-- Logs begin at Tue 2022-05-10 19:33:04 UTC, end at Tue 2022-05-10 20:45:20 UTC. -- May 10 20:12:46.687286 dv-cinder-828806-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 10 20:12:46.694557 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 10 20:12:46.696596 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 20:12:46 2022] *** May 10 20:12:46.696596 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 20:12:46.696596 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 20:12:46.696596 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: nodename: dv-cinder-828806-2-iscsi May 10 20:12:46.696596 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: machine: x86_64 May 10 20:12:46.696596 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: clock source: unix May 10 20:12:46.696596 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: pcre jit disabled May 10 20:12:46.697261 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: detected number of CPU cores: 4 May 10 20:12:46.697261 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: current working directory: / May 10 20:12:46.697261 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: detected binary path: /usr/bin/uwsgi-core May 10 20:12:46.697261 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: your processes number limit is 47680 May 10 20:12:46.697261 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: your memory page size is 4096 bytes May 10 20:12:46.697261 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: detected max file descriptor number: 2048 May 10 20:12:46.697261 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: lock engine: pthread robust mutexes May 10 20:12:46.697261 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: thunder lock: enabled May 10 20:12:46.697261 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 10 20:12:46.702826 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 20:12:46.747226 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: Python main interpreter initialized at 0x56052e21d9c0 May 10 20:12:46.747226 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: python threads support enabled May 10 20:12:46.747226 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: your server socket listen backlog is limited to 100 connections May 10 20:12:46.747226 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: your mercy for graceful operations on workers is 90 seconds May 10 20:12:46.747593 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: mapped 403077 bytes (393 KB) for 2 cores May 10 20:12:46.747701 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: *** Operational MODE: preforking *** May 10 20:12:46.748760 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: *** uWSGI is running in multiple interpreter mode *** May 10 20:12:46.748760 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: spawned uWSGI master process (pid: 80005) May 10 20:12:46.748989 dv-cinder-828806-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 10 20:12:46.750009 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: spawned uWSGI worker 1 (pid: 80020, cores: 1) May 10 20:12:46.750009 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: spawned uWSGI worker 2 (pid: 80021, cores: 1) May 10 20:12:46.750799 dv-cinder-828806-2-iscsi devstack@keystone.service[80005]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 20:12:52.501571 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:12:52.501571 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: from cryptography.utils import int_from_bytes May 10 20:12:52.502843 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:12:52.502843 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: from cryptography.utils import int_from_bytes May 10 20:12:52.506179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:12:52.506179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: from cryptography.utils import int_from_bytes May 10 20:12:52.507452 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:12:52.507452 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: from cryptography.utils import int_from_bytes May 10 20:12:52.552384 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 20:12:52.552561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 20:12:52.552749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] command line args: [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 20:12:52.553173 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 20:12:52.553270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ================================================================================ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 20:12:52.553464 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] admin_token = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.553709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] config_dir = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.553896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.554076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] config_source = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.554255 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] debug = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.554345 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 20:12:52.554490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.554697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 20:12:52.554697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] command line args: [] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 20:12:52.554896 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 20:12:52.555066 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ================================================================================ {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 20:12:52.555315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] admin_token = **** {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.555738 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] config_dir = [] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.556041 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.556220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] config_source = [] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.556539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] debug = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.556740 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.556848 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.557192 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.557416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.557612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.557810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.558033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.558231 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.558424 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.558537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.558815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_config_append = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.559062 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] list_limit = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.559263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.559428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] log_config_append = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.559619 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_dir = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.559817 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.560011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_file = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.560739 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] log_dir = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.560910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.561113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] log_file = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.561285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.561452 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.561595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.561732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.561891 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.562041 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.562169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.562305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.562442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.562621 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.562764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.562894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.563022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.563152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.563292 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.563426 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.563581 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.563711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.563845 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.564008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.564153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.564289 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.564289 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.564553 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.564688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.564816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.564951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.565123 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.565256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.565397 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.565397 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] publish_errors = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.565648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.565648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] publish_errors = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.565896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.566035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.566170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.566170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.566427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.566427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.566734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.566943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.567087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.567227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.567357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] standard_threads = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.567485 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] standard_threads = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.567621 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.567757 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.567886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.568020 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.568149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.568277 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.568414 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_journal = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.568549 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] use_journal = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.568685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_json = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.568814 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] use_json = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.568941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_stderr = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.569130 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] use_stderr = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.569273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] use_syslog = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.569404 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] use_syslog = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.569533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.569667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:12:52.569795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.569929 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.570067 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.570195 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.570323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.570451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.570578 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.570714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.570843 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.570980 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.571108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.571242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.571376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.571579 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.571711 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.571838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.571966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.572093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.572220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.572356 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.572486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.572614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.572756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.572883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.573050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.573200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.573331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.573458 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.573598 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.573732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.573732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.573990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.574121 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.574249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.574377 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.574515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.574644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.574780 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.574909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.575043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.575172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.575300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.575433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.575570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.575706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.576386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.576520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.576655 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.576800 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.576953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.577123 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.577252 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.577380 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.577520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.577649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.577790 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.577920 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.578048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.578176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.578304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.578432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.578638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.578779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.578909 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.579043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.579179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.579313 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.579450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.579579 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.579707 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.579841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.579971 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.580108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.580237 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.580372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.580500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.580644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.580780 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.580918 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.581086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.581215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.581343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.581471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.581598 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.581737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.581875 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.582004 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.582131 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.582259 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.582631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.582775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.582914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.583043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.583171 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.583412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.583754 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.583999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.584166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.584358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.584550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.584742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.584934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.585203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.585415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.585648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.585856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.586052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.586316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.586488 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.586622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.586757 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.586887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.587017 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.587146 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.587284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.587284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.587548 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.587548 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.587791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.587791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.588043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.588182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.588313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.588450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.588589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.588718 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.588847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.589017 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.589169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.589312 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.589447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.589578 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.589708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.589836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.589973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.590104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.590234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.590364 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.590579 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.590743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.590885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.591016 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.591145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.591291 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.591423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.591552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.591552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.591552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.591940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.591940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.591940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.592312 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.592452 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.592582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.592711 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.592840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.592985 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.593132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.593338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.593477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.593619 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.593749 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.593878 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.594015 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.594152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.594282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.594410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.594539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.594676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.594814 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.594964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.595095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.595224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.595353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.595490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.595629 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.595760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.595890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.596018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.596147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.596276 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.596416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.596556 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.596698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.596840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.597012 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.597149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.597278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.597407 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.597547 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.597686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.597823 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.597954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.598083 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.598212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.598354 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.598485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.598614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.598761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.598891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.599020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.599160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.599291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.599456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.599594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.599724 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.599853 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.599991 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] auth.external = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.600122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.600252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.600381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.external = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.600562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.600707 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.600865 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.601028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.601175 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] auth.password = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.601308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.601437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] auth.token = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.601567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.password = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.601697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.601835 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] auth.token = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.601966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.602096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.602226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.602357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.602496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.602836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.603013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.603157 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.603289 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.603419 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.603560 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.603560 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] credential.caching = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.603823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.603823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.604070 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.604200 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.604330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.604479 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.604611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.604611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.604855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.605004 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.605141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.605283 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.605414 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.605544 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.605674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.605674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.605935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.605935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.606192 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.606340 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.606471 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.606471 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.606724 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.606864 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.606996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.606996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.607243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.607373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.607502 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.607640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.607771 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.607901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] federation.caching = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.608048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.608188 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.608326 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.608467 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.608599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.608742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.608879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.609038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.609197 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.609404 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.609538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.609676 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.609812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.609943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.610084 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.610224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.610356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.610486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.610616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.610746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.610876 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.611014 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.611145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.611275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity.caching = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.611406 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.611536 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.611666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.611814 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.611947 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.612082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.612219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.612351 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.612483 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.612621 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.612753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.612883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.613049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.613186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.613328 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.613461 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.613602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.613743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.613873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.614003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.614187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.614323 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.614454 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.614585 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.614715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.614846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.614986 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.615117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.615282 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.615416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.615557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.615688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.615828 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.615959 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.616090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.616220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.616380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.616516 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.616656 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.616788 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.616918 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.617072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.617213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.617350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.617545 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.617679 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.617809 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.617946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.618079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.618217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.618356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.618487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.618616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.618747 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.618877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.619007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.619007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.619275 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.619406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.619537 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.619666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.619797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.619935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.620066 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.620196 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.620326 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.620456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.620594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.620740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.620878 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.621100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.621249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.621380 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.621510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.621656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.621789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.621919 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.622048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.622178 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.622307 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.622445 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.623060 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.623196 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.623326 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.623497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.623650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.623795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.623928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.624057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.624187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.624317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.624446 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.624584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.624715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.624844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.624993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.624993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.625246 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.625388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.625528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.625658 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.625787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.625916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.626047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.626185 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.626315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.626445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.626574 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.626712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.626841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.626979 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.627112 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.627251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.627381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.627510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.627647 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.627778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.627907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.628036 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.628167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.628297 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.628435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.628566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.628695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.628825 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.628955 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.629115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.629258 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.629390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.629519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.629647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.629777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.629906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.630049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.630180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.630320 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.630449 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.630578 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.630804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.630972 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.631106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.631236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.631366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.631497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.631626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.631763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.631894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.632024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.632160 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.632291 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.632421 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.632560 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.632691 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.632830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.632960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.633139 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.633139 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.633397 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.633536 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.633669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.633800 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.633929 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.634059 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.634198 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.634328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.634459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.634588 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.634728 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.634858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.634996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.635133 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.635264 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.635393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.635523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.635652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] resource.caching = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.635855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.635988 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.636118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.636247 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.636376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.636517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.636656 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.636793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.636925 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.637076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.637207 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.637336 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.637486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.637618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.637747 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.637877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.638007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.638137 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.638311 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.638943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] role.caching = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.639077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.639207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] role.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.639338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.639468 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.639616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.639748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.639878 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] role.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.640008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.640139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] role.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.640269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.640407 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.640546 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.640677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.640818 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.640949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.641105 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.641249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.641382 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.641512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.641642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.641774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.641904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.642042 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.642173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.642303 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.642433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.642576 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.642714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.642848 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.642978 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.643108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.643108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.643355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.643499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.643636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.643767 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.643899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.643899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.644145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.644293 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.644425 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.644555 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.644693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.644824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.644956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.645122 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.645254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.645383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.645513 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.645643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.645773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.645911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.646053 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.646183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.646314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.646444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.646574 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.646712 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.646844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.647235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.647369 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.647499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.647629 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.647768 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.647899 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.648030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.648171 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.648302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.648302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] token.caching = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.648557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.648688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.648819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.648949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.649134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.649276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.649408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.649408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.649655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.649784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.649932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.650072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.650205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.650335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.650464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.650464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.650718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.650856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.650987 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.651117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.651248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.651385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.651515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.651653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.651794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.651924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.652061 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.652191 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.652322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.652460 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.652591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.652721 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.652851 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.652998 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.653134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.653134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.653399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.connection = **** {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.653548 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.653699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.653855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.653990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.653990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.654246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.654385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.654516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.654656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.654795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.654927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.655057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.655187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.655326 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.655458 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.655598 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.655729 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.655859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.655989 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.656128 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.656259 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.656390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.656521 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.656651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.656781 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.656920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.657111 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.657243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.657383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.657514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.657645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.657854 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.657988 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.658118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.658248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.658248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80020) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 20:12:52.658494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.658494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.658494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.658494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.658494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:12:52.658494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80021) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 20:12:52.673437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.673646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.673785 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.673918 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.674052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.674185 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.682533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.682744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.712467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.712688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.712840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.713095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.766632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.767056 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.818502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.818769 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.818972 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.819212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.886329 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.886618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.886790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.886933 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.887091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.887231 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.887375 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.887509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.887643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.887784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.887918 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.888051 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.911543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.911757 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.911912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.912053 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.912188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.912331 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.912472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.912612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.912760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.912901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.913095 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.913240 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.913392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.913392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.924804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.924965 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.939700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.939926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.940084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.940228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.940368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.940507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.940659 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.940808 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.940948 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.941122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.941263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.941401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80021) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.941540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.941540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80020) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:12:52.958193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.958407 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 20:12:52.958680 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.958849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.959008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 20:12:52.959153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 20:12:52.959153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.959419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.959419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 20:12:52.959684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.959832 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.959972 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.960112 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.960250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.960388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.960388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.971742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.971742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.972078 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.972226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.972373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.972532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.972678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.972678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.981204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:52.981580 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:52.983753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:52.984033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.984189 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:52.984332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.984482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.984633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.984775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.984921 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.985090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.985243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.985396 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.985537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.985678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.985817 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.985956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.986104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.986245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.986384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.986523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.986671 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.986833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:52.986975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.015239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.016480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.016802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.017386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.019291 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.019573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.022434 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.022713 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.022998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.025097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.025374 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.025648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.030561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.030844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.033024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.033303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.035515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.036269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.036269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.036420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.036698 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.036867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.037174 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.037599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.037917 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.038204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.038480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.038756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.039024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.039293 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.039559 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.039970 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.057098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.057381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.059753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.060027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.062587 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.065139 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.066232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.066529 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.068790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.069100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.071505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.074066 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.075111 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.077714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.078892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.079191 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.079476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.079763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.080045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.080330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.081460 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.081755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.082037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.082324 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.082610 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.082882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.099423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.099836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.100073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.100341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.101857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.102230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.102496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.102756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.108776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.110547 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.110822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.111166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.112888 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.113186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.113905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.114190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.114485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.114770 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.115049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.116219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.116503 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.116780 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.117076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.117357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.129098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.129378 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.129658 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.129946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.130225 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.130515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.130791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.131507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.131780 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.132058 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.132342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.132615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.132884 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.133185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.149124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.151341 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.152405 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.154649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.155770 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.157405 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.157947 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.159061 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.159339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.159517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.159675 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.161153 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.161428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.161720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.167089 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.168716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.169095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.171212 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.172504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.172795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.173106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.173388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.174420 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.174703 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.174984 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.175256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.182651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.182946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.183231 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.184442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.184724 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.185030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.191813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80021) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.192098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.192379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.192656 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.192927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.193243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.193518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.193797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.193956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80020) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:12:53.194098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.194239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.194380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.194530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.194672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.194812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.194961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.195156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.195299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.195440 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.195610 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80021) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.195751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.195751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.196026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.196167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.196401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.196666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.196934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.197217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80020) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:12:53.234690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56052e21d9c0 pid: 80021 (default app) May 10 20:12:53.236799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56052e21d9c0 pid: 80020 (default app) May 10 20:12:53.238068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2081cf7-185b-49ff-8b9d-fcc6affa68dd None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:12:53.238370 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2081cf7-185b-49ff-8b9d-fcc6affa68dd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:12:53.238663 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2081cf7-185b-49ff-8b9d-fcc6affa68dd None None] PATH_INFO: `/v3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:12:53.242880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Tue May 10 20:12:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:01.177373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642ac9c-3b30-436b-ac7d-9308df2d269b None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:01.177940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642ac9c-3b30-436b-ac7d-9308df2d269b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:01.177940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642ac9c-3b30-436b-ac7d-9308df2d269b None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:01.182543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:13:01.187933 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e0310-89b3-44bc-abbf-bfedda96584f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:01.188412 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e0310-89b3-44bc-abbf-bfedda96584f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:01.188500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e0310-89b3-44bc-abbf-bfedda96584f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:01.219759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG oslo_db.sqlalchemy.engines [None req-194e0310-89b3-44bc-abbf-bfedda96584f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80021) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:13:01.402924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG passlib.handlers.bcrypt [None req-194e0310-89b3-44bc-abbf-bfedda96584f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80021) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 20:13:01.403350 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG passlib.handlers.bcrypt [None req-194e0310-89b3-44bc-abbf-bfedda96584f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80021) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 20:13:01.459957 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-194e0310-89b3-44bc-abbf-bfedda96584f None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:01.461585 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-194e0310-89b3-44bc-abbf-bfedda96584f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:01.584299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 2/3] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 20:13:01.701200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642ac9c-3b30-436b-ac7d-9308df2d269b None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:01.737055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG oslo_db.sqlalchemy.engines [None req-8642ac9c-3b30-436b-ac7d-9308df2d269b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80020) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:13:01.866933 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642ac9c-3b30-436b-ac7d-9308df2d269b None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:01.871166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6826c9-3b27-49dc-b0e3-9558706c56dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:01.871823 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6826c9-3b27-49dc-b0e3-9558706c56dc admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:01.872107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6826c9-3b27-49dc-b0e3-9558706c56dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:01.872899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6826c9-3b27-49dc-b0e3-9558706c56dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:01.881029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6826c9-3b27-49dc-b0e3-9558706c56dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:01.933084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0d6826c9-3b27-49dc-b0e3-9558706c56dc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 20:13:01.933428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6826c9-3b27-49dc-b0e3-9558706c56dc admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:01.944117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1324 bytes} [Tue May 10 20:13:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:13:01.949903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e0310-89b3-44bc-abbf-bfedda96584f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:01.963870 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e0310-89b3-44bc-abbf-bfedda96584f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:01.968275 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6b95f-1ec9-4d5a-b927-3e5f99fa929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:01.969449 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6b95f-1ec9-4d5a-b927-3e5f99fa929e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:01.969734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6b95f-1ec9-4d5a-b927-3e5f99fa929e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:01.970007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6b95f-1ec9-4d5a-b927-3e5f99fa929e admin admin] PATH_INFO: `/v3/projects/92bd0a8a7f7646abb6287b06cfd28dac` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:01.971545 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6b95f-1ec9-4d5a-b927-3e5f99fa929e admin admin] RBAC: Authorizing `identity:get_project(project_id=92bd0a8a7f7646abb6287b06cfd28dac)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:02.022662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: WARNING keystone.common.rbac_enforcer.enforcer [None req-34c6b95f-1ec9-4d5a-b927-3e5f99fa929e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 20:13:02.023004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6b95f-1ec9-4d5a-b927-3e5f99fa929e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:02.027681 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 3/5] 10.222.0.61 () {56 vars in 1207 bytes} [Tue May 10 20:13:01 2022] GET /identity/v3/projects/92bd0a8a7f7646abb6287b06cfd28dac => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:04.226868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c58fb-ebc2-4121-8d03-43fc314e61c8 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:04.227403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c58fb-ebc2-4121-8d03-43fc314e61c8 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:04.227403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c58fb-ebc2-4121-8d03-43fc314e61c8 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:04.231597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 3/6] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:04.236932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81c2be-f589-4fdf-9685-9491a7c19233 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:04.237384 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81c2be-f589-4fdf-9685-9491a7c19233 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:04.237519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81c2be-f589-4fdf-9685-9491a7c19233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:04.257748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4c81c2be-f589-4fdf-9685-9491a7c19233 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:04.259250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4c81c2be-f589-4fdf-9685-9491a7c19233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:04.267605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 4/7] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 20:13:04.291068 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c58fb-ebc2-4121-8d03-43fc314e61c8 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:04.303651 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c58fb-ebc2-4121-8d03-43fc314e61c8 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:04.307994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245da50-1cd0-4812-93e2-8124ec31e9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:04.308662 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245da50-1cd0-4812-93e2-8124ec31e9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:04.308948 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245da50-1cd0-4812-93e2-8124ec31e9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:04.309284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245da50-1cd0-4812-93e2-8124ec31e9b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:04.317859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245da50-1cd0-4812-93e2-8124ec31e9b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:04.319702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245da50-1cd0-4812-93e2-8124ec31e9b0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:04.329726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1324 bytes} [Tue May 10 20:13:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:13:04.335805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81c2be-f589-4fdf-9685-9491a7c19233 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:04.345603 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81c2be-f589-4fdf-9685-9491a7c19233 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:04.350088 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09433934-ad0f-4ecc-a561-d789ebbeeb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:04.350976 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09433934-ad0f-4ecc-a561-d789ebbeeb99 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:04.351263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09433934-ad0f-4ecc-a561-d789ebbeeb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:04.351540 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09433934-ad0f-4ecc-a561-d789ebbeeb99 admin admin] PATH_INFO: `/v3/users/caf7948704bc4cd8813f309af89db439` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:04.353006 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09433934-ad0f-4ecc-a561-d789ebbeeb99 admin admin] RBAC: Authorizing `identity:get_user(user_id=caf7948704bc4cd8813f309af89db439)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:04.354892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09433934-ad0f-4ecc-a561-d789ebbeeb99 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:04.356560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 5/9] 10.222.0.61 () {56 vars in 1198 bytes} [Tue May 10 20:13:04 2022] GET /identity/v3/users/caf7948704bc4cd8813f309af89db439 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:06.613583 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ea355-498d-486f-987f-7a49a271bb71 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:06.614121 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ea355-498d-486f-987f-7a49a271bb71 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:06.614121 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ea355-498d-486f-987f-7a49a271bb71 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:06.615472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:06.620649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf15cc-3165-4366-ace5-b578c45d32d7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:06.621062 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf15cc-3165-4366-ace5-b578c45d32d7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:06.621359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf15cc-3165-4366-ace5-b578c45d32d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:06.663271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92abc6-002f-4af2-9fb7-6f9a80f19a64 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:06.663563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92abc6-002f-4af2-9fb7-6f9a80f19a64 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:06.663846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92abc6-002f-4af2-9fb7-6f9a80f19a64 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:06.665269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 6/11] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:13:06.671625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50079cd-f094-4b60-9046-9f978b9e770c None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:06.671911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50079cd-f094-4b60-9046-9f978b9e770c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:06.672190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50079cd-f094-4b60-9046-9f978b9e770c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:06.713536 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG passlib.handlers.bcrypt [None req-a50079cd-f094-4b60-9046-9f978b9e770c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80020) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 20:13:06.713962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG passlib.handlers.bcrypt [None req-a50079cd-f094-4b60-9046-9f978b9e770c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80020) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 20:13:06.748435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f8cf15cc-3165-4366-ace5-b578c45d32d7 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:06.749662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f8cf15cc-3165-4366-ace5-b578c45d32d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:06.761256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-a50079cd-f094-4b60-9046-9f978b9e770c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:06.762823 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a50079cd-f094-4b60-9046-9f978b9e770c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:06.825709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:06.848406 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf15cc-3165-4366-ace5-b578c45d32d7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:06.860656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:06.881624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50079cd-f094-4b60-9046-9f978b9e770c None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:06.941650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf15cc-3165-4366-ace5-b578c45d32d7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:06.973417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396eebf-7d82-4a47-b35a-781df8150d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:06.974219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396eebf-7d82-4a47-b35a-781df8150d65 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:06.974511 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396eebf-7d82-4a47-b35a-781df8150d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:06.974793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396eebf-7d82-4a47-b35a-781df8150d65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:06.975398 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50079cd-f094-4b60-9046-9f978b9e770c None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:06.986539 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396eebf-7d82-4a47-b35a-781df8150d65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-f396eebf-7d82-4a47-b35a-781df8150d65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:06.997665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:06.998651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:06.999466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:06.999466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:06.999466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:06.999466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:06.999466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:06.999466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:06.999466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:06.999466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:06.999466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:06.999466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:06.999466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:06.999466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:06.999466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 7/14] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:13:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:13:07.004535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396eebf-7d82-4a47-b35a-781df8150d65 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:07.011231 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063b6ee-4206-4efb-b6ea-d98c12fe14d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:07.012142 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063b6ee-4206-4efb-b6ea-d98c12fe14d3 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:07.012431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063b6ee-4206-4efb-b6ea-d98c12fe14d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:07.012711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063b6ee-4206-4efb-b6ea-d98c12fe14d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:07.076482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063b6ee-4206-4efb-b6ea-d98c12fe14d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:07.078106 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063b6ee-4206-4efb-b6ea-d98c12fe14d3 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:07.097785 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396eebf-7d82-4a47-b35a-781df8150d65 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:07.129462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0b25f-8c04-46bd-932a-5992d737debb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:07.130121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0b25f-8c04-46bd-932a-5992d737debb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:07.130412 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0b25f-8c04-46bd-932a-5992d737debb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:07.130690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0b25f-8c04-46bd-932a-5992d737debb None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:07.131443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0b25f-8c04-46bd-932a-5992d737debb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:07.131818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0b25f-8c04-46bd-932a-5992d737debb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:07.133194 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0b25f-8c04-46bd-932a-5992d737debb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:07.145051 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 8/15] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:07.150655 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0b25f-8c04-46bd-932a-5992d737debb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:07.169972 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 20:13:07.175411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063b6ee-4206-4efb-b6ea-d98c12fe14d3 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:07.244959 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0b25f-8c04-46bd-932a-5992d737debb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:07.267271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063b6ee-4206-4efb-b6ea-d98c12fe14d3 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:07.276821 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f595a9f-ac0e-4f2a-857d-62615c670c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:07.277712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f595a9f-ac0e-4f2a-857d-62615c670c90 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:07.277996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f595a9f-ac0e-4f2a-857d-62615c670c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:07.278274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f595a9f-ac0e-4f2a-857d-62615c670c90 None admin] PATH_INFO: `/v3/users/caf7948704bc4cd8813f309af89db439` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:07.279470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f595a9f-ac0e-4f2a-857d-62615c670c90 None admin] RBAC: Authorizing `identity:get_user(user_id=caf7948704bc4cd8813f309af89db439)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:07.280929 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f595a9f-ac0e-4f2a-857d-62615c670c90 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:07.282551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 9/17] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:07 2022] GET /identity/v3/users/caf7948704bc4cd8813f309af89db439 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:07.287904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f595a9f-ac0e-4f2a-857d-62615c670c90 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:07.299727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91a6fd-ddcb-4143-a801-442ddecd7b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:07.300515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91a6fd-ddcb-4143-a801-442ddecd7b81 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:07.300799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91a6fd-ddcb-4143-a801-442ddecd7b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:07.301102 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91a6fd-ddcb-4143-a801-442ddecd7b81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:07.392594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f595a9f-ac0e-4f2a-857d-62615c670c90 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:07.426899 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c0bbf-4754-4673-9a61-d053598d134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:07.427698 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c0bbf-4754-4673-9a61-d053598d134e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:07.427992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c0bbf-4754-4673-9a61-d053598d134e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:07.428273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c0bbf-4754-4673-9a61-d053598d134e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:07.428468 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91a6fd-ddcb-4143-a801-442ddecd7b81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:07.429500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c0bbf-4754-4673-9a61-d053598d134e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:07.430140 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91a6fd-ddcb-4143-a801-442ddecd7b81 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:07.430942 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c0bbf-4754-4673-9a61-d053598d134e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:07.432553 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 10/18] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:07.438728 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c0bbf-4754-4673-9a61-d053598d134e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-0a91a6fd-ddcb-4143-a801-442ddecd7b81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:13:07.451412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:07.452394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:07.453395 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:13:07.453395 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:13:07.453395 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:13:07.453395 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:07.453395 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 9/19] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:13:07.458855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91a6fd-ddcb-4143-a801-442ddecd7b81 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:07.531956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c0bbf-4754-4673-9a61-d053598d134e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:07.553201 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91a6fd-ddcb-4143-a801-442ddecd7b81 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:07.563362 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65f8eb-aa36-4a3f-bd86-5f3efe4da057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:07.564021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65f8eb-aa36-4a3f-bd86-5f3efe4da057 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:07.564310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65f8eb-aa36-4a3f-bd86-5f3efe4da057 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:07.564593 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65f8eb-aa36-4a3f-bd86-5f3efe4da057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:07.565458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65f8eb-aa36-4a3f-bd86-5f3efe4da057 None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.domain.id=default, user.id=caf7948704bc4cd8813f309af89db439) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:07.565776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65f8eb-aa36-4a3f-bd86-5f3efe4da057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:07.567221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65f8eb-aa36-4a3f-bd86-5f3efe4da057 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:07.573676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 11/20] 10.222.0.61 () {56 vars in 1322 bytes} [Tue May 10 20:13:07 2022] GET /identity/v3/role_assignments?user.id=caf7948704bc4cd8813f309af89db439&scope.domain.id=default&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 233 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:07.585388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c059846-688d-4b18-ab59-e972040ee5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:07.586082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c059846-688d-4b18-ab59-e972040ee5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:07.586366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c059846-688d-4b18-ab59-e972040ee5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:07.586643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c059846-688d-4b18-ab59-e972040ee5d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:07.587391 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c059846-688d-4b18-ab59-e972040ee5d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:07.587699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c059846-688d-4b18-ab59-e972040ee5d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:07.589166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c059846-688d-4b18-ab59-e972040ee5d6 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:07.609334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 10/21] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:10.061877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c9eb6-728c-4a92-9ef5-b8be634c5a95 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:10.062421 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c9eb6-728c-4a92-9ef5-b8be634c5a95 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:10.062421 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c9eb6-728c-4a92-9ef5-b8be634c5a95 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:10.064052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 12/22] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:10.075113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caee8b9-d182-4148-a5f7-2d02bfb06e2a None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:10.076116 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caee8b9-d182-4148-a5f7-2d02bfb06e2a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:10.076229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caee8b9-d182-4148-a5f7-2d02bfb06e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:10.107530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-9caee8b9-d182-4148-a5f7-2d02bfb06e2a None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:10.109530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9caee8b9-d182-4148-a5f7-2d02bfb06e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:10.232928 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 11/23] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:10.268015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c9eb6-728c-4a92-9ef5-b8be634c5a95 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:10.372157 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c9eb6-728c-4a92-9ef5-b8be634c5a95 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:10.407566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78841bd9-eb0f-46c9-947d-79814bbec337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:10.408600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78841bd9-eb0f-46c9-947d-79814bbec337 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:10.409081 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78841bd9-eb0f-46c9-947d-79814bbec337 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:10.409501 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78841bd9-eb0f-46c9-947d-79814bbec337 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:10.420100 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78841bd9-eb0f-46c9-947d-79814bbec337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-78841bd9-eb0f-46c9-947d-79814bbec337 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:10.428020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:10.429161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:10.430119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:10.430119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:10.430119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:10.430119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:10.430119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:10.430119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:10.430119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:10.430119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:10.430119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:10.430119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:10.430119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:10.430119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:10.432518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 13/24] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:13:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:10.438114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caee8b9-d182-4148-a5f7-2d02bfb06e2a None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:10.560193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caee8b9-d182-4148-a5f7-2d02bfb06e2a None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:10.601909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c049ea-45c6-4712-949b-2893f9e92df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:10.602862 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c049ea-45c6-4712-949b-2893f9e92df8 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:10.603289 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c049ea-45c6-4712-949b-2893f9e92df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:10.603706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c049ea-45c6-4712-949b-2893f9e92df8 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:10.604620 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c049ea-45c6-4712-949b-2893f9e92df8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:10.605107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c049ea-45c6-4712-949b-2893f9e92df8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:10.606689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c049ea-45c6-4712-949b-2893f9e92df8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:10.623644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 12/25] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:10.629396 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78841bd9-eb0f-46c9-947d-79814bbec337 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:10.761267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78841bd9-eb0f-46c9-947d-79814bbec337 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:10.801413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ab2ef-8720-45df-9986-465c2d4c6e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:10.802613 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ab2ef-8720-45df-9986-465c2d4c6e7a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:10.803041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ab2ef-8720-45df-9986-465c2d4c6e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:10.803474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ab2ef-8720-45df-9986-465c2d4c6e7a None admin] PATH_INFO: `/v3/users/caf7948704bc4cd8813f309af89db439` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:10.804822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ab2ef-8720-45df-9986-465c2d4c6e7a None admin] RBAC: Authorizing `identity:get_user(user_id=caf7948704bc4cd8813f309af89db439)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:10.806454 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ab2ef-8720-45df-9986-465c2d4c6e7a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:10.808611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 14/26] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:10 2022] GET /identity/v3/users/caf7948704bc4cd8813f309af89db439 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:10.814249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c049ea-45c6-4712-949b-2893f9e92df8 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:10.892833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810c31-82fd-4801-b234-8b291c39ce02 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:10.893369 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810c31-82fd-4801-b234-8b291c39ce02 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:10.893802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4810c31-82fd-4801-b234-8b291c39ce02 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:10.895475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 15/27] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:13:10.901382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b1d6e-e80a-4f25-88a7-7e6c751b1153 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:10.901873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b1d6e-e80a-4f25-88a7-7e6c751b1153 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:10.902321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b1d6e-e80a-4f25-88a7-7e6c751b1153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:10.938965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-012b1d6e-e80a-4f25-88a7-7e6c751b1153 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:10.940463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-012b1d6e-e80a-4f25-88a7-7e6c751b1153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:10.940912 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c049ea-45c6-4712-949b-2893f9e92df8 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:11.013784 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c2b7b-1662-40a7-8ce9-3453cf14f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:11.014617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c2b7b-1662-40a7-8ce9-3453cf14f441 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:11.014909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c2b7b-1662-40a7-8ce9-3453cf14f441 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:11.015195 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c2b7b-1662-40a7-8ce9-3453cf14f441 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:11.016790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c2b7b-1662-40a7-8ce9-3453cf14f441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:11.018401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c2b7b-1662-40a7-8ce9-3453cf14f441 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:11.020038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 13/28] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:11.041303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c2b7b-1662-40a7-8ce9-3453cf14f441 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:11.055905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 16/29] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:11.090669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b1d6e-e80a-4f25-88a7-7e6c751b1153 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:11.176233 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c2b7b-1662-40a7-8ce9-3453cf14f441 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:11.214535 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6ccac-901f-4cc0-b516-5133b7a6b7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:11.215472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6ccac-901f-4cc0-b516-5133b7a6b7fa None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:11.215764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6ccac-901f-4cc0-b516-5133b7a6b7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:11.216086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6ccac-901f-4cc0-b516-5133b7a6b7fa None admin] PATH_INFO: `/v3/domains/default/users/caf7948704bc4cd8813f309af89db439/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:11.218390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6ccac-901f-4cc0-b516-5133b7a6b7fa None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=caf7948704bc4cd8813f309af89db439, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:11.219928 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6ccac-901f-4cc0-b516-5133b7a6b7fa None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:11.226676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b1d6e-e80a-4f25-88a7-7e6c751b1153 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:11.284550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407cb36-cfb2-4759-b1ff-74a7da40d1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:11.285286 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407cb36-cfb2-4759-b1ff-74a7da40d1db None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:11.285569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407cb36-cfb2-4759-b1ff-74a7da40d1db None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:11.286040 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407cb36-cfb2-4759-b1ff-74a7da40d1db None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:11.286970 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407cb36-cfb2-4759-b1ff-74a7da40d1db None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:11.288671 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407cb36-cfb2-4759-b1ff-74a7da40d1db None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:11.381495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 14/30] 10.222.0.61 () {58 vars in 1361 bytes} [Tue May 10 20:13:11 2022] PUT /identity/v3/domains/default/users/caf7948704bc4cd8813f309af89db439/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:13:11.383401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52355f55-c9c3-4caa-95ee-b3ca45ffe618 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:11.383694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52355f55-c9c3-4caa-95ee-b3ca45ffe618 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:11.383979 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52355f55-c9c3-4caa-95ee-b3ca45ffe618 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:11.388532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 15/31] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:11.389855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ce2ba-19dd-44c6-a72e-6d0baa9d2cb1 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:11.390207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ce2ba-19dd-44c6-a72e-6d0baa9d2cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:11.390492 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ce2ba-19dd-44c6-a72e-6d0baa9d2cb1 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:11.391883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 16/32] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:11.397675 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ad5b5-cbef-4182-95b7-9383a402b1d6 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:11.397958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ad5b5-cbef-4182-95b7-9383a402b1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:11.398233 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ad5b5-cbef-4182-95b7-9383a402b1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:11.418945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-ed4ad5b5-cbef-4182-95b7-9383a402b1d6 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:11.420201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 17/33] 10.222.0.61 () {60 vars in 1131 bytes} [Tue May 10 20:13:11 2022] POST /identity/v3/roles => generated 225 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:13:11.421120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ed4ad5b5-cbef-4182-95b7-9383a402b1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:11.421826 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bdbe8-e2a1-4b8c-97fd-10c662177590 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:11.422125 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bdbe8-e2a1-4b8c-97fd-10c662177590 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:11.422411 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bdbe8-e2a1-4b8c-97fd-10c662177590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:11.458198 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b33bdbe8-e2a1-4b8c-97fd-10c662177590 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:11.459884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b33bdbe8-e2a1-4b8c-97fd-10c662177590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:11.504077 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 17/34] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:11.505181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18604153-b549-423b-bd6b-ce69417a1037 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:11.505472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18604153-b549-423b-bd6b-ce69417a1037 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:11.505819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18604153-b549-423b-bd6b-ce69417a1037 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:11.507370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 18/35] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:11.523729 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f047-186c-4445-9f63-4690fc5d96dd None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:11.524029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f047-186c-4445-9f63-4690fc5d96dd None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:11.524283 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1f047-186c-4445-9f63-4690fc5d96dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:11.562241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-91e1f047-186c-4445-9f63-4690fc5d96dd None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:11.563541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-91e1f047-186c-4445-9f63-4690fc5d96dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:11.615072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 18/36] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:11.616053 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bdbe8-e2a1-4b8c-97fd-10c662177590 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:11.694850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 19/37] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:11.694850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1f047-186c-4445-9f63-4690fc5d96dd None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:11.763662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bdbe8-e2a1-4b8c-97fd-10c662177590 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:11.802355 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d01c6-c61f-4343-96f9-1c34acfe5741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:11.803188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d01c6-c61f-4343-96f9-1c34acfe5741 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:11.803479 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d01c6-c61f-4343-96f9-1c34acfe5741 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:11.803761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d01c6-c61f-4343-96f9-1c34acfe5741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:11.815199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d01c6-c61f-4343-96f9-1c34acfe5741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:11.816830 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d01c6-c61f-4343-96f9-1c34acfe5741 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:11.821382 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1f047-186c-4445-9f63-4690fc5d96dd None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-fe0d01c6-c61f-4343-96f9-1c34acfe5741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:13:11.840375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:11.841332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:11.842118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:13:11.842118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:13:11.842118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:13:11.842118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:11.844441 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 19/38] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:11.844441 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d01c6-c61f-4343-96f9-1c34acfe5741 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:11.888890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbf6f7-54a7-4ae8-ae27-f2c29a466f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:11.889963 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbf6f7-54a7-4ae8-ae27-f2c29a466f40 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:11.890257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbf6f7-54a7-4ae8-ae27-f2c29a466f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:11.890540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbf6f7-54a7-4ae8-ae27-f2c29a466f40 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:11.891308 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbf6f7-54a7-4ae8-ae27-f2c29a466f40 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:11.893785 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbf6f7-54a7-4ae8-ae27-f2c29a466f40 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:11.916617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 20/39] 10.222.0.61 () {60 vars in 1131 bytes} [Tue May 10 20:13:11 2022] POST /identity/v3/roles => generated 219 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:13:11.918224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbf6f7-54a7-4ae8-ae27-f2c29a466f40 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:12.002948 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d01c6-c61f-4343-96f9-1c34acfe5741 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:12.042682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbf6f7-54a7-4ae8-ae27-f2c29a466f40 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:12.053712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6e892-7ad9-486a-97dd-4ae86cf79cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:12.055116 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6e892-7ad9-486a-97dd-4ae86cf79cde None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:12.055899 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6e892-7ad9-486a-97dd-4ae86cf79cde None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:12.056385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6e892-7ad9-486a-97dd-4ae86cf79cde None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:12.057582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6e892-7ad9-486a-97dd-4ae86cf79cde None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:12.060218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6e892-7ad9-486a-97dd-4ae86cf79cde None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:12.079111 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 20/40] 10.222.0.61 () {60 vars in 1131 bytes} [Tue May 10 20:13:11 2022] POST /identity/v3/roles => generated 223 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:13:12.081130 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff080b-0ab3-4df9-9e17-5db1b28d52bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:12.081625 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069124b5-65dc-4519-ba1a-70c6a4f5ec23 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:12.081833 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff080b-0ab3-4df9-9e17-5db1b28d52bf None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:12.082185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff080b-0ab3-4df9-9e17-5db1b28d52bf None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:12.082476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff080b-0ab3-4df9-9e17-5db1b28d52bf None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:12.082781 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069124b5-65dc-4519-ba1a-70c6a4f5ec23 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:12.083388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff080b-0ab3-4df9-9e17-5db1b28d52bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:12.083721 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069124b5-65dc-4519-ba1a-70c6a4f5ec23 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:12.083839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff080b-0ab3-4df9-9e17-5db1b28d52bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:12.085431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff080b-0ab3-4df9-9e17-5db1b28d52bf None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:12.086311 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 21/41] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:12.093023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e04a87-ff77-47ac-a01e-59fa57aafac3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:12.093023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e04a87-ff77-47ac-a01e-59fa57aafac3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:12.094097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e04a87-ff77-47ac-a01e-59fa57aafac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:12.100509 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 21/42] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:12.107956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff080b-0ab3-4df9-9e17-5db1b28d52bf None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:12.130750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c6e04a87-ff77-47ac-a01e-59fa57aafac3 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:12.132051 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c6e04a87-ff77-47ac-a01e-59fa57aafac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:12.247843 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 22/43] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:12.249377 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff080b-0ab3-4df9-9e17-5db1b28d52bf None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:12.278293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e04a87-ff77-47ac-a01e-59fa57aafac3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:12.289410 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41213125-7dd4-44f6-90ec-ea6384b969a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:12.290096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41213125-7dd4-44f6-90ec-ea6384b969a8 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:12.290475 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41213125-7dd4-44f6-90ec-ea6384b969a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:12.290769 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41213125-7dd4-44f6-90ec-ea6384b969a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:12.291497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41213125-7dd4-44f6-90ec-ea6384b969a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:12.292957 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41213125-7dd4-44f6-90ec-ea6384b969a8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:12.332069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 22/44] 10.222.0.61 () {60 vars in 1141 bytes} [Tue May 10 20:13:12 2022] POST /identity/v3/projects => generated 301 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:13:12.409190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e04a87-ff77-47ac-a01e-59fa57aafac3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:12.446300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8b516-b830-4d62-b637-a046a0a58d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:12.447203 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8b516-b830-4d62-b637-a046a0a58d63 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:12.447381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8b516-b830-4d62-b637-a046a0a58d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:12.447659 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8b516-b830-4d62-b637-a046a0a58d63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:12.448877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8b516-b830-4d62-b637-a046a0a58d63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:12.450398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8b516-b830-4d62-b637-a046a0a58d63 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:12.452274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 23/45] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:12.457645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41213125-7dd4-44f6-90ec-ea6384b969a8 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:12.568218 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41213125-7dd4-44f6-90ec-ea6384b969a8 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:12.608176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c5518-5d68-4722-a9d7-6c37100f2e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:12.608844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5518-5d68-4722-a9d7-6c37100f2e48 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:12.609161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5518-5d68-4722-a9d7-6c37100f2e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:12.609446 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c5518-5d68-4722-a9d7-6c37100f2e48 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:12.610168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c5518-5d68-4722-a9d7-6c37100f2e48 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:12.611624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c5518-5d68-4722-a9d7-6c37100f2e48 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:12.635861 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 23/46] 10.222.0.61 () {60 vars in 1141 bytes} [Tue May 10 20:13:12 2022] POST /identity/v3/projects => generated 312 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:13:13.891584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d891edf-1730-4326-81d3-f9232faa9076 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:13.892262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d891edf-1730-4326-81d3-f9232faa9076 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:13.892262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d891edf-1730-4326-81d3-f9232faa9076 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:13.893523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 24/47] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:13.899391 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f86b6d-87df-4fb5-b9c0-6bf5f462b79b None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:13.899799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f86b6d-87df-4fb5-b9c0-6bf5f462b79b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:13.899950 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f86b6d-87df-4fb5-b9c0-6bf5f462b79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:13.916805 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b1f86b6d-87df-4fb5-b9c0-6bf5f462b79b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:13.918026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b1f86b6d-87df-4fb5-b9c0-6bf5f462b79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:13.980352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 24/48] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:14.003637 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d891edf-1730-4326-81d3-f9232faa9076 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:14.098265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d891edf-1730-4326-81d3-f9232faa9076 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:14.129984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c85374-afed-4767-a6ae-225d2ce7292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:14.130766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85374-afed-4767-a6ae-225d2ce7292f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:14.131053 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85374-afed-4767-a6ae-225d2ce7292f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:14.131340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85374-afed-4767-a6ae-225d2ce7292f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:14.140958 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c85374-afed-4767-a6ae-225d2ce7292f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d7c85374-afed-4767-a6ae-225d2ce7292f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:14.148760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:14.149917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:14.150797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:14.150797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:14.150797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:14.150797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:14.150797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:14.150797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:14.150797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:14.150797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:14.150797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:14.150797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:14.150797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:14.150797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:14.150797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 25/49] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:13:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:14.155629 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f86b6d-87df-4fb5-b9c0-6bf5f462b79b None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:14.246164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f86b6d-87df-4fb5-b9c0-6bf5f462b79b None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:14.277777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306eba03-9b69-4618-82ab-8b574fef57b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:14.278966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eba03-9b69-4618-82ab-8b574fef57b6 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:14.279245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eba03-9b69-4618-82ab-8b574fef57b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:14.279514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eba03-9b69-4618-82ab-8b574fef57b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:14.280259 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306eba03-9b69-4618-82ab-8b574fef57b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:14.280564 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306eba03-9b69-4618-82ab-8b574fef57b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:14.281952 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306eba03-9b69-4618-82ab-8b574fef57b6 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:14.289701 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 25/50] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:14.295673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c85374-afed-4767-a6ae-225d2ce7292f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:14.388445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c85374-afed-4767-a6ae-225d2ce7292f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:14.421464 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346441ae-3822-40f5-887d-1566798e0a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:14.422265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346441ae-3822-40f5-887d-1566798e0a55 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:14.422549 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346441ae-3822-40f5-887d-1566798e0a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:14.422827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346441ae-3822-40f5-887d-1566798e0a55 None admin] PATH_INFO: `/v3/users/caf7948704bc4cd8813f309af89db439` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:14.424012 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346441ae-3822-40f5-887d-1566798e0a55 None admin] RBAC: Authorizing `identity:get_user(user_id=caf7948704bc4cd8813f309af89db439)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:14.425516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346441ae-3822-40f5-887d-1566798e0a55 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:14.427158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 26/51] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:14 2022] GET /identity/v3/users/caf7948704bc4cd8813f309af89db439 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:14.432601 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306eba03-9b69-4618-82ab-8b574fef57b6 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:14.526350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306eba03-9b69-4618-82ab-8b574fef57b6 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:14.558573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafa6a7-bf7e-4502-b9c5-87d3819199ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:14.559362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafa6a7-bf7e-4502-b9c5-87d3819199ce None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:14.559677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafa6a7-bf7e-4502-b9c5-87d3819199ce None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:14.559954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafa6a7-bf7e-4502-b9c5-87d3819199ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:14.561156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafa6a7-bf7e-4502-b9c5-87d3819199ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:14.562596 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafa6a7-bf7e-4502-b9c5-87d3819199ce None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:14.564204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 26/52] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:14.569838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346441ae-3822-40f5-887d-1566798e0a55 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:14.665358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346441ae-3822-40f5-887d-1566798e0a55 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:14.699310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b15ee-2aba-46e6-8d6f-693a4b7d6cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:14.699888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b15ee-2aba-46e6-8d6f-693a4b7d6cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:14.700833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b15ee-2aba-46e6-8d6f-693a4b7d6cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:14.701161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b15ee-2aba-46e6-8d6f-693a4b7d6cd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:14.701997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b15ee-2aba-46e6-8d6f-693a4b7d6cd4 None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.domain.id=default, user.id=caf7948704bc4cd8813f309af89db439) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:14.702315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b15ee-2aba-46e6-8d6f-693a4b7d6cd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:14.703757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b15ee-2aba-46e6-8d6f-693a4b7d6cd4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:14.709396 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 27/53] 10.222.0.61 () {56 vars in 1322 bytes} [Tue May 10 20:13:14 2022] GET /identity/v3/role_assignments?user.id=caf7948704bc4cd8813f309af89db439&scope.domain.id=default&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:14.855608 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c64548-d4c7-4a46-9f4f-44c84417ce04 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:14.855900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c64548-d4c7-4a46-9f4f-44c84417ce04 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:14.856182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c64548-d4c7-4a46-9f4f-44c84417ce04 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:14.857661 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 27/54] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:14.863429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766783f-4cae-47d7-8c20-6402e6289a87 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:14.863718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766783f-4cae-47d7-8c20-6402e6289a87 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:14.863995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766783f-4cae-47d7-8c20-6402e6289a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:14.880557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9766783f-4cae-47d7-8c20-6402e6289a87 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:14.881771 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9766783f-4cae-47d7-8c20-6402e6289a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:14.947560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 28/55] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:14.974649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c64548-d4c7-4a46-9f4f-44c84417ce04 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:15.069170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c64548-d4c7-4a46-9f4f-44c84417ce04 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:15.099713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0584a3-cd16-42ff-9eef-8f9a7124d058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:15.100489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0584a3-cd16-42ff-9eef-8f9a7124d058 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:15.100771 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0584a3-cd16-42ff-9eef-8f9a7124d058 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:15.101074 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0584a3-cd16-42ff-9eef-8f9a7124d058 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:15.102223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0584a3-cd16-42ff-9eef-8f9a7124d058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:15.103645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0584a3-cd16-42ff-9eef-8f9a7124d058 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:15.105246 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 28/56] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:15.111187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766783f-4cae-47d7-8c20-6402e6289a87 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:15.202409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766783f-4cae-47d7-8c20-6402e6289a87 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:15.233589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27509072-15d3-4583-9f38-7be42407137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:15.234181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509072-15d3-4583-9f38-7be42407137c None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:15.234462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509072-15d3-4583-9f38-7be42407137c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:15.234738 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509072-15d3-4583-9f38-7be42407137c None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:15.235445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27509072-15d3-4583-9f38-7be42407137c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:15.236886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27509072-15d3-4583-9f38-7be42407137c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:15.262220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 29/57] 10.222.0.61 () {60 vars in 1140 bytes} [Tue May 10 20:13:15 2022] POST /identity/v3/projects => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:13:17.430911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2b541-7cd8-42fe-8180-5a4959fb5553 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:17.431415 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2b541-7cd8-42fe-8180-5a4959fb5553 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:17.431498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2b541-7cd8-42fe-8180-5a4959fb5553 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:17.432826 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 29/58] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:17.438005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea3f1-ef0c-426b-8a63-279620a8b3ed None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:17.438376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea3f1-ef0c-426b-8a63-279620a8b3ed None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:17.438569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ea3f1-ef0c-426b-8a63-279620a8b3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:17.455061 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a58ea3f1-ef0c-426b-8a63-279620a8b3ed None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:17.456224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a58ea3f1-ef0c-426b-8a63-279620a8b3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:17.517094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 30/59] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:17.541036 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2b541-7cd8-42fe-8180-5a4959fb5553 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:17.642710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2b541-7cd8-42fe-8180-5a4959fb5553 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:17.674057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572ab19-91ed-4cb6-a5cf-ad7ccad08afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:17.674837 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572ab19-91ed-4cb6-a5cf-ad7ccad08afb None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:17.675118 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572ab19-91ed-4cb6-a5cf-ad7ccad08afb None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:17.675392 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572ab19-91ed-4cb6-a5cf-ad7ccad08afb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:17.676539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572ab19-91ed-4cb6-a5cf-ad7ccad08afb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:17.678046 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572ab19-91ed-4cb6-a5cf-ad7ccad08afb None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:17.679626 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 30/60] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:17.685722 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ea3f1-ef0c-426b-8a63-279620a8b3ed None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:17.791058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ea3f1-ef0c-426b-8a63-279620a8b3ed None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:17.822560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26306b-c629-40bf-9bc9-5007b5b74996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:17.823219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26306b-c629-40bf-9bc9-5007b5b74996 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:17.823508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26306b-c629-40bf-9bc9-5007b5b74996 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:17.823788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26306b-c629-40bf-9bc9-5007b5b74996 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:17.824504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26306b-c629-40bf-9bc9-5007b5b74996 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:17.826002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26306b-c629-40bf-9bc9-5007b5b74996 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:17.851650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 31/61] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:13:17 2022] POST /identity/v3/users => generated 275 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:13:21.245787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda286a-79fc-4b62-82b3-9a6d8956a66a None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:21.246772 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda286a-79fc-4b62-82b3-9a6d8956a66a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:21.247333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda286a-79fc-4b62-82b3-9a6d8956a66a None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:21.248892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 31/62] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:21.254311 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80656ae0-4bb8-48c7-bd0b-032e4effe84c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:21.255149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80656ae0-4bb8-48c7-bd0b-032e4effe84c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:21.255636 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80656ae0-4bb8-48c7-bd0b-032e4effe84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:21.279136 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-80656ae0-4bb8-48c7-bd0b-032e4effe84c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:21.280600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-80656ae0-4bb8-48c7-bd0b-032e4effe84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:21.364095 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 32/63] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:21.407615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda286a-79fc-4b62-82b3-9a6d8956a66a None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:21.414773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabddbbe-d219-4b78-8277-7cb057227033 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:21.415095 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabddbbe-d219-4b78-8277-7cb057227033 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:21.415321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabddbbe-d219-4b78-8277-7cb057227033 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:21.417182 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 33/64] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:13:21.422581 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c278a73-8d83-47e0-a0aa-a3dc9a5cda53 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:21.423667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c278a73-8d83-47e0-a0aa-a3dc9a5cda53 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:21.424146 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c278a73-8d83-47e0-a0aa-a3dc9a5cda53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:21.462515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9c278a73-8d83-47e0-a0aa-a3dc9a5cda53 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:21.465263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9c278a73-8d83-47e0-a0aa-a3dc9a5cda53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:21.597070 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 34/65] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:21.598709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f633d2-9e74-4c45-96f5-dbddf8602ac0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:21.599193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f633d2-9e74-4c45-96f5-dbddf8602ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:21.599715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f633d2-9e74-4c45-96f5-dbddf8602ac0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:21.601480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 35/66] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:21.607202 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5d32d-5145-4765-9fbd-cf26380935ab None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:21.607715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5d32d-5145-4765-9fbd-cf26380935ab None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:21.608187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5d32d-5145-4765-9fbd-cf26380935ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:21.617537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda286a-79fc-4b62-82b3-9a6d8956a66a None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:21.625438 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8ad5d32d-5145-4765-9fbd-cf26380935ab None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:21.626892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8ad5d32d-5145-4765-9fbd-cf26380935ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:21.653970 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4b4f1-74e3-414a-93e9-e858856c892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:21.654778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4b4f1-74e3-414a-93e9-e858856c892b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:21.655064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4b4f1-74e3-414a-93e9-e858856c892b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:21.655336 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4b4f1-74e3-414a-93e9-e858856c892b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:21.667576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4b4f1-74e3-414a-93e9-e858856c892b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-eff4b4f1-74e3-414a-93e9-e858856c892b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:21.677108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:21.678027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:21.678787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:21.678787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:21.678787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:21.678787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:21.678787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:21.678787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:21.678787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:21.678787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:21.678787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:21.678787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:21.678787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:21.678787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:21.678787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 32/67] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:21.681799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05291acb-2102-485f-bd56-1fc06d33bc37 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:21.682098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05291acb-2102-485f-bd56-1fc06d33bc37 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:21.682386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05291acb-2102-485f-bd56-1fc06d33bc37 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:21.684207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 33/68] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:21.685914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05291acb-2102-485f-bd56-1fc06d33bc37 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:21.697219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 36/69] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:21.698284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5d32d-5145-4765-9fbd-cf26380935ab None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:21.788749 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05291acb-2102-485f-bd56-1fc06d33bc37 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:21.791616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5d32d-5145-4765-9fbd-cf26380935ab None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:21.820117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f82a773-9544-4fe0-8b3d-993792ce8339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:21.820902 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82a773-9544-4fe0-8b3d-993792ce8339 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:21.821211 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82a773-9544-4fe0-8b3d-993792ce8339 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:21.821489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f82a773-9544-4fe0-8b3d-993792ce8339 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:21.823057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4bf229-745b-4acc-9ad7-0a699603fa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:21.823727 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bf229-745b-4acc-9ad7-0a699603fa6e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:21.824018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bf229-745b-4acc-9ad7-0a699603fa6e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:21.824299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4bf229-745b-4acc-9ad7-0a699603fa6e None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:21.825610 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bf229-745b-4acc-9ad7-0a699603fa6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:21.825921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bf229-745b-4acc-9ad7-0a699603fa6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:21.827325 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4bf229-745b-4acc-9ad7-0a699603fa6e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:21.831952 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f82a773-9544-4fe0-8b3d-993792ce8339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:21.835647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 37/70] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:21.836594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d373a-f72d-4a75-b4d3-76a27b10a4e7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:21.836886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d373a-f72d-4a75-b4d3-76a27b10a4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:21.837201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d373a-f72d-4a75-b4d3-76a27b10a4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-2f82a773-9544-4fe0-8b3d-993792ce8339 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:21.839474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:21.840433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:21.842035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:21.842035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:21.842035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:21.842035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:21.842035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:21.842035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:21.842035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:21.842035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:21.842035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:21.842035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:21.842035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:21.842035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:21.842035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 34/71] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:13:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:21.843007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811641e8-7968-49d6-b410-c53e200faa56 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:21.843007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811641e8-7968-49d6-b410-c53e200faa56 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:21.843007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811641e8-7968-49d6-b410-c53e200faa56 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:21.844223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 35/72] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:21.845726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811641e8-7968-49d6-b410-c53e200faa56 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:21.855961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ad8d373a-f72d-4a75-b4d3-76a27b10a4e7 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:21.857131 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ad8d373a-f72d-4a75-b4d3-76a27b10a4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:21.919894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 38/73] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:21.920730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d373a-f72d-4a75-b4d3-76a27b10a4e7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:21.956175 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811641e8-7968-49d6-b410-c53e200faa56 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:22.002431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17b4bb-7834-449f-8185-66c4c6fa662b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:22.003694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17b4bb-7834-449f-8185-66c4c6fa662b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:22.004155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17b4bb-7834-449f-8185-66c4c6fa662b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:22.004603 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17b4bb-7834-449f-8185-66c4c6fa662b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:22.006352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17b4bb-7834-449f-8185-66c4c6fa662b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:22.008885 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17b4bb-7834-449f-8185-66c4c6fa662b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:22.011527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 36/74] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:22.013393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17b4bb-7834-449f-8185-66c4c6fa662b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:22.020418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d373a-f72d-4a75-b4d3-76a27b10a4e7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:22.052533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d044017-b4cc-4e3c-95da-db060fb8d1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:22.053475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d044017-b4cc-4e3c-95da-db060fb8d1cc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:22.053756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d044017-b4cc-4e3c-95da-db060fb8d1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:22.054028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d044017-b4cc-4e3c-95da-db060fb8d1cc None admin] PATH_INFO: `/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:22.066404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d044017-b4cc-4e3c-95da-db060fb8d1cc None admin] RBAC: Authorizing `identity:get_user(user_id=ffeaef636d2b4715ba81d22ce7c0cc52)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:22.067847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d044017-b4cc-4e3c-95da-db060fb8d1cc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:22.069660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 39/75] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:21 2022] GET /identity/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:22.070792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865cdd4-b3ba-4f53-ab1b-adf36fc2df16 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:22.071085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865cdd4-b3ba-4f53-ab1b-adf36fc2df16 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:22.071363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865cdd4-b3ba-4f53-ab1b-adf36fc2df16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:22.087633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1865cdd4-b3ba-4f53-ab1b-adf36fc2df16 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:22.088794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1865cdd4-b3ba-4f53-ab1b-adf36fc2df16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:22.108216 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17b4bb-7834-449f-8185-66c4c6fa662b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:22.139444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab39c0e-fa87-4b30-a6ae-920629bab1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:22.140103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab39c0e-fa87-4b30-a6ae-920629bab1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:22.140384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab39c0e-fa87-4b30-a6ae-920629bab1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:22.140664 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab39c0e-fa87-4b30-a6ae-920629bab1f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:22.141430 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab39c0e-fa87-4b30-a6ae-920629bab1f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:22.141740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab39c0e-fa87-4b30-a6ae-920629bab1f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:22.143099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab39c0e-fa87-4b30-a6ae-920629bab1f4 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:22.150852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 40/76] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:22.151185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 37/77] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:22.151507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865cdd4-b3ba-4f53-ab1b-adf36fc2df16 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:22.151949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab39c0e-fa87-4b30-a6ae-920629bab1f4 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:22.245018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab39c0e-fa87-4b30-a6ae-920629bab1f4 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:22.245894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865cdd4-b3ba-4f53-ab1b-adf36fc2df16 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:22.276934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df220b-9e13-40e3-bd50-f24321b23ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:22.277640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df220b-9e13-40e3-bd50-f24321b23ebb None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:22.277930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df220b-9e13-40e3-bd50-f24321b23ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:22.278238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df220b-9e13-40e3-bd50-f24321b23ebb None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:22.278339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf877-e031-4cec-be1a-4ec7c8ed9132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:22.278955 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df220b-9e13-40e3-bd50-f24321b23ebb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:22.279084 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf877-e031-4cec-be1a-4ec7c8ed9132 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:22.279368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf877-e031-4cec-be1a-4ec7c8ed9132 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:22.279645 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cf877-e031-4cec-be1a-4ec7c8ed9132 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:22.280406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df220b-9e13-40e3-bd50-f24321b23ebb None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:22.289303 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cf877-e031-4cec-be1a-4ec7c8ed9132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-dc5cf877-e031-4cec-be1a-4ec7c8ed9132 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:22.296912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:22.297863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:22.298827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:22.298827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:22.298827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:22.298827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:22.298827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:22.298827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:22.298827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:22.298827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:22.298827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:22.298827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:22.298827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:22.298827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:22.298827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 41/78] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:22.299657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf877-e031-4cec-be1a-4ec7c8ed9132 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:22.306945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 38/79] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:13:22 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:13:22.307754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df220b-9e13-40e3-bd50-f24321b23ebb None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:22.404371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cf877-e031-4cec-be1a-4ec7c8ed9132 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:22.417869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df220b-9e13-40e3-bd50-f24321b23ebb None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:22.440034 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d313d9-345d-4a8a-9d8c-79aa28e93393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:22.440705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d313d9-345d-4a8a-9d8c-79aa28e93393 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:22.441010 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d313d9-345d-4a8a-9d8c-79aa28e93393 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:22.441297 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d313d9-345d-4a8a-9d8c-79aa28e93393 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:22.455949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009b4cf-c589-4f9c-9c37-b271c8d28280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:22.457301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009b4cf-c589-4f9c-9c37-b271c8d28280 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:22.457896 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009b4cf-c589-4f9c-9c37-b271c8d28280 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:22.458266 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009b4cf-c589-4f9c-9c37-b271c8d28280 None admin] PATH_INFO: `/v3/users/caf7948704bc4cd8813f309af89db439` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:22.459550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009b4cf-c589-4f9c-9c37-b271c8d28280 None admin] RBAC: Authorizing `identity:get_user(user_id=caf7948704bc4cd8813f309af89db439)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:22.461035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009b4cf-c589-4f9c-9c37-b271c8d28280 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:22.462715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 39/80] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:22 2022] GET /identity/v3/users/caf7948704bc4cd8813f309af89db439 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:22.463508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009b4cf-c589-4f9c-9c37-b271c8d28280 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:22.512016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d313d9-345d-4a8a-9d8c-79aa28e93393 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:22.514111 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d313d9-345d-4a8a-9d8c-79aa28e93393 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:22.578023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009b4cf-c589-4f9c-9c37-b271c8d28280 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:22.615481 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 42/81] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:22.616197 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d313d9-345d-4a8a-9d8c-79aa28e93393 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:22.619715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab4117-167b-4f86-ae2f-0d28d3e4ee2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:22.620770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab4117-167b-4f86-ae2f-0d28d3e4ee2c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:22.621286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab4117-167b-4f86-ae2f-0d28d3e4ee2c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:22.621742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab4117-167b-4f86-ae2f-0d28d3e4ee2c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:22.634625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab4117-167b-4f86-ae2f-0d28d3e4ee2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-baab4117-167b-4f86-ae2f-0d28d3e4ee2c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:22.642985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:22.643855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:22.644609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:22.644609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:22.644609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:22.644609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:22.644609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:22.644609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:22.644609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:22.644609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:22.644609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:22.644609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:22.644609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:22.644609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:22.645688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 40/82] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:13:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:22.646461 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab4117-167b-4f86-ae2f-0d28d3e4ee2c None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:22.723786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d313d9-345d-4a8a-9d8c-79aa28e93393 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:22.754284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab4117-167b-4f86-ae2f-0d28d3e4ee2c None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:22.763987 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8eed18-a351-4162-9d13-919bfa1ad661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:22.765017 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8eed18-a351-4162-9d13-919bfa1ad661 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:22.765017 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8eed18-a351-4162-9d13-919bfa1ad661 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:22.765214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8eed18-a351-4162-9d13-919bfa1ad661 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:22.765967 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8eed18-a351-4162-9d13-919bfa1ad661 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:22.766280 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8eed18-a351-4162-9d13-919bfa1ad661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:22.767678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8eed18-a351-4162-9d13-919bfa1ad661 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:22.776720 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 43/83] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:22.777576 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8eed18-a351-4162-9d13-919bfa1ad661 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:22.796163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850de22-6adb-49d2-ae27-01c33c3a202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:22.796836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850de22-6adb-49d2-ae27-01c33c3a202a None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:22.797151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850de22-6adb-49d2-ae27-01c33c3a202a None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:22.797432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850de22-6adb-49d2-ae27-01c33c3a202a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:22.864498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850de22-6adb-49d2-ae27-01c33c3a202a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:22.866011 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850de22-6adb-49d2-ae27-01c33c3a202a None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:22.882824 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8eed18-a351-4162-9d13-919bfa1ad661 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:22.917290 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c5248-ae53-45c9-bdb1-37911d946ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:22.918202 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c5248-ae53-45c9-bdb1-37911d946ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:22.919300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c5248-ae53-45c9-bdb1-37911d946ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:22.919583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c5248-ae53-45c9-bdb1-37911d946ae3 None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:22.920776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c5248-ae53-45c9-bdb1-37911d946ae3 None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:22.922281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c5248-ae53-45c9-bdb1-37911d946ae3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:22.923966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 44/84] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:22 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:22.924719 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c5248-ae53-45c9-bdb1-37911d946ae3 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:22.972669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 41/85] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:22.978126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850de22-6adb-49d2-ae27-01c33c3a202a None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:23.051575 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c5248-ae53-45c9-bdb1-37911d946ae3 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:23.086429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850de22-6adb-49d2-ae27-01c33c3a202a None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:23.092721 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4debccc-f262-4b8f-8f0f-dd7b85c4e771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:23.093443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4debccc-f262-4b8f-8f0f-dd7b85c4e771 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:23.093730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4debccc-f262-4b8f-8f0f-dd7b85c4e771 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:23.094011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4debccc-f262-4b8f-8f0f-dd7b85c4e771 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:23.094764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4debccc-f262-4b8f-8f0f-dd7b85c4e771 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:23.095101 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4debccc-f262-4b8f-8f0f-dd7b85c4e771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:23.096878 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4debccc-f262-4b8f-8f0f-dd7b85c4e771 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:23.107611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 45/86] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:13:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:23.113275 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4debccc-f262-4b8f-8f0f-dd7b85c4e771 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:23.127038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab40e6-76ca-4520-9666-a8f6d51fd737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:23.128239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab40e6-76ca-4520-9666-a8f6d51fd737 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:23.128745 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab40e6-76ca-4520-9666-a8f6d51fd737 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:23.129226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab40e6-76ca-4520-9666-a8f6d51fd737 None admin] PATH_INFO: `/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:23.130653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab40e6-76ca-4520-9666-a8f6d51fd737 None admin] RBAC: Authorizing `identity:get_user(user_id=ffeaef636d2b4715ba81d22ce7c0cc52)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:23.132373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab40e6-76ca-4520-9666-a8f6d51fd737 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:23.134414 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 42/87] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:22 2022] GET /identity/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:23.135416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab40e6-76ca-4520-9666-a8f6d51fd737 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:23.221732 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4debccc-f262-4b8f-8f0f-dd7b85c4e771 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:23.239245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab40e6-76ca-4520-9666-a8f6d51fd737 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:23.260446 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b33c7-1cf1-485f-ae5f-b821d1ff3873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:23.261747 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b33c7-1cf1-485f-ae5f-b821d1ff3873 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:23.262206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b33c7-1cf1-485f-ae5f-b821d1ff3873 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:23.262718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b33c7-1cf1-485f-ae5f-b821d1ff3873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:23.263836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b33c7-1cf1-485f-ae5f-b821d1ff3873 None admin] RBAC: Adding query filter params (role.id=dc43ddd6d3b649a187dbfe63b0e20247, scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3, user.id=ffeaef636d2b4715ba81d22ce7c0cc52) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:23.264322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b33c7-1cf1-485f-ae5f-b821d1ff3873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:23.266028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b33c7-1cf1-485f-ae5f-b821d1ff3873 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:23.273980 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18f099-0b87-45a8-8cc4-3c5ff7a09e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:23.274548 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 46/88] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:23 2022] GET /identity/v3/role_assignments?user.id=ffeaef636d2b4715ba81d22ce7c0cc52&scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3&role.id=dc43ddd6d3b649a187dbfe63b0e20247 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:23.274808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18f099-0b87-45a8-8cc4-3c5ff7a09e4c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:23.275097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18f099-0b87-45a8-8cc4-3c5ff7a09e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:23.275375 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18f099-0b87-45a8-8cc4-3c5ff7a09e4c None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:23.276274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b33c7-1cf1-485f-ae5f-b821d1ff3873 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:23.276614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18f099-0b87-45a8-8cc4-3c5ff7a09e4c None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:23.278689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18f099-0b87-45a8-8cc4-3c5ff7a09e4c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:23.280486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 43/89] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:23 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:23.281521 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18f099-0b87-45a8-8cc4-3c5ff7a09e4c None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:23.386158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b33c7-1cf1-485f-ae5f-b821d1ff3873 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:23.389477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18f099-0b87-45a8-8cc4-3c5ff7a09e4c None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:23.425819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d212eb-f024-4da7-ab53-fdae53e2f4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:23.426315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afe5a8-2175-4c1e-a915-24b5d6143507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:23.426505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d212eb-f024-4da7-ab53-fdae53e2f4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:23.426760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d212eb-f024-4da7-ab53-fdae53e2f4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:23.427040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d212eb-f024-4da7-ab53-fdae53e2f4a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:23.427974 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afe5a8-2175-4c1e-a915-24b5d6143507 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:23.428445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afe5a8-2175-4c1e-a915-24b5d6143507 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:23.429018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afe5a8-2175-4c1e-a915-24b5d6143507 None admin] PATH_INFO: `/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:23.430488 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afe5a8-2175-4c1e-a915-24b5d6143507 None admin] RBAC: Authorizing `identity:get_user(user_id=ffeaef636d2b4715ba81d22ce7c0cc52)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:23.432129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afe5a8-2175-4c1e-a915-24b5d6143507 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:23.434350 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 47/90] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:23 2022] GET /identity/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:23.435358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afe5a8-2175-4c1e-a915-24b5d6143507 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:23.501268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d212eb-f024-4da7-ab53-fdae53e2f4a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:23.502677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d212eb-f024-4da7-ab53-fdae53e2f4a6 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:23.571157 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afe5a8-2175-4c1e-a915-24b5d6143507 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:23.606472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 44/91] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:23.607337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d212eb-f024-4da7-ab53-fdae53e2f4a6 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:23.619055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6caaa0-490b-47bb-a30e-9cc731f5eb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:23.620162 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6caaa0-490b-47bb-a30e-9cc731f5eb74 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:23.620455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6caaa0-490b-47bb-a30e-9cc731f5eb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:23.620738 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6caaa0-490b-47bb-a30e-9cc731f5eb74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:23.622801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6caaa0-490b-47bb-a30e-9cc731f5eb74 None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3, user.id=caf7948704bc4cd8813f309af89db439) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:23.623124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6caaa0-490b-47bb-a30e-9cc731f5eb74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:23.625244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6caaa0-490b-47bb-a30e-9cc731f5eb74 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:23.632863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 48/92] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:23 2022] GET /identity/v3/role_assignments?user.id=caf7948704bc4cd8813f309af89db439&scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:23.634134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6caaa0-490b-47bb-a30e-9cc731f5eb74 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:23.786173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d212eb-f024-4da7-ab53-fdae53e2f4a6 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:23.825925 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefb3a1-f5a6-46e7-88cf-2eb5e9d17556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:23.826758 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefb3a1-f5a6-46e7-88cf-2eb5e9d17556 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:23.827049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefb3a1-f5a6-46e7-88cf-2eb5e9d17556 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:23.827328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefb3a1-f5a6-46e7-88cf-2eb5e9d17556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:23.838338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6caaa0-490b-47bb-a30e-9cc731f5eb74 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:23.914940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0f898-3eea-4b85-a437-3000021c68e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:23.915827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0f898-3eea-4b85-a437-3000021c68e6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:23.916111 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0f898-3eea-4b85-a437-3000021c68e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:23.916391 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0f898-3eea-4b85-a437-3000021c68e6 None admin] PATH_INFO: `/v3/projects/a7a6f8abe15047978850e4c7ac1efd72` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:23.917757 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefb3a1-f5a6-46e7-88cf-2eb5e9d17556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:23.919301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefb3a1-f5a6-46e7-88cf-2eb5e9d17556 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:23.921905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0f898-3eea-4b85-a437-3000021c68e6 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a6f8abe15047978850e4c7ac1efd72)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:23.923386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0f898-3eea-4b85-a437-3000021c68e6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:23.925186 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 49/93] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:23 2022] GET /identity/v3/projects/a7a6f8abe15047978850e4c7ac1efd72 => generated 312 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:23.931915 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0f898-3eea-4b85-a437-3000021c68e6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:24.085464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 45/94] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:24.092111 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefb3a1-f5a6-46e7-88cf-2eb5e9d17556 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:24.147071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0f898-3eea-4b85-a437-3000021c68e6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:24.199931 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefb3a1-f5a6-46e7-88cf-2eb5e9d17556 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:24.223315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23bd79-8858-4063-af29-62e5d46eb76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:24.224331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23bd79-8858-4063-af29-62e5d46eb76d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:24.224827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23bd79-8858-4063-af29-62e5d46eb76d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:24.225330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23bd79-8858-4063-af29-62e5d46eb76d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:24.226353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23bd79-8858-4063-af29-62e5d46eb76d None admin] RBAC: Adding query filter params (role.id=dc43ddd6d3b649a187dbfe63b0e20247, scope.project.id=a7a6f8abe15047978850e4c7ac1efd72, user.id=ffeaef636d2b4715ba81d22ce7c0cc52) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:24.226859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23bd79-8858-4063-af29-62e5d46eb76d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:24.228505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23bd79-8858-4063-af29-62e5d46eb76d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:24.238426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 50/95] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:23 2022] GET /identity/v3/role_assignments?user.id=ffeaef636d2b4715ba81d22ce7c0cc52&scope.project.id=a7a6f8abe15047978850e4c7ac1efd72&role.id=dc43ddd6d3b649a187dbfe63b0e20247 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:24.245877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53596b-0bc0-4ddf-8d2f-1f61099c2b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:24.247422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53596b-0bc0-4ddf-8d2f-1f61099c2b9e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:24.247720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53596b-0bc0-4ddf-8d2f-1f61099c2b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:24.247999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53596b-0bc0-4ddf-8d2f-1f61099c2b9e None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:24.249465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53596b-0bc0-4ddf-8d2f-1f61099c2b9e None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:24.250959 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53596b-0bc0-4ddf-8d2f-1f61099c2b9e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:24.252804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 46/96] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:24 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:24.258901 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23bd79-8858-4063-af29-62e5d46eb76d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:24.362445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23bd79-8858-4063-af29-62e5d46eb76d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:24.401015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689755b-e7cb-40f1-a35c-a89736f07b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:24.401798 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689755b-e7cb-40f1-a35c-a89736f07b21 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:24.402012 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689755b-e7cb-40f1-a35c-a89736f07b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:24.402341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689755b-e7cb-40f1-a35c-a89736f07b21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:24.403826 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689755b-e7cb-40f1-a35c-a89736f07b21 None admin] RBAC: Adding query filter params (role.id=472b056b3a5047109259d7fad9133274, scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3, user.id=ffeaef636d2b4715ba81d22ce7c0cc52) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:24.404151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689755b-e7cb-40f1-a35c-a89736f07b21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:24.405684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689755b-e7cb-40f1-a35c-a89736f07b21 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:24.411881 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 51/97] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:24 2022] GET /identity/v3/role_assignments?user.id=ffeaef636d2b4715ba81d22ce7c0cc52&scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3&role.id=472b056b3a5047109259d7fad9133274 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:25.093331 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea7cb3-660d-448c-8dce-ef1cad0d3ac6 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:25.093832 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea7cb3-660d-448c-8dce-ef1cad0d3ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:25.093903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea7cb3-660d-448c-8dce-ef1cad0d3ac6 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:25.095243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 47/98] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:25.101033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bd5b2-a950-4233-821d-83148d9dd037 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:25.101551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bd5b2-a950-4233-821d-83148d9dd037 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:25.102024 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bd5b2-a950-4233-821d-83148d9dd037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:25.122860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fe1bd5b2-a950-4233-821d-83148d9dd037 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:25.124327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fe1bd5b2-a950-4233-821d-83148d9dd037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:25.139852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4156d9-2896-4da0-912b-ed1d6c3aa687 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:25.140136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4156d9-2896-4da0-912b-ed1d6c3aa687 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:25.140423 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4156d9-2896-4da0-912b-ed1d6c3aa687 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:25.141833 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 48/99] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:13:25.146859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6cb4a-275b-4d5c-90ce-ffd393f2b901 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:25.147402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6cb4a-275b-4d5c-90ce-ffd393f2b901 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:25.147691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6cb4a-275b-4d5c-90ce-ffd393f2b901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:25.164942 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-7cf6cb4a-275b-4d5c-90ce-ffd393f2b901 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:25.166161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7cf6cb4a-275b-4d5c-90ce-ffd393f2b901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:25.232248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 52/100] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:25.233958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 49/101] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:25.256754 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bd5b2-a950-4233-821d-83148d9dd037 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:25.266960 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6cb4a-275b-4d5c-90ce-ffd393f2b901 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:25.455858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bd5b2-a950-4233-821d-83148d9dd037 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:25.503909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6cb4a-275b-4d5c-90ce-ffd393f2b901 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:25.529501 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf3afe-19bd-4a25-8f4e-6c4b12adb995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:25.530669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf3afe-19bd-4a25-8f4e-6c4b12adb995 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:25.531151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf3afe-19bd-4a25-8f4e-6c4b12adb995 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:25.531671 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf3afe-19bd-4a25-8f4e-6c4b12adb995 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:25.534627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf3afe-19bd-4a25-8f4e-6c4b12adb995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:25.537084 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf3afe-19bd-4a25-8f4e-6c4b12adb995 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:25.539703 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 53/102] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:25.547674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf3afe-19bd-4a25-8f4e-6c4b12adb995 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:25.586625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a989d0-5a12-4362-a53c-8f79a3ce478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:25.587786 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a989d0-5a12-4362-a53c-8f79a3ce478e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:25.588269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a989d0-5a12-4362-a53c-8f79a3ce478e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:25.588760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a989d0-5a12-4362-a53c-8f79a3ce478e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:25.616804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a989d0-5a12-4362-a53c-8f79a3ce478e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-d9a989d0-5a12-4362-a53c-8f79a3ce478e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:25.624962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:25.625860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:25.626698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:25.626698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:25.626698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:25.626698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:25.626698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:25.626698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:25.626698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:25.626698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:25.626698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:25.626698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:25.626698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:25.626698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:25.635828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 50/103] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:25.645243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a989d0-5a12-4362-a53c-8f79a3ce478e None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:25.753194 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf3afe-19bd-4a25-8f4e-6c4b12adb995 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:25.829790 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07023c6-d03c-4c7d-9b61-f90d8406785a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:25.830403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07023c6-d03c-4c7d-9b61-f90d8406785a None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:25.830697 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07023c6-d03c-4c7d-9b61-f90d8406785a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:25.830980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07023c6-d03c-4c7d-9b61-f90d8406785a None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:25.831714 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07023c6-d03c-4c7d-9b61-f90d8406785a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:25.833277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07023c6-d03c-4c7d-9b61-f90d8406785a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:25.847948 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a989d0-5a12-4362-a53c-8f79a3ce478e None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:25.912077 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3a255-5d5a-4742-a4af-55ff279783f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:25.912800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 54/104] 10.222.0.61 () {60 vars in 1141 bytes} [Tue May 10 20:13:25 2022] POST /identity/v3/projects => generated 302 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:13:25.913868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3a255-5d5a-4742-a4af-55ff279783f0 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:25.914357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3a255-5d5a-4742-a4af-55ff279783f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:25.914899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3a255-5d5a-4742-a4af-55ff279783f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:25.915877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3a255-5d5a-4742-a4af-55ff279783f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:25.916405 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3a255-5d5a-4742-a4af-55ff279783f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:25.921861 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3a255-5d5a-4742-a4af-55ff279783f0 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:25.943007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 51/105] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:25.958147 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07023c6-d03c-4c7d-9b61-f90d8406785a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:26.143775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07023c6-d03c-4c7d-9b61-f90d8406785a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:26.188486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012fdc4-35ed-4712-9cfa-0e4c2b225b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:26.189389 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012fdc4-35ed-4712-9cfa-0e4c2b225b0a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:26.189674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012fdc4-35ed-4712-9cfa-0e4c2b225b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:26.189952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012fdc4-35ed-4712-9cfa-0e4c2b225b0a None admin] PATH_INFO: `/v3/users/d4bccb5d01074f848e4d3e0f689d4f09` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:26.204807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012fdc4-35ed-4712-9cfa-0e4c2b225b0a None admin] RBAC: Authorizing `identity:get_user(user_id=d4bccb5d01074f848e4d3e0f689d4f09)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:26.206330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012fdc4-35ed-4712-9cfa-0e4c2b225b0a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:26.208284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 55/106] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:25 2022] GET /identity/v3/users/d4bccb5d01074f848e4d3e0f689d4f09 => generated 289 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:26.217928 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3a255-5d5a-4742-a4af-55ff279783f0 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:26.412510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3a255-5d5a-4742-a4af-55ff279783f0 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:26.460057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8f7bc-5976-4550-924f-20aef04cc528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:26.461175 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8f7bc-5976-4550-924f-20aef04cc528 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:26.461671 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8f7bc-5976-4550-924f-20aef04cc528 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:26.462168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8f7bc-5976-4550-924f-20aef04cc528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:26.543144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8f7bc-5976-4550-924f-20aef04cc528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:26.545010 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8f7bc-5976-4550-924f-20aef04cc528 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:26.669616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 52/107] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:26.676739 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012fdc4-35ed-4712-9cfa-0e4c2b225b0a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:26.868113 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012fdc4-35ed-4712-9cfa-0e4c2b225b0a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:26.921194 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eeced5-0161-45dd-ac2d-9936d4e617d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:26.922349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeced5-0161-45dd-ac2d-9936d4e617d4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:26.922750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeced5-0161-45dd-ac2d-9936d4e617d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:26.923135 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eeced5-0161-45dd-ac2d-9936d4e617d4 None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:26.924799 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeced5-0161-45dd-ac2d-9936d4e617d4 None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:26.926962 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eeced5-0161-45dd-ac2d-9936d4e617d4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:26.929654 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 56/108] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:26 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:26.936210 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8f7bc-5976-4550-924f-20aef04cc528 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:27.044142 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35500152-d053-468d-ae3a-4177708cc315 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:27.044452 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35500152-d053-468d-ae3a-4177708cc315 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:27.044836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35500152-d053-468d-ae3a-4177708cc315 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:27.047501 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 57/109] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:27.053550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29f8ca-6bc5-4e12-b259-417e8cb4acd1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:27.053845 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29f8ca-6bc5-4e12-b259-417e8cb4acd1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:27.054123 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29f8ca-6bc5-4e12-b259-417e8cb4acd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:27.073001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ad29f8ca-6bc5-4e12-b259-417e8cb4acd1 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:27.077011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ad29f8ca-6bc5-4e12-b259-417e8cb4acd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:27.136882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8f7bc-5976-4550-924f-20aef04cc528 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:27.199377 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f3e2f-c85d-425b-85b0-5d391a92b5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:27.200532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f3e2f-c85d-425b-85b0-5d391a92b5ea None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:27.200819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f3e2f-c85d-425b-85b0-5d391a92b5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:27.201148 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f3e2f-c85d-425b-85b0-5d391a92b5ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:27.201986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f3e2f-c85d-425b-85b0-5d391a92b5ea None admin] RBAC: Adding query filter params (role.id=4ec76066e1a543478164db1c9d114ce9, scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3, user.id=d4bccb5d01074f848e4d3e0f689d4f09) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:27.202539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f3e2f-c85d-425b-85b0-5d391a92b5ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:27.202639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 58/110] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:27.203653 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251db79b-8e7b-4c2c-9c73-1af8194f4a77 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:27.203754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f3e2f-c85d-425b-85b0-5d391a92b5ea None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:27.203944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251db79b-8e7b-4c2c-9c73-1af8194f4a77 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:27.204221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251db79b-8e7b-4c2c-9c73-1af8194f4a77 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:27.205743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 59/111] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:27.210898 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d3f88-337e-4b06-b040-66100a327360 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:27.211184 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d3f88-337e-4b06-b040-66100a327360 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:27.211465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d3f88-337e-4b06-b040-66100a327360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:27.227320 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 53/112] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:26 2022] GET /identity/v3/role_assignments?user.id=d4bccb5d01074f848e4d3e0f689d4f09&scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3&role.id=4ec76066e1a543478164db1c9d114ce9 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:27.227946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-958d3f88-337e-4b06-b040-66100a327360 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:27.229128 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-958d3f88-337e-4b06-b040-66100a327360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:27.249044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f3e2f-c85d-425b-85b0-5d391a92b5ea None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:27.303818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 60/113] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:27.340272 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d3f88-337e-4b06-b040-66100a327360 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:27.382932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f3e2f-c85d-425b-85b0-5d391a92b5ea None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:27.419869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c37e9-1303-49cf-ab9d-7cf64f739085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:27.420674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c37e9-1303-49cf-ab9d-7cf64f739085 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:27.420958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c37e9-1303-49cf-ab9d-7cf64f739085 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:27.421261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c37e9-1303-49cf-ab9d-7cf64f739085 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:27.431889 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c37e9-1303-49cf-ab9d-7cf64f739085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-a64c37e9-1303-49cf-ab9d-7cf64f739085 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:27.440268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:27.441267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:27.443517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:27.443517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:27.443517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:27.443517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:27.443517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:27.443517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:27.443517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:27.443517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:27.443517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:27.443517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:27.443517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:27.443517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:27.443517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 54/114] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:13:27.447908 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c37e9-1303-49cf-ab9d-7cf64f739085 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:27.551281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d3f88-337e-4b06-b040-66100a327360 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:27.562770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c37e9-1303-49cf-ab9d-7cf64f739085 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:27.600761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb80624-5bfb-4523-92de-3df29b55eb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:27.601475 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb80624-5bfb-4523-92de-3df29b55eb25 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:27.601759 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb80624-5bfb-4523-92de-3df29b55eb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:27.602035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb80624-5bfb-4523-92de-3df29b55eb25 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:27.602798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb80624-5bfb-4523-92de-3df29b55eb25 None admin] RBAC: Adding query filter params (name=member) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:27.603104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb80624-5bfb-4523-92de-3df29b55eb25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:27.604499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb80624-5bfb-4523-92de-3df29b55eb25 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:27.615408 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 55/115] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:27.621465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb80624-5bfb-4523-92de-3df29b55eb25 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:27.653774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97cee2-aaf5-43f0-8deb-9ce6de5231b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:27.654596 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97cee2-aaf5-43f0-8deb-9ce6de5231b9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:27.654886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97cee2-aaf5-43f0-8deb-9ce6de5231b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:27.655163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97cee2-aaf5-43f0-8deb-9ce6de5231b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:27.681942 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97cee2-aaf5-43f0-8deb-9ce6de5231b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-0e97cee2-aaf5-43f0-8deb-9ce6de5231b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:27.690486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:27.692930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:27.694838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:27.694838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:27.694838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:27.694838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:27.694838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:27.694838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:27.694838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:27.694838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:27.694838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:27.694838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:27.694838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:27.694838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:27.694838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 61/116] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:13:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:13:27.701395 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97cee2-aaf5-43f0-8deb-9ce6de5231b9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:27.738334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb80624-5bfb-4523-92de-3df29b55eb25 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:27.781016 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e86cbc-c71b-4987-a8fc-8558902ed5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:27.782241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e86cbc-c71b-4987-a8fc-8558902ed5ad None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:27.782526 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e86cbc-c71b-4987-a8fc-8558902ed5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:27.783085 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e86cbc-c71b-4987-a8fc-8558902ed5ad None admin] PATH_INFO: `/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:27.784492 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e86cbc-c71b-4987-a8fc-8558902ed5ad None admin] RBAC: Authorizing `identity:get_user(user_id=ffeaef636d2b4715ba81d22ce7c0cc52)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:27.786158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e86cbc-c71b-4987-a8fc-8558902ed5ad None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:27.788041 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 56/117] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:27 2022] GET /identity/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:27.794370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e86cbc-c71b-4987-a8fc-8558902ed5ad None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:27.916603 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e86cbc-c71b-4987-a8fc-8558902ed5ad None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:27.953811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036535e-a85b-4872-a311-10f9906e32f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:27.955441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036535e-a85b-4872-a311-10f9906e32f2 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:27.955730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036535e-a85b-4872-a311-10f9906e32f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:27.956010 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036535e-a85b-4872-a311-10f9906e32f2 None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:27.957396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036535e-a85b-4872-a311-10f9906e32f2 None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:27.958878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036535e-a85b-4872-a311-10f9906e32f2 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:27.960908 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 57/118] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:27 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:27.962616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97cee2-aaf5-43f0-8deb-9ce6de5231b9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:27.966440 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036535e-a85b-4872-a311-10f9906e32f2 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:27.998905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfa929-1dbb-4104-be6b-73e88259986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:27.999655 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfa929-1dbb-4104-be6b-73e88259986a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:27.999941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfa929-1dbb-4104-be6b-73e88259986a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:28.000218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfa929-1dbb-4104-be6b-73e88259986a None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:28.001098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfa929-1dbb-4104-be6b-73e88259986a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:28.001413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfa929-1dbb-4104-be6b-73e88259986a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:28.002958 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfa929-1dbb-4104-be6b-73e88259986a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:28.015763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 62/119] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:28.026802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfa929-1dbb-4104-be6b-73e88259986a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:28.091249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036535e-a85b-4872-a311-10f9906e32f2 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:28.125578 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a8f29-94f6-4305-9ffd-89ff3bb94a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:28.126832 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a8f29-94f6-4305-9ffd-89ff3bb94a78 None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:28.127254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a8f29-94f6-4305-9ffd-89ff3bb94a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:28.127719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a8f29-94f6-4305-9ffd-89ff3bb94a78 None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3/users/ffeaef636d2b4715ba81d22ce7c0cc52/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:28.129961 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a8f29-94f6-4305-9ffd-89ff3bb94a78 None admin] RBAC: Authorizing `identity:create_grant(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3, user_id=ffeaef636d2b4715ba81d22ce7c0cc52, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:28.131664 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a8f29-94f6-4305-9ffd-89ff3bb94a78 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:28.135468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfa929-1dbb-4104-be6b-73e88259986a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:28.147617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 58/120] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:13:27 2022] PUT /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3/users/ffeaef636d2b4715ba81d22ce7c0cc52/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:13:28.189946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af350e-0f69-4f41-9666-875ac60eec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:28.190775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af350e-0f69-4f41-9666-875ac60eec6b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:28.191055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af350e-0f69-4f41-9666-875ac60eec6b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:28.191329 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af350e-0f69-4f41-9666-875ac60eec6b None admin] PATH_INFO: `/v3/users/caf7948704bc4cd8813f309af89db439` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:28.192675 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af350e-0f69-4f41-9666-875ac60eec6b None admin] RBAC: Authorizing `identity:get_user(user_id=caf7948704bc4cd8813f309af89db439)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:28.194179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af350e-0f69-4f41-9666-875ac60eec6b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:28.195948 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 63/121] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:28 2022] GET /identity/v3/users/caf7948704bc4cd8813f309af89db439 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:28.197761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0e3fb-89d3-46d3-b2c0-37a93265c3bf None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:28.198240 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0e3fb-89d3-46d3-b2c0-37a93265c3bf None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:28.198743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0e3fb-89d3-46d3-b2c0-37a93265c3bf None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:28.200962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 59/122] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:13:28.204823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af350e-0f69-4f41-9666-875ac60eec6b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:28.208252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3357b-732f-4c69-885d-7bee60783434 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:28.208732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3357b-732f-4c69-885d-7bee60783434 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:28.209261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3357b-732f-4c69-885d-7bee60783434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:28.234072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-d2c3357b-732f-4c69-885d-7bee60783434 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:28.236761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d2c3357b-732f-4c69-885d-7bee60783434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:28.376825 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af350e-0f69-4f41-9666-875ac60eec6b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:28.399932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 60/123] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:28.401146 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d80b7d-5ed8-46ed-9791-5fc14714bbe4 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:28.401438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d80b7d-5ed8-46ed-9791-5fc14714bbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:28.401718 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d80b7d-5ed8-46ed-9791-5fc14714bbe4 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:28.407393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 61/124] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:28.408221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a163c-82f9-4a1b-b13c-b52446c3656a None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:28.408520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a163c-82f9-4a1b-b13c-b52446c3656a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:28.408857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a163c-82f9-4a1b-b13c-b52446c3656a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:28.428545 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c0385-15f3-4edf-a835-b805051ff8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:28.429785 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c0385-15f3-4edf-a835-b805051ff8bb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:28.430332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c0385-15f3-4edf-a835-b805051ff8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:28.430781 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c0385-15f3-4edf-a835-b805051ff8bb None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:28.433444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c0385-15f3-4edf-a835-b805051ff8bb None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:28.435776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c0385-15f3-4edf-a835-b805051ff8bb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:28.437784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 64/125] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:28 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:28.443559 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c0385-15f3-4edf-a835-b805051ff8bb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:28.450081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-074a163c-82f9-4a1b-b13c-b52446c3656a None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:28.451633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-074a163c-82f9-4a1b-b13c-b52446c3656a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:28.530332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 62/126] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:28.531097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a163c-82f9-4a1b-b13c-b52446c3656a None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:28.553620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c0385-15f3-4edf-a835-b805051ff8bb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:28.588314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68742-660b-43ff-98bc-4026e3c273ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:28.589562 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68742-660b-43ff-98bc-4026e3c273ba None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:28.590084 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68742-660b-43ff-98bc-4026e3c273ba None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:28.591068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d68742-660b-43ff-98bc-4026e3c273ba None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3/users/caf7948704bc4cd8813f309af89db439/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:28.593270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d68742-660b-43ff-98bc-4026e3c273ba None admin] RBAC: Authorizing `identity:create_grant(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3, user_id=caf7948704bc4cd8813f309af89db439, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:28.594988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d68742-660b-43ff-98bc-4026e3c273ba None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:28.615322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 65/127] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:13:28 2022] PUT /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3/users/caf7948704bc4cd8813f309af89db439/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:13:28.616619 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68742-660b-43ff-98bc-4026e3c273ba None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:28.658132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a163c-82f9-4a1b-b13c-b52446c3656a None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:28.711534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa191f09-1c5e-4a7c-90ec-522ae329133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:28.713607 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa191f09-1c5e-4a7c-90ec-522ae329133f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:28.714122 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa191f09-1c5e-4a7c-90ec-522ae329133f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:28.714571 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa191f09-1c5e-4a7c-90ec-522ae329133f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:28.727782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa191f09-1c5e-4a7c-90ec-522ae329133f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-fa191f09-1c5e-4a7c-90ec-522ae329133f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:28.738674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:28.739589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:28.740328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:28.740328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:28.740328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:28.740328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:28.740328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:28.740328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:28.740328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:28.740328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:28.740328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:28.740328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:28.740328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:28.740328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:28.742799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 63/128] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:28.748655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa191f09-1c5e-4a7c-90ec-522ae329133f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:28.845437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d68742-660b-43ff-98bc-4026e3c273ba None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:28.884611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa191f09-1c5e-4a7c-90ec-522ae329133f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:28.923230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e16386-3881-4c66-84c1-b1c291a7fe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:28.924494 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e16386-3881-4c66-84c1-b1c291a7fe9f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:28.925440 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e16386-3881-4c66-84c1-b1c291a7fe9f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:28.926190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397d375-0d25-4988-a340-80c188695813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:28.926641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e16386-3881-4c66-84c1-b1c291a7fe9f None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:28.927594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397d375-0d25-4988-a340-80c188695813 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:28.928506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e16386-3881-4c66-84c1-b1c291a7fe9f None admin] RBAC: Adding query filter params (name=member) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:28.928931 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397d375-0d25-4988-a340-80c188695813 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:28.929407 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e16386-3881-4c66-84c1-b1c291a7fe9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:28.929822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397d375-0d25-4988-a340-80c188695813 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:28.931362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e16386-3881-4c66-84c1-b1c291a7fe9f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:28.947424 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 64/129] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:28.957188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397d375-0d25-4988-a340-80c188695813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-f397d375-0d25-4988-a340-80c188695813 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:28.965595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:28.966679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:28.967669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:28.967669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:28.967669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:28.967669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:28.967669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:28.967669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:28.967669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:28.967669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:28.967669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:28.967669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:28.967669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:28.967669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:28.974736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e16386-3881-4c66-84c1-b1c291a7fe9f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:28.983514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 66/130] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:13:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:28.990392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397d375-0d25-4988-a340-80c188695813 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:29.145155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e16386-3881-4c66-84c1-b1c291a7fe9f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:29.185445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397d375-0d25-4988-a340-80c188695813 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:29.203289 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd49a84-5d3a-4311-8b8c-b00bd4e02fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:29.205084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd49a84-5d3a-4311-8b8c-b00bd4e02fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:29.206599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd49a84-5d3a-4311-8b8c-b00bd4e02fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:29.207841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd49a84-5d3a-4311-8b8c-b00bd4e02fe2 None admin] PATH_INFO: `/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:29.210610 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd49a84-5d3a-4311-8b8c-b00bd4e02fe2 None admin] RBAC: Authorizing `identity:get_user(user_id=ffeaef636d2b4715ba81d22ce7c0cc52)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:29.212230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd49a84-5d3a-4311-8b8c-b00bd4e02fe2 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:29.218349 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 65/131] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:28 2022] GET /identity/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:29.235151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd49a84-5d3a-4311-8b8c-b00bd4e02fe2 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:29.258258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5b6d6-3b25-4a81-b599-b7fc48fffa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:29.259201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5b6d6-3b25-4a81-b599-b7fc48fffa0c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:29.259632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5b6d6-3b25-4a81-b599-b7fc48fffa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:29.260094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5b6d6-3b25-4a81-b599-b7fc48fffa0c None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:29.261032 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5b6d6-3b25-4a81-b599-b7fc48fffa0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:29.261523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5b6d6-3b25-4a81-b599-b7fc48fffa0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:29.263597 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5b6d6-3b25-4a81-b599-b7fc48fffa0c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:29.279776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 67/132] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:13:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:29.287979 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5b6d6-3b25-4a81-b599-b7fc48fffa0c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:29.426495 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5b6d6-3b25-4a81-b599-b7fc48fffa0c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:29.432805 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd49a84-5d3a-4311-8b8c-b00bd4e02fe2 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:29.482405 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032b55c-6686-4897-8378-9d564a174af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:29.483223 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032b55c-6686-4897-8378-9d564a174af3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:29.483510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032b55c-6686-4897-8378-9d564a174af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:29.483786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032b55c-6686-4897-8378-9d564a174af3 None admin] PATH_INFO: `/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:29.486131 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032b55c-6686-4897-8378-9d564a174af3 None admin] RBAC: Authorizing `identity:get_user(user_id=ffeaef636d2b4715ba81d22ce7c0cc52)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:29.487605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032b55c-6686-4897-8378-9d564a174af3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:29.491701 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 68/133] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:29 2022] GET /identity/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:29.499410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032b55c-6686-4897-8378-9d564a174af3 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:29.521060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e25e86-b09c-4c87-8e06-11e414e82e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:29.522079 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e25e86-b09c-4c87-8e06-11e414e82e31 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:29.522626 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e25e86-b09c-4c87-8e06-11e414e82e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:29.522907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e25e86-b09c-4c87-8e06-11e414e82e31 None admin] PATH_INFO: `/v3/projects/a7a6f8abe15047978850e4c7ac1efd72` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:29.525645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e25e86-b09c-4c87-8e06-11e414e82e31 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a6f8abe15047978850e4c7ac1efd72)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:29.527110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e25e86-b09c-4c87-8e06-11e414e82e31 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:29.532862 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 66/134] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:29 2022] GET /identity/v3/projects/a7a6f8abe15047978850e4c7ac1efd72 => generated 312 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:29.534859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e25e86-b09c-4c87-8e06-11e414e82e31 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:29.629866 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032b55c-6686-4897-8378-9d564a174af3 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:29.664161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495d9fd-a4ca-42e2-8b8f-8010fa03c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:29.665093 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495d9fd-a4ca-42e2-8b8f-8010fa03c4ce None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:29.665379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495d9fd-a4ca-42e2-8b8f-8010fa03c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:29.665655 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495d9fd-a4ca-42e2-8b8f-8010fa03c4ce None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:29.666893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495d9fd-a4ca-42e2-8b8f-8010fa03c4ce None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:29.668344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495d9fd-a4ca-42e2-8b8f-8010fa03c4ce None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:29.670928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 69/135] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:29 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:29.677002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ddb0-1291-42bc-88ab-d319170c3413 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:29.677002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ddb0-1291-42bc-88ab-d319170c3413 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:29.677002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352ddb0-1291-42bc-88ab-d319170c3413 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:29.677002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 70/136] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:29.678251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352ddb0-1291-42bc-88ab-d319170c3413 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:29.698156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e25e86-b09c-4c87-8e06-11e414e82e31 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:29.780901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b365c-a0c0-4b86-a8a6-f6d5e942b88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:29.781683 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352ddb0-1291-42bc-88ab-d319170c3413 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:29.782398 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b365c-a0c0-4b86-a8a6-f6d5e942b88f None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:29.782885 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b365c-a0c0-4b86-a8a6-f6d5e942b88f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:29.783351 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b365c-a0c0-4b86-a8a6-f6d5e942b88f None admin] PATH_INFO: `/v3/projects/a7a6f8abe15047978850e4c7ac1efd72/users/ffeaef636d2b4715ba81d22ce7c0cc52/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:29.786313 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b365c-a0c0-4b86-a8a6-f6d5e942b88f None admin] RBAC: Authorizing `identity:create_grant(project_id=a7a6f8abe15047978850e4c7ac1efd72, user_id=ffeaef636d2b4715ba81d22ce7c0cc52, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:29.787981 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b365c-a0c0-4b86-a8a6-f6d5e942b88f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:29.815357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 67/137] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:13:29 2022] PUT /identity/v3/projects/a7a6f8abe15047978850e4c7ac1efd72/users/ffeaef636d2b4715ba81d22ce7c0cc52/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:13:29.816620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc223b-379a-4090-8cec-b06286bf28a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:29.817340 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb11124-1b9d-45ef-80d4-81bdd6b4a379 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:29.817605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc223b-379a-4090-8cec-b06286bf28a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:29.817887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc223b-379a-4090-8cec-b06286bf28a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:29.818221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc223b-379a-4090-8cec-b06286bf28a6 None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3/users/ffeaef636d2b4715ba81d22ce7c0cc52/roles/472b056b3a5047109259d7fad9133274` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:29.818473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb11124-1b9d-45ef-80d4-81bdd6b4a379 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:29.818942 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb11124-1b9d-45ef-80d4-81bdd6b4a379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:29.820540 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc223b-379a-4090-8cec-b06286bf28a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3, user_id=ffeaef636d2b4715ba81d22ce7c0cc52, role_id=472b056b3a5047109259d7fad9133274)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:29.822179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc223b-379a-4090-8cec-b06286bf28a6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:29.837623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 71/138] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:13:29 2022] PUT /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3/users/ffeaef636d2b4715ba81d22ce7c0cc52/roles/472b056b3a5047109259d7fad9133274 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:13:29.862261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-9fb11124-1b9d-45ef-80d4-81bdd6b4a379 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:29.863872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9fb11124-1b9d-45ef-80d4-81bdd6b4a379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:29.963834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 68/139] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:30.024383 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc223b-379a-4090-8cec-b06286bf28a6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:30.166830 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc223b-379a-4090-8cec-b06286bf28a6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:30.203459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fb317-6e53-4e23-b1cb-9a74969a4364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:30.204273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fb317-6e53-4e23-b1cb-9a74969a4364 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:30.204555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fb317-6e53-4e23-b1cb-9a74969a4364 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:30.204829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fb317-6e53-4e23-b1cb-9a74969a4364 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:30.206217 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fb317-6e53-4e23-b1cb-9a74969a4364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:30.207686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fb317-6e53-4e23-b1cb-9a74969a4364 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:30.209806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 72/140] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:30.215133 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb11124-1b9d-45ef-80d4-81bdd6b4a379 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:30.366173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb11124-1b9d-45ef-80d4-81bdd6b4a379 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:30.417215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dae80-7946-4ac9-aa08-b0f2766d4957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:30.417825 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dae80-7946-4ac9-aa08-b0f2766d4957 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:30.418108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dae80-7946-4ac9-aa08-b0f2766d4957 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:30.418389 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dae80-7946-4ac9-aa08-b0f2766d4957 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:30.419149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dae80-7946-4ac9-aa08-b0f2766d4957 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:30.420585 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dae80-7946-4ac9-aa08-b0f2766d4957 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:30.450879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 69/141] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:13:30 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:13:30.996382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f7baa-efb7-4317-9d3e-115bb91704c2 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:30.996826 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f7baa-efb7-4317-9d3e-115bb91704c2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:30.997254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f7baa-efb7-4317-9d3e-115bb91704c2 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:30.999328 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 73/142] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:31.004743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28375504-0fce-4754-8712-75a7d8140939 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:31.005074 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28375504-0fce-4754-8712-75a7d8140939 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:31.005365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28375504-0fce-4754-8712-75a7d8140939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:31.029741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-28375504-0fce-4754-8712-75a7d8140939 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:31.030920 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-28375504-0fce-4754-8712-75a7d8140939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:31.106565 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 70/143] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:31.137401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f7baa-efb7-4317-9d3e-115bb91704c2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:31.289555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f7baa-efb7-4317-9d3e-115bb91704c2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:31.337643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9868fa-065c-4bd8-81e0-3d9bb871f935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:31.338455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9868fa-065c-4bd8-81e0-3d9bb871f935 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:31.338743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9868fa-065c-4bd8-81e0-3d9bb871f935 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:31.339023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9868fa-065c-4bd8-81e0-3d9bb871f935 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:31.351453 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9868fa-065c-4bd8-81e0-3d9bb871f935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-8a9868fa-065c-4bd8-81e0-3d9bb871f935 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:31.359418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:31.360270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:31.361052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:31.361052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:31.361052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:31.361052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:31.361052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:31.361052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:31.361052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:31.361052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:31.361052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:31.361052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:31.361052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:31.361052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:31.361643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 74/144] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:31.367657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28375504-0fce-4754-8712-75a7d8140939 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:31.509396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28375504-0fce-4754-8712-75a7d8140939 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:31.544544 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f93b5c-5f9e-4024-9df0-2a9d1d3a67e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:31.545179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f93b5c-5f9e-4024-9df0-2a9d1d3a67e9 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:31.545465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f93b5c-5f9e-4024-9df0-2a9d1d3a67e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:31.545743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f93b5c-5f9e-4024-9df0-2a9d1d3a67e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:31.546501 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f93b5c-5f9e-4024-9df0-2a9d1d3a67e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:31.546810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f93b5c-5f9e-4024-9df0-2a9d1d3a67e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:31.548190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f93b5c-5f9e-4024-9df0-2a9d1d3a67e9 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:31.560351 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 71/145] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:31.568070 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9868fa-065c-4bd8-81e0-3d9bb871f935 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:31.733401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9868fa-065c-4bd8-81e0-3d9bb871f935 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:31.774429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792aee51-be19-4982-af43-c9ef1dee1aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:31.775661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792aee51-be19-4982-af43-c9ef1dee1aef None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:31.775946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792aee51-be19-4982-af43-c9ef1dee1aef None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:31.776227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792aee51-be19-4982-af43-c9ef1dee1aef None admin] PATH_INFO: `/v3/users/d4bccb5d01074f848e4d3e0f689d4f09` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:31.781225 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792aee51-be19-4982-af43-c9ef1dee1aef None admin] RBAC: Authorizing `identity:get_user(user_id=d4bccb5d01074f848e4d3e0f689d4f09)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:31.782780 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792aee51-be19-4982-af43-c9ef1dee1aef None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:31.784552 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 75/146] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:31 2022] GET /identity/v3/users/d4bccb5d01074f848e4d3e0f689d4f09 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:31.789988 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f93b5c-5f9e-4024-9df0-2a9d1d3a67e9 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:31.936262 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f93b5c-5f9e-4024-9df0-2a9d1d3a67e9 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:31.987548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994314fc-665e-4186-9868-3806c5dfc34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:31.988432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994314fc-665e-4186-9868-3806c5dfc34d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:31.988760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994314fc-665e-4186-9868-3806c5dfc34d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:31.989030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994314fc-665e-4186-9868-3806c5dfc34d None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:31.993703 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994314fc-665e-4186-9868-3806c5dfc34d None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:31.995177 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994314fc-665e-4186-9868-3806c5dfc34d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:31.997822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 72/147] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:31 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:32.005007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792aee51-be19-4982-af43-c9ef1dee1aef None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:32.159014 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97dcca-c8ef-4ad6-8bfb-e90d2e5ded76 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:32.159398 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97dcca-c8ef-4ad6-8bfb-e90d2e5ded76 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:32.159598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f97dcca-c8ef-4ad6-8bfb-e90d2e5ded76 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:32.165425 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 73/148] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:32.174364 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abbb13-15e5-4f11-8637-431030555500 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:32.174652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abbb13-15e5-4f11-8637-431030555500 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:32.174941 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abbb13-15e5-4f11-8637-431030555500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:32.191240 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792aee51-be19-4982-af43-c9ef1dee1aef None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:32.205344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e4abbb13-15e5-4f11-8637-431030555500 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:32.206576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e4abbb13-15e5-4f11-8637-431030555500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:32.251947 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577913f-fb4a-4146-8134-67e846a99708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:32.253287 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577913f-fb4a-4146-8134-67e846a99708 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:32.253775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577913f-fb4a-4146-8134-67e846a99708 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:32.254243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577913f-fb4a-4146-8134-67e846a99708 None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3/users/d4bccb5d01074f848e4d3e0f689d4f09/roles/4ec76066e1a543478164db1c9d114ce9` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:32.261194 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577913f-fb4a-4146-8134-67e846a99708 None admin] RBAC: Authorizing `identity:create_grant(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3, user_id=d4bccb5d01074f848e4d3e0f689d4f09, role_id=4ec76066e1a543478164db1c9d114ce9)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:32.263058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577913f-fb4a-4146-8134-67e846a99708 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:32.283958 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 76/149] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:13:32 2022] PUT /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3/users/d4bccb5d01074f848e4d3e0f689d4f09/roles/4ec76066e1a543478164db1c9d114ce9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:13:32.338223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 74/150] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:32.374690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577913f-fb4a-4146-8134-67e846a99708 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:32.502358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577913f-fb4a-4146-8134-67e846a99708 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:32.537021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec1f40-b053-4972-802e-e1715aa40d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:32.537829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec1f40-b053-4972-802e-e1715aa40d56 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:32.538118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec1f40-b053-4972-802e-e1715aa40d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:32.538391 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec1f40-b053-4972-802e-e1715aa40d56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:32.557992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec1f40-b053-4972-802e-e1715aa40d56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-95ec1f40-b053-4972-802e-e1715aa40d56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:32.565897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:32.566885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:32.567649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:32.567649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:32.567649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:32.567649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:32.567649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:32.567649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:32.567649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:32.567649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:32.567649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:32.567649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:32.567649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:32.567649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:32.571630 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 77/151] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:32.573028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abbb13-15e5-4f11-8637-431030555500 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:32.628034 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035650d7-13ce-45cb-b10e-726bbbaf116a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:32.628341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035650d7-13ce-45cb-b10e-726bbbaf116a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:32.628608 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035650d7-13ce-45cb-b10e-726bbbaf116a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:32.633224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 78/152] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:32.648665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f772abd-2f38-44cb-9b73-3c284a854ee0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:32.649035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f772abd-2f38-44cb-9b73-3c284a854ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:32.649253 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f772abd-2f38-44cb-9b73-3c284a854ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:32.675354 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5f772abd-2f38-44cb-9b73-3c284a854ee0 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:32.676779 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5f772abd-2f38-44cb-9b73-3c284a854ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:32.764748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abbb13-15e5-4f11-8637-431030555500 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:32.801103 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 79/153] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:32.830202 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16826308-934c-4b7d-897f-94b6c7740845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:32.830938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16826308-934c-4b7d-897f-94b6c7740845 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:32.831227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16826308-934c-4b7d-897f-94b6c7740845 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:32.831549 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16826308-934c-4b7d-897f-94b6c7740845 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:32.832268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16826308-934c-4b7d-897f-94b6c7740845 None admin] RBAC: Adding query filter params (name=member) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:32.832666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16826308-934c-4b7d-897f-94b6c7740845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:32.833876 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f772abd-2f38-44cb-9b73-3c284a854ee0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:32.834107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16826308-934c-4b7d-897f-94b6c7740845 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:32.851329 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 75/154] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:32.856697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16826308-934c-4b7d-897f-94b6c7740845 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:32.960755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f772abd-2f38-44cb-9b73-3c284a854ee0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:32.997839 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e12e2a-1a81-43ee-8a18-fe8931a04712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:32.998654 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e12e2a-1a81-43ee-8a18-fe8931a04712 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:32.998936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e12e2a-1a81-43ee-8a18-fe8931a04712 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:32.999211 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e12e2a-1a81-43ee-8a18-fe8931a04712 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:33.009758 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e12e2a-1a81-43ee-8a18-fe8931a04712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-a6e12e2a-1a81-43ee-8a18-fe8931a04712 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:33.019254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:33.020138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:33.020914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:33.020914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:33.020914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:33.020914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:33.020914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:33.020914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:33.020914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:33.020914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:33.020914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:33.020914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:33.020914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:33.020914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:33.020914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 80/155] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:13:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:33.028484 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e12e2a-1a81-43ee-8a18-fe8931a04712 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:33.059110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16826308-934c-4b7d-897f-94b6c7740845 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:33.145699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d3890-756e-438c-94a2-a03399bd0338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:33.146958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d3890-756e-438c-94a2-a03399bd0338 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:33.147764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d3890-756e-438c-94a2-a03399bd0338 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:33.148262 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d3890-756e-438c-94a2-a03399bd0338 None admin] PATH_INFO: `/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:33.149801 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d3890-756e-438c-94a2-a03399bd0338 None admin] RBAC: Authorizing `identity:get_user(user_id=ffeaef636d2b4715ba81d22ce7c0cc52)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:33.151494 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d3890-756e-438c-94a2-a03399bd0338 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:33.153477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 76/156] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:32 2022] GET /identity/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:33.158742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d3890-756e-438c-94a2-a03399bd0338 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:33.168116 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e12e2a-1a81-43ee-8a18-fe8931a04712 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:33.216388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb334f7-bbeb-41ec-90c2-3b31986497b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:33.216388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb334f7-bbeb-41ec-90c2-3b31986497b0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:33.216388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb334f7-bbeb-41ec-90c2-3b31986497b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:33.216388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb334f7-bbeb-41ec-90c2-3b31986497b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:33.217224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb334f7-bbeb-41ec-90c2-3b31986497b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:33.217618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb334f7-bbeb-41ec-90c2-3b31986497b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:33.219091 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb334f7-bbeb-41ec-90c2-3b31986497b0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:33.237078 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 81/157] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:33.248815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb334f7-bbeb-41ec-90c2-3b31986497b0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:33.292329 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d3890-756e-438c-94a2-a03399bd0338 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:33.334207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24f7f9-c45f-4505-8862-67da7a233c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:33.335381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24f7f9-c45f-4505-8862-67da7a233c75 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:33.335872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24f7f9-c45f-4505-8862-67da7a233c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:33.336352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24f7f9-c45f-4505-8862-67da7a233c75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:33.373002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb334f7-bbeb-41ec-90c2-3b31986497b0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:33.407401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452801f3-4ed9-4012-b08a-afa9f72f999d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:33.408596 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452801f3-4ed9-4012-b08a-afa9f72f999d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:33.409080 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452801f3-4ed9-4012-b08a-afa9f72f999d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:33.409486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452801f3-4ed9-4012-b08a-afa9f72f999d None admin] PATH_INFO: `/v3/users/caf7948704bc4cd8813f309af89db439` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:33.410956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452801f3-4ed9-4012-b08a-afa9f72f999d None admin] RBAC: Authorizing `identity:get_user(user_id=caf7948704bc4cd8813f309af89db439)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:33.412857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452801f3-4ed9-4012-b08a-afa9f72f999d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:33.416281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 82/158] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:33 2022] GET /identity/v3/users/caf7948704bc4cd8813f309af89db439 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:33.432492 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24f7f9-c45f-4505-8862-67da7a233c75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:33.438557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24f7f9-c45f-4505-8862-67da7a233c75 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:33.451447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452801f3-4ed9-4012-b08a-afa9f72f999d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:33.552358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 77/159] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 20:13:33.562025 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24f7f9-c45f-4505-8862-67da7a233c75 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:33.585508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452801f3-4ed9-4012-b08a-afa9f72f999d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:33.619347 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a4b9a-2c0f-4c4b-bff1-bd2b8d255120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:33.620367 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4b9a-2c0f-4c4b-bff1-bd2b8d255120 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:33.620871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4b9a-2c0f-4c4b-bff1-bd2b8d255120 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:33.621360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4b9a-2c0f-4c4b-bff1-bd2b8d255120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:33.703348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24f7f9-c45f-4505-8862-67da7a233c75 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:33.745455 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747cdb16-f53a-40c6-b35e-bc4fac42a601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:33.746232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a4b9a-2c0f-4c4b-bff1-bd2b8d255120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:33.747348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cdb16-f53a-40c6-b35e-bc4fac42a601 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:33.747781 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cdb16-f53a-40c6-b35e-bc4fac42a601 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:33.748272 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747cdb16-f53a-40c6-b35e-bc4fac42a601 None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:33.748727 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a4b9a-2c0f-4c4b-bff1-bd2b8d255120 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:33.751651 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cdb16-f53a-40c6-b35e-bc4fac42a601 None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:33.755021 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747cdb16-f53a-40c6-b35e-bc4fac42a601 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:33.760857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 78/160] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:33 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:33.762461 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c736a43-1048-44a5-8f03-345a1fb5118b None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:33.763012 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c736a43-1048-44a5-8f03-345a1fb5118b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:33.763544 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c736a43-1048-44a5-8f03-345a1fb5118b None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:33.765469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 79/161] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:33.772550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c736a43-1048-44a5-8f03-345a1fb5118b None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:33.942713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c736a43-1048-44a5-8f03-345a1fb5118b None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:33.970245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 83/162] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:33.971635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a72fe-fb5f-47a6-aee2-c49861342ee5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:33.971920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a72fe-fb5f-47a6-aee2-c49861342ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:33.972196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a72fe-fb5f-47a6-aee2-c49861342ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:33.998644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4491dfa-6971-4e84-b1fe-b7532b86530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:33.999548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4491dfa-6971-4e84-b1fe-b7532b86530e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:33.999997 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4491dfa-6971-4e84-b1fe-b7532b86530e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:34.000417 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4491dfa-6971-4e84-b1fe-b7532b86530e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:34.001474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4491dfa-6971-4e84-b1fe-b7532b86530e None admin] RBAC: Adding query filter params (role.id=dc43ddd6d3b649a187dbfe63b0e20247, scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3, user.id=ffeaef636d2b4715ba81d22ce7c0cc52) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:34.001730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5b9a72fe-fb5f-47a6-aee2-c49861342ee5 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:34.002103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4491dfa-6971-4e84-b1fe-b7532b86530e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:34.002987 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5b9a72fe-fb5f-47a6-aee2-c49861342ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:34.003913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4491dfa-6971-4e84-b1fe-b7532b86530e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:34.011880 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 80/163] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:33 2022] GET /identity/v3/role_assignments?user.id=ffeaef636d2b4715ba81d22ce7c0cc52&scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3&role.id=dc43ddd6d3b649a187dbfe63b0e20247 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:34.013586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916c622-7c1e-4a89-ac31-8af892966459 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:34.014040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916c622-7c1e-4a89-ac31-8af892966459 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:34.014522 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916c622-7c1e-4a89-ac31-8af892966459 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:34.016511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 81/164] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:34.017504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916c622-7c1e-4a89-ac31-8af892966459 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:34.139456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 84/165] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:34.142129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195060-b5d7-44df-bec0-89647cb5ffad None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:34.142292 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916c622-7c1e-4a89-ac31-8af892966459 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:34.142989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195060-b5d7-44df-bec0-89647cb5ffad None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:34.143682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195060-b5d7-44df-bec0-89647cb5ffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:34.178061 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4c195060-b5d7-44df-bec0-89647cb5ffad None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:34.179701 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4c195060-b5d7-44df-bec0-89647cb5ffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:34.181843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b402f-6282-424e-8b8e-bdcb020439fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:34.182951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b402f-6282-424e-8b8e-bdcb020439fe None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:34.183230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b402f-6282-424e-8b8e-bdcb020439fe None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:34.183499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b402f-6282-424e-8b8e-bdcb020439fe None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:34.185875 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b402f-6282-424e-8b8e-bdcb020439fe None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:34.187322 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b402f-6282-424e-8b8e-bdcb020439fe None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:34.189242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 82/166] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:34 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:34.195764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b402f-6282-424e-8b8e-bdcb020439fe None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:34.268356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 85/167] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:34.274356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c195060-b5d7-44df-bec0-89647cb5ffad None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:34.390220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b402f-6282-424e-8b8e-bdcb020439fe None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:34.429066 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c195060-b5d7-44df-bec0-89647cb5ffad None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:34.454763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e19111-9f8e-4e7e-8444-4fda11022a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:34.455758 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e19111-9f8e-4e7e-8444-4fda11022a4c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:34.456238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e19111-9f8e-4e7e-8444-4fda11022a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:34.456707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e19111-9f8e-4e7e-8444-4fda11022a4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:34.457766 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e19111-9f8e-4e7e-8444-4fda11022a4c None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3, user.id=caf7948704bc4cd8813f309af89db439) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:34.458455 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e19111-9f8e-4e7e-8444-4fda11022a4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:34.461368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e19111-9f8e-4e7e-8444-4fda11022a4c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:34.473255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 83/168] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:34 2022] GET /identity/v3/role_assignments?user.id=caf7948704bc4cd8813f309af89db439&scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:34.475090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e19111-9f8e-4e7e-8444-4fda11022a4c None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:34.494670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52fe7d-5676-4c45-954a-2cf34a9cdbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:34.495861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52fe7d-5676-4c45-954a-2cf34a9cdbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:34.496371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52fe7d-5676-4c45-954a-2cf34a9cdbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:34.498551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52fe7d-5676-4c45-954a-2cf34a9cdbb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:34.520857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52fe7d-5676-4c45-954a-2cf34a9cdbb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ca52fe7d-5676-4c45-954a-2cf34a9cdbb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:34.533063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:34.533984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:34.534844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:34.534844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:34.534844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:34.534844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:34.534844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:34.534844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:34.534844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:34.534844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:34.534844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:34.534844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:34.534844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:34.534844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:34.549582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 86/169] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:34.556464 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52fe7d-5676-4c45-954a-2cf34a9cdbb9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:34.698153 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e19111-9f8e-4e7e-8444-4fda11022a4c None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:34.744168 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52fe7d-5676-4c45-954a-2cf34a9cdbb9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:34.768354 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee92e4-e0f7-450d-aad7-f2d3f55e6adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:34.770058 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee92e4-e0f7-450d-aad7-f2d3f55e6adc None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:34.771789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee92e4-e0f7-450d-aad7-f2d3f55e6adc None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:34.772531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee92e4-e0f7-450d-aad7-f2d3f55e6adc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:34.793907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee92e4-e0f7-450d-aad7-f2d3f55e6adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-6bee92e4-e0f7-450d-aad7-f2d3f55e6adc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:34.803642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:34.804569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:34.805355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:34.805355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:34.805355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:34.805355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:34.805355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:34.805355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:34.805355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:34.805355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:34.805355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:34.805355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:34.805355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:34.805355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:34.808942 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 84/170] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:13:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:34.812255 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36d4ec-f1ef-46fe-bc8c-58765abb3118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:34.813257 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d4ec-f1ef-46fe-bc8c-58765abb3118 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:34.813752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d4ec-f1ef-46fe-bc8c-58765abb3118 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:34.815076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee92e4-e0f7-450d-aad7-f2d3f55e6adc None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:34.816300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36d4ec-f1ef-46fe-bc8c-58765abb3118 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:34.819441 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36d4ec-f1ef-46fe-bc8c-58765abb3118 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:34.821755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36d4ec-f1ef-46fe-bc8c-58765abb3118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:34.826950 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36d4ec-f1ef-46fe-bc8c-58765abb3118 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:34.838388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 87/171] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:34.846804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36d4ec-f1ef-46fe-bc8c-58765abb3118 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:34.985723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36d4ec-f1ef-46fe-bc8c-58765abb3118 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:35.024068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445e8d0-d6c9-459b-a645-9dfd2aae3a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:35.025051 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445e8d0-d6c9-459b-a645-9dfd2aae3a5b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:35.025472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445e8d0-d6c9-459b-a645-9dfd2aae3a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:35.025850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445e8d0-d6c9-459b-a645-9dfd2aae3a5b None admin] PATH_INFO: `/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:35.027166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445e8d0-d6c9-459b-a645-9dfd2aae3a5b None admin] RBAC: Authorizing `identity:get_user(user_id=ffeaef636d2b4715ba81d22ce7c0cc52)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:35.029619 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c445e8d0-d6c9-459b-a645-9dfd2aae3a5b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:35.031557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 88/172] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:34 2022] GET /identity/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:35.038558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445e8d0-d6c9-459b-a645-9dfd2aae3a5b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:35.049018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee92e4-e0f7-450d-aad7-f2d3f55e6adc None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:35.129799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b64a5-eaa3-450c-a021-c426f4826cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:35.130788 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b64a5-eaa3-450c-a021-c426f4826cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:35.131069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b64a5-eaa3-450c-a021-c426f4826cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:35.131466 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b64a5-eaa3-450c-a021-c426f4826cd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:35.132239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b64a5-eaa3-450c-a021-c426f4826cd7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:35.132544 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b64a5-eaa3-450c-a021-c426f4826cd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:35.134038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b64a5-eaa3-450c-a021-c426f4826cd7 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:35.148748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 85/173] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:13:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:35.156196 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b64a5-eaa3-450c-a021-c426f4826cd7 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:35.162702 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445e8d0-d6c9-459b-a645-9dfd2aae3a5b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:35.227138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477629af-09f6-46d5-97ba-7e72f2a078d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:35.227804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477629af-09f6-46d5-97ba-7e72f2a078d7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:35.228088 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477629af-09f6-46d5-97ba-7e72f2a078d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:35.228362 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477629af-09f6-46d5-97ba-7e72f2a078d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:35.302768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477629af-09f6-46d5-97ba-7e72f2a078d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:35.304156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477629af-09f6-46d5-97ba-7e72f2a078d7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:35.339055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b64a5-eaa3-450c-a021-c426f4826cd7 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:35.376483 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd35d8-3dc9-4c70-97de-c5e5865d88f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:35.377732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd35d8-3dc9-4c70-97de-c5e5865d88f9 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:35.378218 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd35d8-3dc9-4c70-97de-c5e5865d88f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:35.378727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd35d8-3dc9-4c70-97de-c5e5865d88f9 None admin] PATH_INFO: `/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:35.380197 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd35d8-3dc9-4c70-97de-c5e5865d88f9 None admin] RBAC: Authorizing `identity:get_user(user_id=ffeaef636d2b4715ba81d22ce7c0cc52)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:35.381881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd35d8-3dc9-4c70-97de-c5e5865d88f9 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:35.383972 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 86/174] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:35 2022] GET /identity/v3/users/ffeaef636d2b4715ba81d22ce7c0cc52 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:35.389939 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd35d8-3dc9-4c70-97de-c5e5865d88f9 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:35.440162 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 89/175] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:35.466811 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477629af-09f6-46d5-97ba-7e72f2a078d7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:35.510594 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd35d8-3dc9-4c70-97de-c5e5865d88f9 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:35.548086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164bd66-dbb7-4b43-92de-2c70f82ca4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:35.549152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164bd66-dbb7-4b43-92de-2c70f82ca4dc None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:35.549635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164bd66-dbb7-4b43-92de-2c70f82ca4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:35.550127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164bd66-dbb7-4b43-92de-2c70f82ca4dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:35.625454 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164bd66-dbb7-4b43-92de-2c70f82ca4dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:35.627745 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164bd66-dbb7-4b43-92de-2c70f82ca4dc None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:35.686359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477629af-09f6-46d5-97ba-7e72f2a078d7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:35.723875 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e7e1f-fa35-4f53-8d90-a11aa95109a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:35.724740 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e7e1f-fa35-4f53-8d90-a11aa95109a0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:35.725046 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e7e1f-fa35-4f53-8d90-a11aa95109a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:35.725328 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e7e1f-fa35-4f53-8d90-a11aa95109a0 None admin] PATH_INFO: `/v3/projects/a7a6f8abe15047978850e4c7ac1efd72` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:35.726536 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e7e1f-fa35-4f53-8d90-a11aa95109a0 None admin] RBAC: Authorizing `identity:get_project(project_id=a7a6f8abe15047978850e4c7ac1efd72)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:35.727978 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e7e1f-fa35-4f53-8d90-a11aa95109a0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:35.730134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 90/176] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:35 2022] GET /identity/v3/projects/a7a6f8abe15047978850e4c7ac1efd72 => generated 312 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:35.731820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ed661-7ce1-4ee6-b691-6e48a55dd91c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:35.732049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ed661-7ce1-4ee6-b691-6e48a55dd91c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:35.732325 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ed661-7ce1-4ee6-b691-6e48a55dd91c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:35.738301 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 91/177] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:35.739867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107fe42-a4df-4d9c-99e7-f2a44ce32f13 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:35.740155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107fe42-a4df-4d9c-99e7-f2a44ce32f13 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:35.740436 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107fe42-a4df-4d9c-99e7-f2a44ce32f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:35.753351 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 87/178] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:35.754483 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164bd66-dbb7-4b43-92de-2c70f82ca4dc None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:35.759130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2107fe42-a4df-4d9c-99e7-f2a44ce32f13 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:35.760484 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2107fe42-a4df-4d9c-99e7-f2a44ce32f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:35.829122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 92/179] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:35.830008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107fe42-a4df-4d9c-99e7-f2a44ce32f13 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:35.872293 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164bd66-dbb7-4b43-92de-2c70f82ca4dc None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:35.924423 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce009e3b-3721-4adc-9c92-b7160cf0503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:35.925119 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce009e3b-3721-4adc-9c92-b7160cf0503e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:35.925405 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce009e3b-3721-4adc-9c92-b7160cf0503e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:35.925685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce009e3b-3721-4adc-9c92-b7160cf0503e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:35.926522 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce009e3b-3721-4adc-9c92-b7160cf0503e None admin] RBAC: Adding query filter params (role.id=dc43ddd6d3b649a187dbfe63b0e20247, scope.project.id=a7a6f8abe15047978850e4c7ac1efd72, user.id=ffeaef636d2b4715ba81d22ce7c0cc52) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:35.926838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce009e3b-3721-4adc-9c92-b7160cf0503e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:35.928277 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce009e3b-3721-4adc-9c92-b7160cf0503e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:35.944690 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 88/180] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:35 2022] GET /identity/v3/role_assignments?user.id=ffeaef636d2b4715ba81d22ce7c0cc52&scope.project.id=a7a6f8abe15047978850e4c7ac1efd72&role.id=dc43ddd6d3b649a187dbfe63b0e20247 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:35.945570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce009e3b-3721-4adc-9c92-b7160cf0503e None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:35.993304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107fe42-a4df-4d9c-99e7-f2a44ce32f13 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:36.061053 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0bd4b-4821-44ff-afa0-188f8d397218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:36.061989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0bd4b-4821-44ff-afa0-188f8d397218 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:36.062278 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0bd4b-4821-44ff-afa0-188f8d397218 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:36.062554 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0bd4b-4821-44ff-afa0-188f8d397218 None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:36.063953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0bd4b-4821-44ff-afa0-188f8d397218 None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:36.066354 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0bd4b-4821-44ff-afa0-188f8d397218 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:36.069740 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 93/181] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:35 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:36.078099 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0bd4b-4821-44ff-afa0-188f8d397218 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:36.149977 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce009e3b-3721-4adc-9c92-b7160cf0503e None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:36.214335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee5cc9c-89d8-48d7-b462-5180f7739b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:36.215992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5cc9c-89d8-48d7-b462-5180f7739b41 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:36.216892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5cc9c-89d8-48d7-b462-5180f7739b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:36.217403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5cc9c-89d8-48d7-b462-5180f7739b41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:36.232601 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee5cc9c-89d8-48d7-b462-5180f7739b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-dee5cc9c-89d8-48d7-b462-5180f7739b41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:36.240568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:36.241449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:36.242239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:36.242239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:36.242239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:36.242239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:36.242239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:36.242239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:36.242239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:36.242239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:36.242239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:36.242239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:36.242239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:36.242239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:36.244492 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0bd4b-4821-44ff-afa0-188f8d397218 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:36.246393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 89/182] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:36.247902 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fdd79-7910-4adc-8ec3-9b7a0cbf3bae None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:36.248413 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fdd79-7910-4adc-8ec3-9b7a0cbf3bae None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:36.248885 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fdd79-7910-4adc-8ec3-9b7a0cbf3bae None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:36.250638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 90/183] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:36.252108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fdd79-7910-4adc-8ec3-9b7a0cbf3bae None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:36.284085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c64364-94b7-4293-b144-ef67916902e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:36.284743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c64364-94b7-4293-b144-ef67916902e0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:36.285055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c64364-94b7-4293-b144-ef67916902e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:36.285334 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c64364-94b7-4293-b144-ef67916902e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:36.286169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c64364-94b7-4293-b144-ef67916902e0 None admin] RBAC: Adding query filter params (role.id=472b056b3a5047109259d7fad9133274, scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3, user.id=ffeaef636d2b4715ba81d22ce7c0cc52) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:36.286480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c64364-94b7-4293-b144-ef67916902e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:36.288820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c64364-94b7-4293-b144-ef67916902e0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:36.295840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 94/184] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:36 2022] GET /identity/v3/role_assignments?user.id=ffeaef636d2b4715ba81d22ce7c0cc52&scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3&role.id=472b056b3a5047109259d7fad9133274 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:36.296882 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228b7e-3f93-4cc3-a558-03bf6594806e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:36.305403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228b7e-3f93-4cc3-a558-03bf6594806e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:36.306021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228b7e-3f93-4cc3-a558-03bf6594806e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:36.326461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d8228b7e-3f93-4cc3-a558-03bf6594806e None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:36.327648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d8228b7e-3f93-4cc3-a558-03bf6594806e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:36.378968 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fdd79-7910-4adc-8ec3-9b7a0cbf3bae None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:36.457801 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148adce-ff78-45a7-bfcd-0890f133b7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:36.458817 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148adce-ff78-45a7-bfcd-0890f133b7ee None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:36.459248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148adce-ff78-45a7-bfcd-0890f133b7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:36.459670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148adce-ff78-45a7-bfcd-0890f133b7ee None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:36.460615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148adce-ff78-45a7-bfcd-0890f133b7ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:36.461123 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148adce-ff78-45a7-bfcd-0890f133b7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:36.463134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6148adce-ff78-45a7-bfcd-0890f133b7ee None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:36.488310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 91/185] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:36.490577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148adce-ff78-45a7-bfcd-0890f133b7ee None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:36.496606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 95/186] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:36.530937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8228b7e-3f93-4cc3-a558-03bf6594806e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:36.654474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148adce-ff78-45a7-bfcd-0890f133b7ee None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:36.673987 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8228b7e-3f93-4cc3-a558-03bf6594806e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:36.702726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d404e-d2ac-4cc3-ae77-9d7a9b7bcc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:36.703619 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d404e-d2ac-4cc3-ae77-9d7a9b7bcc34 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:36.703900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d404e-d2ac-4cc3-ae77-9d7a9b7bcc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:36.704171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d404e-d2ac-4cc3-ae77-9d7a9b7bcc34 None admin] PATH_INFO: `/v3/users/8a994fcb2b3945f08f4775525e6c6b97` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:36.714939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b0a2e-2093-4e8c-b2a0-52e1a850ee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:36.715795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b0a2e-2093-4e8c-b2a0-52e1a850ee35 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:36.716073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b0a2e-2093-4e8c-b2a0-52e1a850ee35 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:36.716347 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b0a2e-2093-4e8c-b2a0-52e1a850ee35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:36.719809 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d404e-d2ac-4cc3-ae77-9d7a9b7bcc34 None admin] RBAC: Authorizing `identity:get_user(user_id=8a994fcb2b3945f08f4775525e6c6b97)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:36.721340 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d404e-d2ac-4cc3-ae77-9d7a9b7bcc34 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:36.723216 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 92/187] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:36 2022] GET /identity/v3/users/8a994fcb2b3945f08f4775525e6c6b97 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:36.728086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361d6c7-7413-499f-aa7e-f654533068e9 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:36.728086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361d6c7-7413-499f-aa7e-f654533068e9 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:36.728086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361d6c7-7413-499f-aa7e-f654533068e9 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:36.728086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 93/188] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:36.729785 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361d6c7-7413-499f-aa7e-f654533068e9 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:36.730589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b0a2e-2093-4e8c-b2a0-52e1a850ee35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-691b0a2e-2093-4e8c-b2a0-52e1a850ee35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:36.739388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:36.740246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:36.741065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:36.741065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:36.741065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:36.741065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:36.741065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:36.741065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:36.741065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:36.741065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:36.741065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:36.741065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:36.741065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:36.741065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:36.741065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 96/189] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:13:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:36.743324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d8810-afe4-450a-bb5e-0a4d73371c02 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:36.743324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d8810-afe4-450a-bb5e-0a4d73371c02 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:36.743324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d8810-afe4-450a-bb5e-0a4d73371c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:36.759119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-712d8810-afe4-450a-bb5e-0a4d73371c02 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:36.760333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-712d8810-afe4-450a-bb5e-0a4d73371c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:36.825323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 97/190] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:36.826507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d8810-afe4-450a-bb5e-0a4d73371c02 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:36.847700 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361d6c7-7413-499f-aa7e-f654533068e9 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:36.880679 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb85b1-0bb5-4d15-9b90-1e13bfac3639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:36.881366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb85b1-0bb5-4d15-9b90-1e13bfac3639 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:36.881621 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb85b1-0bb5-4d15-9b90-1e13bfac3639 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:36.881899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb85b1-0bb5-4d15-9b90-1e13bfac3639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:36.923255 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d8810-afe4-450a-bb5e-0a4d73371c02 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:36.944656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb85b1-0bb5-4d15-9b90-1e13bfac3639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:36.946147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb85b1-0bb5-4d15-9b90-1e13bfac3639 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:36.953933 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c6b03-2b32-47b4-937b-d43c0ce1bd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:36.954586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c6b03-2b32-47b4-937b-d43c0ce1bd1d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:36.954865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c6b03-2b32-47b4-937b-d43c0ce1bd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:36.955143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c6b03-2b32-47b4-937b-d43c0ce1bd1d None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:36.955875 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c6b03-2b32-47b4-937b-d43c0ce1bd1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:36.956177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c6b03-2b32-47b4-937b-d43c0ce1bd1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:36.957576 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c6b03-2b32-47b4-937b-d43c0ce1bd1d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:36.965665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 98/191] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:13:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:36.966550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c6b03-2b32-47b4-937b-d43c0ce1bd1d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:37.042719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 94/192] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:37.042719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467357a-5ad8-4d83-bc64-2fec41534aa4 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:37.042719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467357a-5ad8-4d83-bc64-2fec41534aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:37.042719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467357a-5ad8-4d83-bc64-2fec41534aa4 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:37.042719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 95/193] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:37.042719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467357a-5ad8-4d83-bc64-2fec41534aa4 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:37.063619 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c6b03-2b32-47b4-937b-d43c0ce1bd1d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:37.094704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45f213-b4a4-4371-a379-26bf3eb9bb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:37.095486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45f213-b4a4-4371-a379-26bf3eb9bb08 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:37.095769 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45f213-b4a4-4371-a379-26bf3eb9bb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:37.096049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45f213-b4a4-4371-a379-26bf3eb9bb08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:37.097219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45f213-b4a4-4371-a379-26bf3eb9bb08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:37.098650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45f213-b4a4-4371-a379-26bf3eb9bb08 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:37.100231 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 99/194] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:37.100997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45f213-b4a4-4371-a379-26bf3eb9bb08 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:37.140907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467357a-5ad8-4d83-bc64-2fec41534aa4 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:37.173529 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f81dd-76e2-4219-a1cf-3b79c7737399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:37.174393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f81dd-76e2-4219-a1cf-3b79c7737399 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:37.174676 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f81dd-76e2-4219-a1cf-3b79c7737399 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:37.174950 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f81dd-76e2-4219-a1cf-3b79c7737399 None admin] PATH_INFO: `/v3/users/8a994fcb2b3945f08f4775525e6c6b97` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:37.176134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f81dd-76e2-4219-a1cf-3b79c7737399 None admin] RBAC: Authorizing `identity:get_user(user_id=8a994fcb2b3945f08f4775525e6c6b97)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:37.177637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f81dd-76e2-4219-a1cf-3b79c7737399 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:37.179259 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 96/195] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:37 2022] GET /identity/v3/users/8a994fcb2b3945f08f4775525e6c6b97 => generated 283 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:37.180373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883099f6-5ba4-493b-8e07-8f174f0f222c None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:37.180661 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883099f6-5ba4-493b-8e07-8f174f0f222c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:37.180936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883099f6-5ba4-493b-8e07-8f174f0f222c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:37.193427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45f213-b4a4-4371-a379-26bf3eb9bb08 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:37.196142 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-883099f6-5ba4-493b-8e07-8f174f0f222c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:37.197337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-883099f6-5ba4-493b-8e07-8f174f0f222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:37.224704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a74df-329d-4bed-8964-2ed3f48218fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:37.225584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a74df-329d-4bed-8964-2ed3f48218fc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:37.225871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a74df-329d-4bed-8964-2ed3f48218fc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:37.226149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a74df-329d-4bed-8964-2ed3f48218fc None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:37.227300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a74df-329d-4bed-8964-2ed3f48218fc None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:37.228729 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a74df-329d-4bed-8964-2ed3f48218fc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:37.230423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 100/196] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:37 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:37.230423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a74df-329d-4bed-8964-2ed3f48218fc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:37.259183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 97/197] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:37.259942 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883099f6-5ba4-493b-8e07-8f174f0f222c None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:37.323856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a74df-329d-4bed-8964-2ed3f48218fc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:37.352695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883099f6-5ba4-493b-8e07-8f174f0f222c None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:37.355612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13c134-8739-4524-b954-3533606f8ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:37.356302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13c134-8739-4524-b954-3533606f8ac4 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:37.356589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13c134-8739-4524-b954-3533606f8ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:37.356869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13c134-8739-4524-b954-3533606f8ac4 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:37.357603 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13c134-8739-4524-b954-3533606f8ac4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:37.359043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13c134-8739-4524-b954-3533606f8ac4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:37.377991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 101/198] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:13:37 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:13:37.378800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13c134-8739-4524-b954-3533606f8ac4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:37.389412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa2a81-103a-4214-9bfe-90d16aeb433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:37.390090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa2a81-103a-4214-9bfe-90d16aeb433f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:37.390377 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa2a81-103a-4214-9bfe-90d16aeb433f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:37.390655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa2a81-103a-4214-9bfe-90d16aeb433f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:37.466507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa2a81-103a-4214-9bfe-90d16aeb433f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:37.468049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa2a81-103a-4214-9bfe-90d16aeb433f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:37.488010 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13c134-8739-4524-b954-3533606f8ac4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:37.529312 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d619e-6510-436b-b975-ec878adb3e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:37.530807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d619e-6510-436b-b975-ec878adb3e07 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:37.531573 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d619e-6510-436b-b975-ec878adb3e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:37.532044 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d619e-6510-436b-b975-ec878adb3e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:37.533118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d619e-6510-436b-b975-ec878adb3e07 None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=6199907f9ce64320bb281523e68ea62a, user.id=8a994fcb2b3945f08f4775525e6c6b97) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:37.533773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d619e-6510-436b-b975-ec878adb3e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:37.536282 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d619e-6510-436b-b975-ec878adb3e07 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:37.544076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 102/199] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:37 2022] GET /identity/v3/role_assignments?user.id=8a994fcb2b3945f08f4775525e6c6b97&scope.project.id=6199907f9ce64320bb281523e68ea62a&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:37.545235 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d619e-6510-436b-b975-ec878adb3e07 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:37.580095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 98/200] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:37.587311 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa2a81-103a-4214-9bfe-90d16aeb433f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:37.677584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d619e-6510-436b-b975-ec878adb3e07 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:37.698704 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa2a81-103a-4214-9bfe-90d16aeb433f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:37.715897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54122f77-3c6a-4802-9b03-6cb77dcec9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:37.716961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54122f77-3c6a-4802-9b03-6cb77dcec9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:37.717411 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54122f77-3c6a-4802-9b03-6cb77dcec9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:37.717828 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54122f77-3c6a-4802-9b03-6cb77dcec9c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:37.729527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54122f77-3c6a-4802-9b03-6cb77dcec9c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:37.735537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647d0b7-ddf1-4d0b-85f8-fa25d7c14836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:37.736409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647d0b7-ddf1-4d0b-85f8-fa25d7c14836 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:37.736690 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647d0b7-ddf1-4d0b-85f8-fa25d7c14836 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:37.736966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647d0b7-ddf1-4d0b-85f8-fa25d7c14836 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:37.738208 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647d0b7-ddf1-4d0b-85f8-fa25d7c14836 None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-54122f77-3c6a-4802-9b03-6cb77dcec9c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:37.738633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:37.739662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:37.740665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:37.740665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:37.740665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:37.740665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:37.740665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:37.740665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:37.740665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:37.740665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:37.740665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:37.740665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:37.740665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:37.740665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:37.741388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647d0b7-ddf1-4d0b-85f8-fa25d7c14836 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:37.741388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 99/201] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:37 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:37.742834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 103/202] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:37.748044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647d0b7-ddf1-4d0b-85f8-fa25d7c14836 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:37.749132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54122f77-3c6a-4802-9b03-6cb77dcec9c7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:37.854229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647d0b7-ddf1-4d0b-85f8-fa25d7c14836 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:37.856505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54122f77-3c6a-4802-9b03-6cb77dcec9c7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:37.890705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccfbd4-556e-4c30-882d-f0645fef217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:37.891465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccfbd4-556e-4c30-882d-f0645fef217a None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:37.891815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccfbd4-556e-4c30-882d-f0645fef217a None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:37.892160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ccfbd4-556e-4c30-882d-f0645fef217a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:37.893103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccfbd4-556e-4c30-882d-f0645fef217a None admin] RBAC: Adding query filter params (role.id=472b056b3a5047109259d7fad9133274, scope.project.id=6199907f9ce64320bb281523e68ea62a, user.id=8a994fcb2b3945f08f4775525e6c6b97) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:37.893493 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccfbd4-556e-4c30-882d-f0645fef217a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:37.894996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ccfbd4-556e-4c30-882d-f0645fef217a None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:37.900924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 100/203] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:37 2022] GET /identity/v3/role_assignments?user.id=8a994fcb2b3945f08f4775525e6c6b97&scope.project.id=6199907f9ce64320bb281523e68ea62a&role.id=472b056b3a5047109259d7fad9133274 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:37.903351 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851455c-1684-42db-bb78-3e6c5f891223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:37.904032 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851455c-1684-42db-bb78-3e6c5f891223 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:37.904327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851455c-1684-42db-bb78-3e6c5f891223 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:37.904608 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851455c-1684-42db-bb78-3e6c5f891223 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:37.905411 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851455c-1684-42db-bb78-3e6c5f891223 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:37.905726 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851455c-1684-42db-bb78-3e6c5f891223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:37.907179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851455c-1684-42db-bb78-3e6c5f891223 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:37.916866 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 104/204] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:37.922781 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccfbd4-556e-4c30-882d-f0645fef217a None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:38.057516 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ccfbd4-556e-4c30-882d-f0645fef217a None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:38.113879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4df570-a635-4d45-8b9e-d7b647897482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:38.114717 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4df570-a635-4d45-8b9e-d7b647897482 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:38.115002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4df570-a635-4d45-8b9e-d7b647897482 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:38.115277 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4df570-a635-4d45-8b9e-d7b647897482 None admin] PATH_INFO: `/v3/users/d4bccb5d01074f848e4d3e0f689d4f09` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:38.116635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4df570-a635-4d45-8b9e-d7b647897482 None admin] RBAC: Authorizing `identity:get_user(user_id=d4bccb5d01074f848e4d3e0f689d4f09)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:38.118127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4df570-a635-4d45-8b9e-d7b647897482 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:38.119841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 101/205] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:37 2022] GET /identity/v3/users/d4bccb5d01074f848e4d3e0f689d4f09 => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:38.126245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851455c-1684-42db-bb78-3e6c5f891223 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:38.243293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851455c-1684-42db-bb78-3e6c5f891223 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:38.277420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64793258-f0b7-46ec-b190-65a9b4dad6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:38.278160 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64793258-f0b7-46ec-b190-65a9b4dad6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:38.278444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64793258-f0b7-46ec-b190-65a9b4dad6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:38.278735 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64793258-f0b7-46ec-b190-65a9b4dad6f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:38.346915 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64793258-f0b7-46ec-b190-65a9b4dad6f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:38.348458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64793258-f0b7-46ec-b190-65a9b4dad6f0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:38.447073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 105/206] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:38.454372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4df570-a635-4d45-8b9e-d7b647897482 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:38.580648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4df570-a635-4d45-8b9e-d7b647897482 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:38.622803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c338f2-814e-49d7-aad6-09149adfcfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:38.623674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c338f2-814e-49d7-aad6-09149adfcfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:38.623957 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c338f2-814e-49d7-aad6-09149adfcfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:38.624231 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c338f2-814e-49d7-aad6-09149adfcfb2 None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:38.625474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c338f2-814e-49d7-aad6-09149adfcfb2 None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:38.626936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c338f2-814e-49d7-aad6-09149adfcfb2 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:38.629003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 102/207] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:38 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:38.638096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64793258-f0b7-46ec-b190-65a9b4dad6f0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:38.760700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64793258-f0b7-46ec-b190-65a9b4dad6f0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:38.797339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957539e3-e31d-47c1-be2d-a72fdd53dca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:38.798000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957539e3-e31d-47c1-be2d-a72fdd53dca3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:38.798283 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957539e3-e31d-47c1-be2d-a72fdd53dca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:38.798561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957539e3-e31d-47c1-be2d-a72fdd53dca3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:38.799401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957539e3-e31d-47c1-be2d-a72fdd53dca3 None admin] RBAC: Adding query filter params (role.id=4ec76066e1a543478164db1c9d114ce9, scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3, user.id=d4bccb5d01074f848e4d3e0f689d4f09) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:38.799712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957539e3-e31d-47c1-be2d-a72fdd53dca3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:38.801190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957539e3-e31d-47c1-be2d-a72fdd53dca3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:38.807054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 106/208] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:38 2022] GET /identity/v3/role_assignments?user.id=d4bccb5d01074f848e4d3e0f689d4f09&scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3&role.id=4ec76066e1a543478164db1c9d114ce9 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:39.968436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f0135-63ef-4712-bc0e-9ebf7c825046 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:39.970350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f0135-63ef-4712-bc0e-9ebf7c825046 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:39.970872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f0135-63ef-4712-bc0e-9ebf7c825046 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:39.974938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 103/209] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:39.984935 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863d629-a0dc-41e0-b3b5-7456728e8610 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:39.985743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863d629-a0dc-41e0-b3b5-7456728e8610 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:39.986227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863d629-a0dc-41e0-b3b5-7456728e8610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.002883 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c863d629-a0dc-41e0-b3b5-7456728e8610 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:40.004442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c863d629-a0dc-41e0-b3b5-7456728e8610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:40.073886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 107/210] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:40.096304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f0135-63ef-4712-bc0e-9ebf7c825046 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:40.142729 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e27c0b-7ac3-4ac8-9e6a-51f3d0e26c12 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.143062 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e27c0b-7ac3-4ac8-9e6a-51f3d0e26c12 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.143278 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e27c0b-7ac3-4ac8-9e6a-51f3d0e26c12 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.144881 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 108/211] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:13:40.151213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9447f-9e95-401f-bcd8-13f935b6966b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.151732 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9447f-9e95-401f-bcd8-13f935b6966b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.152211 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9447f-9e95-401f-bcd8-13f935b6966b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.169713 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1da9447f-9e95-401f-bcd8-13f935b6966b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:40.171401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1da9447f-9e95-401f-bcd8-13f935b6966b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:40.202467 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f0135-63ef-4712-bc0e-9ebf7c825046 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:40.238051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4a4a6-feaf-4bcb-b7a3-bc68a61c0eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:40.239205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4a4a6-feaf-4bcb-b7a3-bc68a61c0eaf None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.239612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4a4a6-feaf-4bcb-b7a3-bc68a61c0eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.239901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4a4a6-feaf-4bcb-b7a3-bc68a61c0eaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.243939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 109/212] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:40.245502 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0955afd-d9a1-4685-bd82-5d96ef4b2e23 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.245987 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0955afd-d9a1-4685-bd82-5d96ef4b2e23 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.246656 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0955afd-d9a1-4685-bd82-5d96ef4b2e23 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.248098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 110/213] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:40.255198 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4a4a6-feaf-4bcb-b7a3-bc68a61c0eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:40.255361 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef5830-4c2b-4923-927a-729873b9177c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.255361 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef5830-4c2b-4923-927a-729873b9177c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.255361 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef5830-4c2b-4923-927a-729873b9177c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-c3d4a4a6-feaf-4bcb-b7a3-bc68a61c0eaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:40.259249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:40.260333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:40.261353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:40.261353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:40.261353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:40.261353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:40.261353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:40.261353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:40.261353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:40.261353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:40.261353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:40.261353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:40.261353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:40.261353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:40.261353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 104/214] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:13:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:40.268354 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4a4a6-feaf-4bcb-b7a3-bc68a61c0eaf None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:40.275502 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c2ef5830-4c2b-4923-927a-729873b9177c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:40.276864 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c2ef5830-4c2b-4923-927a-729873b9177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:40.344284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 111/215] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:40.345285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef5830-4c2b-4923-927a-729873b9177c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:40.368689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4a4a6-feaf-4bcb-b7a3-bc68a61c0eaf None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:40.406634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eebf5d-536a-4ef5-b7c2-ca8c1eab4c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:40.407498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eebf5d-536a-4ef5-b7c2-ca8c1eab4c79 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.407785 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eebf5d-536a-4ef5-b7c2-ca8c1eab4c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.408586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eebf5d-536a-4ef5-b7c2-ca8c1eab4c79 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.410154 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eebf5d-536a-4ef5-b7c2-ca8c1eab4c79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:40.410330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eebf5d-536a-4ef5-b7c2-ca8c1eab4c79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:40.412156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eebf5d-536a-4ef5-b7c2-ca8c1eab4c79 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:40.426017 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 105/216] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:40.427055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eebf5d-536a-4ef5-b7c2-ca8c1eab4c79 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:40.441444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef5830-4c2b-4923-927a-729873b9177c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:40.473583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10328119-8137-44cf-991e-ad58c4ed23a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:40.474379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10328119-8137-44cf-991e-ad58c4ed23a4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.474665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10328119-8137-44cf-991e-ad58c4ed23a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.474947 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10328119-8137-44cf-991e-ad58c4ed23a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.476127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10328119-8137-44cf-991e-ad58c4ed23a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:40.477620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10328119-8137-44cf-991e-ad58c4ed23a4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:40.479236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 112/217] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:40.484180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10328119-8137-44cf-991e-ad58c4ed23a4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:40.533062 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eebf5d-536a-4ef5-b7c2-ca8c1eab4c79 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:40.566434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db4717-641f-4873-9cf9-ac2117a15fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:40.567236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db4717-641f-4873-9cf9-ac2117a15fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.567523 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db4717-641f-4873-9cf9-ac2117a15fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.567797 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db4717-641f-4873-9cf9-ac2117a15fc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.577896 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5db4717-641f-4873-9cf9-ac2117a15fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:40.584563 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10328119-8137-44cf-991e-ad58c4ed23a4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-b5db4717-641f-4873-9cf9-ac2117a15fc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:40.585597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:40.586436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:40.587213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:40.587213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:40.587213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:40.587213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:40.587213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:40.587213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:40.587213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:40.587213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:40.587213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:40.587213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:40.587213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:40.587213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:40.587213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 106/218] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:40.588367 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db4717-641f-4873-9cf9-ac2117a15fc9 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:40.621667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801ec72-cc47-4ac8-a068-93dc94a29836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:40.622537 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ec72-cc47-4ac8-a068-93dc94a29836 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.622820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ec72-cc47-4ac8-a068-93dc94a29836 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.623096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ec72-cc47-4ac8-a068-93dc94a29836 None admin] PATH_INFO: `/v3/users/8a994fcb2b3945f08f4775525e6c6b97` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.624286 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801ec72-cc47-4ac8-a068-93dc94a29836 None admin] RBAC: Authorizing `identity:get_user(user_id=8a994fcb2b3945f08f4775525e6c6b97)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:40.625754 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801ec72-cc47-4ac8-a068-93dc94a29836 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:40.627667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 113/219] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:40 2022] GET /identity/v3/users/8a994fcb2b3945f08f4775525e6c6b97 => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:40.632599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801ec72-cc47-4ac8-a068-93dc94a29836 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:40.686736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db4717-641f-4873-9cf9-ac2117a15fc9 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:40.717759 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed527be8-1dcd-49ef-b119-5942fa096fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:40.718417 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed527be8-1dcd-49ef-b119-5942fa096fdc None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.718697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed527be8-1dcd-49ef-b119-5942fa096fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.718971 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed527be8-1dcd-49ef-b119-5942fa096fdc None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.719664 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed527be8-1dcd-49ef-b119-5942fa096fdc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:40.721114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed527be8-1dcd-49ef-b119-5942fa096fdc None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:40.725887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801ec72-cc47-4ac8-a068-93dc94a29836 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:40.740200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 107/220] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:13:40 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:13:40.741369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed527be8-1dcd-49ef-b119-5942fa096fdc None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:40.761484 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09746f4-9404-4f83-87f1-d70ae94c9168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:40.762234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09746f4-9404-4f83-87f1-d70ae94c9168 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.762575 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09746f4-9404-4f83-87f1-d70ae94c9168 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.762853 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09746f4-9404-4f83-87f1-d70ae94c9168 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.763624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09746f4-9404-4f83-87f1-d70ae94c9168 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:40.763934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09746f4-9404-4f83-87f1-d70ae94c9168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:40.765383 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09746f4-9404-4f83-87f1-d70ae94c9168 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:40.775915 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 114/221] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:40.777153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31360555-4950-48b8-8cb3-10c4c8198373 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.777442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31360555-4950-48b8-8cb3-10c4c8198373 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.778266 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31360555-4950-48b8-8cb3-10c4c8198373 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.779841 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 115/222] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:40.784789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31360555-4950-48b8-8cb3-10c4c8198373 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:40.857320 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed527be8-1dcd-49ef-b119-5942fa096fdc None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:40.890770 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31360555-4950-48b8-8cb3-10c4c8198373 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:40.891806 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d169d-6ca6-4920-97c8-048072fef9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:40.892692 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d169d-6ca6-4920-97c8-048072fef9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.893003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d169d-6ca6-4920-97c8-048072fef9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.893286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d169d-6ca6-4920-97c8-048072fef9a1 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.894539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d169d-6ca6-4920-97c8-048072fef9a1 None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:40.896029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d169d-6ca6-4920-97c8-048072fef9a1 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:40.898301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 108/223] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:40 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:40.902506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b933f-0bd1-443b-92a3-8bac5b7cb456 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.902506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b933f-0bd1-443b-92a3-8bac5b7cb456 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.903633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b933f-0bd1-443b-92a3-8bac5b7cb456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.920810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-d71b933f-0bd1-443b-92a3-8bac5b7cb456 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:40.922466 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d71b933f-0bd1-443b-92a3-8bac5b7cb456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:40.933057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e96c6e-f4a1-48cf-adae-b85642d544af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:40.934018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e96c6e-f4a1-48cf-adae-b85642d544af None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:40.934308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e96c6e-f4a1-48cf-adae-b85642d544af None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:40.934591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e96c6e-f4a1-48cf-adae-b85642d544af None admin] PATH_INFO: `/v3/users/a25e29702a4d4772b786ccbf752848c5` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:40.950938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e96c6e-f4a1-48cf-adae-b85642d544af None admin] RBAC: Authorizing `identity:get_user(user_id=a25e29702a4d4772b786ccbf752848c5)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:40.953008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e96c6e-f4a1-48cf-adae-b85642d544af None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:40.954894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 116/224] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:40 2022] GET /identity/v3/users/a25e29702a4d4772b786ccbf752848c5 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:40.957774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e96c6e-f4a1-48cf-adae-b85642d544af None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:40.994351 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 109/225] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:40.995714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b933f-0bd1-443b-92a3-8bac5b7cb456 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:41.088515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e96c6e-f4a1-48cf-adae-b85642d544af None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:41.098287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b933f-0bd1-443b-92a3-8bac5b7cb456 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:41.131910 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866424f-18b3-420f-a01d-8bd714e10f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:41.132558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866424f-18b3-420f-a01d-8bd714e10f78 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:41.132842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866424f-18b3-420f-a01d-8bd714e10f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:41.133147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866424f-18b3-420f-a01d-8bd714e10f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:41.133989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63be0b0-6d59-4b78-a066-f1556b24291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:41.134885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be0b0-6d59-4b78-a066-f1556b24291c None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:41.135170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be0b0-6d59-4b78-a066-f1556b24291c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:41.135449 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be0b0-6d59-4b78-a066-f1556b24291c None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a/users/8a994fcb2b3945f08f4775525e6c6b97/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:41.137972 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63be0b0-6d59-4b78-a066-f1556b24291c None admin] RBAC: Authorizing `identity:create_grant(project_id=6199907f9ce64320bb281523e68ea62a, user_id=8a994fcb2b3945f08f4775525e6c6b97, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:41.139434 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63be0b0-6d59-4b78-a066-f1556b24291c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:41.169098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 117/226] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:13:40 2022] PUT /identity/v3/projects/6199907f9ce64320bb281523e68ea62a/users/8a994fcb2b3945f08f4775525e6c6b97/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:13:41.170116 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63be0b0-6d59-4b78-a066-f1556b24291c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:41.238337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866424f-18b3-420f-a01d-8bd714e10f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:41.239826 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7866424f-18b3-420f-a01d-8bd714e10f78 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:41.285346 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63be0b0-6d59-4b78-a066-f1556b24291c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:41.321874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1009a-df27-4159-92ac-ee3b2bffc202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:41.322758 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1009a-df27-4159-92ac-ee3b2bffc202 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:41.323050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1009a-df27-4159-92ac-ee3b2bffc202 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:41.323325 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1009a-df27-4159-92ac-ee3b2bffc202 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:41.334888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1009a-df27-4159-92ac-ee3b2bffc202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-70e1009a-df27-4159-92ac-ee3b2bffc202 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:41.343871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:41.344766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:41.345984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:41.345984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:41.345984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:41.345984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:41.345984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:41.345984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:41.345984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:41.345984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:41.345984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:41.345984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:41.345984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:41.345984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:41.345984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 118/227] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:13:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:41.350991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1009a-df27-4159-92ac-ee3b2bffc202 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:41.351857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 110/228] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:41.362174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866424f-18b3-420f-a01d-8bd714e10f78 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:41.488145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1009a-df27-4159-92ac-ee3b2bffc202 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:41.509358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866424f-18b3-420f-a01d-8bd714e10f78 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:41.534062 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958bc07-9ede-4f56-9643-893b128b18f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:41.535258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958bc07-9ede-4f56-9643-893b128b18f2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:41.536034 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958bc07-9ede-4f56-9643-893b128b18f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:41.536796 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958bc07-9ede-4f56-9643-893b128b18f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:41.538014 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958bc07-9ede-4f56-9643-893b128b18f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:41.538850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958bc07-9ede-4f56-9643-893b128b18f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:41.540722 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958bc07-9ede-4f56-9643-893b128b18f2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:41.548177 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956123b-8d20-49d3-8172-a990a669f363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:41.549082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956123b-8d20-49d3-8172-a990a669f363 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:41.549370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956123b-8d20-49d3-8172-a990a669f363 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:41.549645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956123b-8d20-49d3-8172-a990a669f363 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:41.550860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956123b-8d20-49d3-8172-a990a669f363 None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:41.551374 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 119/229] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:13:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:41.552287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956123b-8d20-49d3-8172-a990a669f363 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:41.560447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 111/230] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:41 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:41.560613 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958bc07-9ede-4f56-9643-893b128b18f2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:41.561617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956123b-8d20-49d3-8172-a990a669f363 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:41.663350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956123b-8d20-49d3-8172-a990a669f363 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:41.685674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958bc07-9ede-4f56-9643-893b128b18f2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:41.710930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e93259-27e7-4da4-b4d6-ffc2bb5b93fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:41.711857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e93259-27e7-4da4-b4d6-ffc2bb5b93fa None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:41.712286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e93259-27e7-4da4-b4d6-ffc2bb5b93fa None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:41.712705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e93259-27e7-4da4-b4d6-ffc2bb5b93fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:41.713710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e93259-27e7-4da4-b4d6-ffc2bb5b93fa None admin] RBAC: Adding query filter params (role.id=dc43ddd6d3b649a187dbfe63b0e20247, scope.project.id=6199907f9ce64320bb281523e68ea62a, user.id=a25e29702a4d4772b786ccbf752848c5) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:41.714482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e93259-27e7-4da4-b4d6-ffc2bb5b93fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:41.716268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e93259-27e7-4da4-b4d6-ffc2bb5b93fa None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:41.727423 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 112/231] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:41 2022] GET /identity/v3/role_assignments?user.id=a25e29702a4d4772b786ccbf752848c5&scope.project.id=6199907f9ce64320bb281523e68ea62a&role.id=dc43ddd6d3b649a187dbfe63b0e20247 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:41.753890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462887e-f8b6-4e22-87a7-7906b1eedb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:41.755052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462887e-f8b6-4e22-87a7-7906b1eedb95 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:41.755509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462887e-f8b6-4e22-87a7-7906b1eedb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:41.755930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462887e-f8b6-4e22-87a7-7906b1eedb95 None admin] PATH_INFO: `/v3/users/8a994fcb2b3945f08f4775525e6c6b97` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:41.757521 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462887e-f8b6-4e22-87a7-7906b1eedb95 None admin] RBAC: Authorizing `identity:get_user(user_id=8a994fcb2b3945f08f4775525e6c6b97)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:41.759183 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462887e-f8b6-4e22-87a7-7906b1eedb95 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:41.761132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 120/232] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:41 2022] GET /identity/v3/users/8a994fcb2b3945f08f4775525e6c6b97 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:41.767040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e93259-27e7-4da4-b4d6-ffc2bb5b93fa None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:41.911972 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e93259-27e7-4da4-b4d6-ffc2bb5b93fa None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:41.958770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd0968-559f-4753-8638-09c923d607a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:41.959902 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd0968-559f-4753-8638-09c923d607a6 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:41.960335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd0968-559f-4753-8638-09c923d607a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:41.960777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd0968-559f-4753-8638-09c923d607a6 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:41.962244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd0968-559f-4753-8638-09c923d607a6 None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:41.963899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd0968-559f-4753-8638-09c923d607a6 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:41.965924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 113/233] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:41 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:41.971623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462887e-f8b6-4e22-87a7-7906b1eedb95 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:42.104181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462887e-f8b6-4e22-87a7-7906b1eedb95 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:42.146444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9401fe-3608-49c2-ad97-a97c074718c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:42.147819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9401fe-3608-49c2-ad97-a97c074718c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:42.148240 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9401fe-3608-49c2-ad97-a97c074718c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:42.148677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9401fe-3608-49c2-ad97-a97c074718c0 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a/users/8a994fcb2b3945f08f4775525e6c6b97/roles/472b056b3a5047109259d7fad9133274` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:42.151028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9401fe-3608-49c2-ad97-a97c074718c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6199907f9ce64320bb281523e68ea62a, user_id=8a994fcb2b3945f08f4775525e6c6b97, role_id=472b056b3a5047109259d7fad9133274)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:42.153170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9401fe-3608-49c2-ad97-a97c074718c0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:42.172826 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 121/234] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:13:41 2022] PUT /identity/v3/projects/6199907f9ce64320bb281523e68ea62a/users/8a994fcb2b3945f08f4775525e6c6b97/roles/472b056b3a5047109259d7fad9133274 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:13:43.360287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301cd16-5c17-4487-8dd4-3ee6ac6fba09 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:43.360783 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301cd16-5c17-4487-8dd4-3ee6ac6fba09 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:43.360783 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301cd16-5c17-4487-8dd4-3ee6ac6fba09 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:43.362442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 114/235] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:43.367632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280f91f-b51b-4547-be1d-3fc7cca5ffdc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:43.368475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280f91f-b51b-4547-be1d-3fc7cca5ffdc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:43.368954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280f91f-b51b-4547-be1d-3fc7cca5ffdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:43.386727 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f280f91f-b51b-4547-be1d-3fc7cca5ffdc None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:43.388257 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f280f91f-b51b-4547-be1d-3fc7cca5ffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:43.462305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 122/236] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:43.485887 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301cd16-5c17-4487-8dd4-3ee6ac6fba09 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:43.592568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301cd16-5c17-4487-8dd4-3ee6ac6fba09 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:43.603216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3634414-0591-4fbf-8b63-e5782a5748c0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:43.603513 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3634414-0591-4fbf-8b63-e5782a5748c0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:43.603785 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3634414-0591-4fbf-8b63-e5782a5748c0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:43.605487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 123/237] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:13:43.612470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b06da4-effb-4d76-ad0c-a32d9fda9f73 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:43.612762 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b06da4-effb-4d76-ad0c-a32d9fda9f73 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:43.613233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b06da4-effb-4d76-ad0c-a32d9fda9f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:43.635648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-22b06da4-effb-4d76-ad0c-a32d9fda9f73 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:43.638359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-22b06da4-effb-4d76-ad0c-a32d9fda9f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:43.661184 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee66f5-3ef4-44f0-a7f8-14d9595fb238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:43.662220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee66f5-3ef4-44f0-a7f8-14d9595fb238 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:43.662651 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee66f5-3ef4-44f0-a7f8-14d9595fb238 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:43.663070 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee66f5-3ef4-44f0-a7f8-14d9595fb238 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:43.681934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee66f5-3ef4-44f0-a7f8-14d9595fb238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-0fee66f5-3ef4-44f0-a7f8-14d9595fb238 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:43.693736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:43.694657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:43.695890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:43.695890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:43.695890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:43.695890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:43.695890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:43.695890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:43.695890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:43.695890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:43.695890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:43.695890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:43.695890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:43.695890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:43.702788 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 115/238] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:43.716207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee66f5-3ef4-44f0-a7f8-14d9595fb238 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:43.740137 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 124/239] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:43.788849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b06da4-effb-4d76-ad0c-a32d9fda9f73 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:43.849551 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee66f5-3ef4-44f0-a7f8-14d9595fb238 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:43.897707 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b06da4-effb-4d76-ad0c-a32d9fda9f73 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:43.898030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28e774-a194-476f-a217-6be54fb24eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:43.898729 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28e774-a194-476f-a217-6be54fb24eab None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:43.899057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28e774-a194-476f-a217-6be54fb24eab None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:43.899336 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28e774-a194-476f-a217-6be54fb24eab None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:43.900150 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28e774-a194-476f-a217-6be54fb24eab None admin] RBAC: Adding query filter params (name=reader) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:43.900485 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28e774-a194-476f-a217-6be54fb24eab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:43.902286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28e774-a194-476f-a217-6be54fb24eab None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:43.915124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 116/240] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:43.922931 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28e774-a194-476f-a217-6be54fb24eab None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:43.939802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e81d3-d0fe-48c3-9da2-240eb997ed26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:43.940919 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e81d3-d0fe-48c3-9da2-240eb997ed26 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:43.941456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e81d3-d0fe-48c3-9da2-240eb997ed26 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:43.941930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e81d3-d0fe-48c3-9da2-240eb997ed26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:43.943296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e81d3-d0fe-48c3-9da2-240eb997ed26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:43.944944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e81d3-d0fe-48c3-9da2-240eb997ed26 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:43.946828 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 125/241] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:43.956214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e81d3-d0fe-48c3-9da2-240eb997ed26 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:44.059520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e81d3-d0fe-48c3-9da2-240eb997ed26 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:44.094331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04059a-469e-4e26-8220-76c87de12d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:44.095362 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04059a-469e-4e26-8220-76c87de12d11 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:44.095870 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04059a-469e-4e26-8220-76c87de12d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:44.096342 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04059a-469e-4e26-8220-76c87de12d11 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:44.097297 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04059a-469e-4e26-8220-76c87de12d11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:44.098957 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04059a-469e-4e26-8220-76c87de12d11 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:44.127257 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 126/242] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:13:43 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:13:44.157697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28e774-a194-476f-a217-6be54fb24eab None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:44.195176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c235c-dce0-4903-8e0b-018758cd969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:44.196443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c235c-dce0-4903-8e0b-018758cd969d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:44.196927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c235c-dce0-4903-8e0b-018758cd969d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:44.197505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c235c-dce0-4903-8e0b-018758cd969d None admin] PATH_INFO: `/v3/users/55ea507cfbe44bfe9f2fc345ef1af19a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:44.213301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c235c-dce0-4903-8e0b-018758cd969d None admin] RBAC: Authorizing `identity:get_user(user_id=55ea507cfbe44bfe9f2fc345ef1af19a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:44.215762 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c235c-dce0-4903-8e0b-018758cd969d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:44.218083 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 117/243] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:43 2022] GET /identity/v3/users/55ea507cfbe44bfe9f2fc345ef1af19a => generated 297 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:44.223721 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04059a-469e-4e26-8220-76c87de12d11 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:44.345002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04059a-469e-4e26-8220-76c87de12d11 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:44.388726 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c2c58-13bc-42d5-bbf5-c47d9c464277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:44.389521 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c2c58-13bc-42d5-bbf5-c47d9c464277 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:44.389689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c2c58-13bc-42d5-bbf5-c47d9c464277 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:44.389970 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c2c58-13bc-42d5-bbf5-c47d9c464277 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:44.461107 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c2c58-13bc-42d5-bbf5-c47d9c464277 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:44.462558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c2c58-13bc-42d5-bbf5-c47d9c464277 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:44.478288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1882b79-cf3f-422b-9154-8c361ea42398 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:44.478796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1882b79-cf3f-422b-9154-8c361ea42398 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:44.478869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1882b79-cf3f-422b-9154-8c361ea42398 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:44.480480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 118/244] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:44.486606 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15939a-e6da-471e-ae98-f2e53a52a279 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:44.486893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15939a-e6da-471e-ae98-f2e53a52a279 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:44.487164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15939a-e6da-471e-ae98-f2e53a52a279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:44.507935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-3c15939a-e6da-471e-ae98-f2e53a52a279 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:44.509146 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3c15939a-e6da-471e-ae98-f2e53a52a279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:44.565131 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 127/245] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:44.573995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c2c58-13bc-42d5-bbf5-c47d9c464277 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:44.582981 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 119/246] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:44.606299 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15939a-e6da-471e-ae98-f2e53a52a279 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:44.674383 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c2c58-13bc-42d5-bbf5-c47d9c464277 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:44.729459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eee240-d676-4ccf-8937-f4c91ffc7e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:44.730258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eee240-d676-4ccf-8937-f4c91ffc7e03 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:44.731061 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eee240-d676-4ccf-8937-f4c91ffc7e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:44.731349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eee240-d676-4ccf-8937-f4c91ffc7e03 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:44.733436 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eee240-d676-4ccf-8937-f4c91ffc7e03 None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:44.734899 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eee240-d676-4ccf-8937-f4c91ffc7e03 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:44.736742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 128/247] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:44 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:44.737801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69118d-073e-4afb-86f6-fc191b81a9e4 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:44.738082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69118d-073e-4afb-86f6-fc191b81a9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:44.738354 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69118d-073e-4afb-86f6-fc191b81a9e4 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:44.739559 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 129/248] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:44.745342 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69118d-073e-4afb-86f6-fc191b81a9e4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:44.754278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15939a-e6da-471e-ae98-f2e53a52a279 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:44.802388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d350ca4-9719-4751-baed-cbb8b80c5f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:44.803224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d350ca4-9719-4751-baed-cbb8b80c5f9f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:44.803498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d350ca4-9719-4751-baed-cbb8b80c5f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:44.803767 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d350ca4-9719-4751-baed-cbb8b80c5f9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:44.818241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d350ca4-9719-4751-baed-cbb8b80c5f9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-6d350ca4-9719-4751-baed-cbb8b80c5f9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:44.828557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:44.829591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:44.830401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:44.830401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:44.830401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:44.830401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:44.830401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:44.830401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:44.830401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:44.830401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:44.830401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:44.830401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:44.830401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:13:44.830401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:44.830401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 120/249] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:13:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:13:44.831639 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce418b7-3ebe-403c-8c20-f729ee1a66cb None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:44.832319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce418b7-3ebe-403c-8c20-f729ee1a66cb None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:44.832319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce418b7-3ebe-403c-8c20-f729ee1a66cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:44.852069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-5ce418b7-3ebe-403c-8c20-f729ee1a66cb None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:44.853705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5ce418b7-3ebe-403c-8c20-f729ee1a66cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:44.877585 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69118d-073e-4afb-86f6-fc191b81a9e4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:44.921887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e094019-f957-42b7-bb78-e40984a794e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:44.922701 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e094019-f957-42b7-bb78-e40984a794e0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:44.923035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e094019-f957-42b7-bb78-e40984a794e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:44.923309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e094019-f957-42b7-bb78-e40984a794e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:44.924291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e094019-f957-42b7-bb78-e40984a794e0 None admin] RBAC: Adding query filter params (role.id=4ec76066e1a543478164db1c9d114ce9, scope.project.id=6199907f9ce64320bb281523e68ea62a, user.id=55ea507cfbe44bfe9f2fc345ef1af19a) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:44.924607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e094019-f957-42b7-bb78-e40984a794e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:44.925479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 121/250] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:44.926145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e094019-f957-42b7-bb78-e40984a794e0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:44.926796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce418b7-3ebe-403c-8c20-f729ee1a66cb None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:44.933058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 130/251] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:44 2022] GET /identity/v3/role_assignments?user.id=55ea507cfbe44bfe9f2fc345ef1af19a&scope.project.id=6199907f9ce64320bb281523e68ea62a&role.id=4ec76066e1a543478164db1c9d114ce9 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:44.975290 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e094019-f957-42b7-bb78-e40984a794e0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:45.084609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce418b7-3ebe-403c-8c20-f729ee1a66cb None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:45.129089 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135102e8-da44-4ae2-a25c-17b440ea0cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:45.130128 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135102e8-da44-4ae2-a25c-17b440ea0cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:45.130649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135102e8-da44-4ae2-a25c-17b440ea0cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:45.130926 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135102e8-da44-4ae2-a25c-17b440ea0cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:45.131698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135102e8-da44-4ae2-a25c-17b440ea0cc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:45.132007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135102e8-da44-4ae2-a25c-17b440ea0cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:45.133487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135102e8-da44-4ae2-a25c-17b440ea0cc2 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:45.149029 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e094019-f957-42b7-bb78-e40984a794e0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:45.149218 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 122/252] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:45.156699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135102e8-da44-4ae2-a25c-17b440ea0cc2 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:45.205512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d05c2a-a36f-4fc8-b6a0-037fc95e2025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:45.206405 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d05c2a-a36f-4fc8-b6a0-037fc95e2025 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:45.207057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d05c2a-a36f-4fc8-b6a0-037fc95e2025 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:45.207335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d05c2a-a36f-4fc8-b6a0-037fc95e2025 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:45.221492 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d05c2a-a36f-4fc8-b6a0-037fc95e2025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-f5d05c2a-a36f-4fc8-b6a0-037fc95e2025 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:45.229892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:45.231444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:45.232233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:45.232233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:45.232233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:45.232233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:45.232233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:45.232233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:45.232233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:45.232233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:45.232233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:45.232233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:45.232233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:45.232233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:45.233373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 131/253] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:13:45.238702 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee032fa-37f8-4663-a404-f69c0956e92c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:45.239168 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee032fa-37f8-4663-a404-f69c0956e92c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:45.239449 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee032fa-37f8-4663-a404-f69c0956e92c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:45.240806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 132/254] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:45.242616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee032fa-37f8-4663-a404-f69c0956e92c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:45.305617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135102e8-da44-4ae2-a25c-17b440ea0cc2 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:45.339268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3e946-225a-4ffc-8325-05165eb1bcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:45.340666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3e946-225a-4ffc-8325-05165eb1bcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:45.340946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3e946-225a-4ffc-8325-05165eb1bcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:45.341244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3e946-225a-4ffc-8325-05165eb1bcf7 None admin] PATH_INFO: `/v3/users/8a994fcb2b3945f08f4775525e6c6b97` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:45.342444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3e946-225a-4ffc-8325-05165eb1bcf7 None admin] RBAC: Authorizing `identity:get_user(user_id=8a994fcb2b3945f08f4775525e6c6b97)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:45.343945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3e946-225a-4ffc-8325-05165eb1bcf7 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:45.345615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 123/255] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:45 2022] GET /identity/v3/users/8a994fcb2b3945f08f4775525e6c6b97 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:45.346747 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242e1b6-f202-4826-9422-dd1ae3299372 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:45.347025 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242e1b6-f202-4826-9422-dd1ae3299372 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:45.347297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242e1b6-f202-4826-9422-dd1ae3299372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:45.368246 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e242e1b6-f202-4826-9422-dd1ae3299372 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:45.369500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e242e1b6-f202-4826-9422-dd1ae3299372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:45.436640 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee032fa-37f8-4663-a404-f69c0956e92c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:45.477923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 124/256] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:45.478789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242e1b6-f202-4826-9422-dd1ae3299372 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:45.502975 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ca795-f679-4fd3-8861-2331f2f61393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:45.503575 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ca795-f679-4fd3-8861-2331f2f61393 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:45.503859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ca795-f679-4fd3-8861-2331f2f61393 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:45.504137 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ca795-f679-4fd3-8861-2331f2f61393 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:45.504891 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ca795-f679-4fd3-8861-2331f2f61393 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:45.505230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ca795-f679-4fd3-8861-2331f2f61393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:45.506628 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ca795-f679-4fd3-8861-2331f2f61393 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:45.527393 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 133/257] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:45.530952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ca795-f679-4fd3-8861-2331f2f61393 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:45.621669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242e1b6-f202-4826-9422-dd1ae3299372 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:45.632752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ca795-f679-4fd3-8861-2331f2f61393 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:45.656533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3f5ce-1c82-4b52-97f8-a4a1dfc679ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:45.657511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3f5ce-1c82-4b52-97f8-a4a1dfc679ea None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:45.658003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3f5ce-1c82-4b52-97f8-a4a1dfc679ea None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:45.658464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3f5ce-1c82-4b52-97f8-a4a1dfc679ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:45.667065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f65df-fc26-4183-b6fa-002cfdfafd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:45.667874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f65df-fc26-4183-b6fa-002cfdfafd7c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:45.668193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f65df-fc26-4183-b6fa-002cfdfafd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:45.668472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f65df-fc26-4183-b6fa-002cfdfafd7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:45.678878 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f65df-fc26-4183-b6fa-002cfdfafd7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ef0f65df-fc26-4183-b6fa-002cfdfafd7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:45.687246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:45.688153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:45.688936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:45.688936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:45.688936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:45.688936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:45.688936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:45.688936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:45.688936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:45.688936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:45.688936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:45.688936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:45.688936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:45.688936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:45.688936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 134/258] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:13:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:45.690169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f65df-fc26-4183-b6fa-002cfdfafd7c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:45.732514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3f5ce-1c82-4b52-97f8-a4a1dfc679ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:45.734402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3f5ce-1c82-4b52-97f8-a4a1dfc679ea None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:45.789554 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f65df-fc26-4183-b6fa-002cfdfafd7c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:45.822578 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76723-8a8c-4d39-adb5-d1d1fa16289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:45.823461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76723-8a8c-4d39-adb5-d1d1fa16289f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:45.823794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76723-8a8c-4d39-adb5-d1d1fa16289f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:45.824026 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76723-8a8c-4d39-adb5-d1d1fa16289f None admin] PATH_INFO: `/v3/users/a25e29702a4d4772b786ccbf752848c5` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:45.825281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb76723-8a8c-4d39-adb5-d1d1fa16289f None admin] RBAC: Authorizing `identity:get_user(user_id=a25e29702a4d4772b786ccbf752848c5)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:45.826801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb76723-8a8c-4d39-adb5-d1d1fa16289f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:45.829040 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 135/259] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:45 2022] GET /identity/v3/users/a25e29702a4d4772b786ccbf752848c5 => generated 297 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:45.829818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76723-8a8c-4d39-adb5-d1d1fa16289f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:45.834295 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 125/260] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:45.835370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3f5ce-1c82-4b52-97f8-a4a1dfc679ea None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:45.938212 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3f5ce-1c82-4b52-97f8-a4a1dfc679ea None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:45.941298 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76723-8a8c-4d39-adb5-d1d1fa16289f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:45.973294 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471a387-3997-480e-a2e3-cb9fa4420e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:45.984403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471a387-3997-480e-a2e3-cb9fa4420e83 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:45.984897 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471a387-3997-480e-a2e3-cb9fa4420e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:45.985418 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471a387-3997-480e-a2e3-cb9fa4420e83 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:45.986925 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471a387-3997-480e-a2e3-cb9fa4420e83 None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:45.988810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471a387-3997-480e-a2e3-cb9fa4420e83 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:45.991229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 126/261] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:45 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:45.991465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8aba38-dba0-44bb-b42b-2c9ca6ab9cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:45.992143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8aba38-dba0-44bb-b42b-2c9ca6ab9cba None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:45.992428 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8aba38-dba0-44bb-b42b-2c9ca6ab9cba None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:45.992707 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8aba38-dba0-44bb-b42b-2c9ca6ab9cba None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:45.993109 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471a387-3997-480e-a2e3-cb9fa4420e83 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:45.993497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8aba38-dba0-44bb-b42b-2c9ca6ab9cba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:45.993808 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8aba38-dba0-44bb-b42b-2c9ca6ab9cba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:45.995179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8aba38-dba0-44bb-b42b-2c9ca6ab9cba None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:46.004304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 136/262] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:13:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:46.005403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8aba38-dba0-44bb-b42b-2c9ca6ab9cba None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:46.094993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471a387-3997-480e-a2e3-cb9fa4420e83 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:46.129575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e25db-e1cb-4034-946d-8f74ea139119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:46.130770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e25db-e1cb-4034-946d-8f74ea139119 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:46.131247 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e25db-e1cb-4034-946d-8f74ea139119 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:46.131735 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e25db-e1cb-4034-946d-8f74ea139119 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:46.133136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e25db-e1cb-4034-946d-8f74ea139119 None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:46.134769 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e25db-e1cb-4034-946d-8f74ea139119 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:46.136672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 127/263] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:45 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:46.141742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e25db-e1cb-4034-946d-8f74ea139119 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:46.149131 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8aba38-dba0-44bb-b42b-2c9ca6ab9cba None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:46.214283 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45cc13-2c1d-49a3-822c-91e8af9b9924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:46.215213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45cc13-2c1d-49a3-822c-91e8af9b9924 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:46.215494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45cc13-2c1d-49a3-822c-91e8af9b9924 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:46.215766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45cc13-2c1d-49a3-822c-91e8af9b9924 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a/users/a25e29702a4d4772b786ccbf752848c5/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:46.222450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45cc13-2c1d-49a3-822c-91e8af9b9924 None admin] RBAC: Authorizing `identity:create_grant(project_id=6199907f9ce64320bb281523e68ea62a, user_id=a25e29702a4d4772b786ccbf752848c5, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:46.223889 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45cc13-2c1d-49a3-822c-91e8af9b9924 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:46.243516 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e25db-e1cb-4034-946d-8f74ea139119 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:46.247598 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 137/264] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:13:46 2022] PUT /identity/v3/projects/6199907f9ce64320bb281523e68ea62a/users/a25e29702a4d4772b786ccbf752848c5/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:13:46.248511 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45cc13-2c1d-49a3-822c-91e8af9b9924 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:46.291261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb9e2e-1f28-4ba8-b159-6da0fa221542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:46.292531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb9e2e-1f28-4ba8-b159-6da0fa221542 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:46.293043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb9e2e-1f28-4ba8-b159-6da0fa221542 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:46.294050 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb9e2e-1f28-4ba8-b159-6da0fa221542 None admin] PATH_INFO: `/v3/users/8a994fcb2b3945f08f4775525e6c6b97` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:46.295598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb9e2e-1f28-4ba8-b159-6da0fa221542 None admin] RBAC: Authorizing `identity:get_user(user_id=8a994fcb2b3945f08f4775525e6c6b97)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:46.297267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb9e2e-1f28-4ba8-b159-6da0fa221542 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:46.299486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 128/265] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:46 2022] GET /identity/v3/users/8a994fcb2b3945f08f4775525e6c6b97 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:46.304437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb9e2e-1f28-4ba8-b159-6da0fa221542 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:46.429659 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb9e2e-1f28-4ba8-b159-6da0fa221542 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:46.448825 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45cc13-2c1d-49a3-822c-91e8af9b9924 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:46.465766 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277e0a3-c6e4-4180-9246-97ab05a382ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:46.466775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277e0a3-c6e4-4180-9246-97ab05a382ed None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:46.467324 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277e0a3-c6e4-4180-9246-97ab05a382ed None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:46.467863 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277e0a3-c6e4-4180-9246-97ab05a382ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:46.506486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee25ed3-2a1c-4b8a-8514-46ff109c6864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:46.507157 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee25ed3-2a1c-4b8a-8514-46ff109c6864 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:46.507442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee25ed3-2a1c-4b8a-8514-46ff109c6864 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:46.507722 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee25ed3-2a1c-4b8a-8514-46ff109c6864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:46.508571 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee25ed3-2a1c-4b8a-8514-46ff109c6864 None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=6199907f9ce64320bb281523e68ea62a, user.id=8a994fcb2b3945f08f4775525e6c6b97) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:46.508884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee25ed3-2a1c-4b8a-8514-46ff109c6864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:46.510472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee25ed3-2a1c-4b8a-8514-46ff109c6864 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:46.525889 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 138/266] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:46 2022] GET /identity/v3/role_assignments?user.id=8a994fcb2b3945f08f4775525e6c6b97&scope.project.id=6199907f9ce64320bb281523e68ea62a&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:46.540755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277e0a3-c6e4-4180-9246-97ab05a382ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:46.542467 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277e0a3-c6e4-4180-9246-97ab05a382ed None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:46.653266 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 129/267] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:46.658440 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee25ed3-2a1c-4b8a-8514-46ff109c6864 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:46.772690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee25ed3-2a1c-4b8a-8514-46ff109c6864 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:46.808170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb64ed-5676-4f59-b39a-7b3148dc0cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:46.809618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb64ed-5676-4f59-b39a-7b3148dc0cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:46.809900 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb64ed-5676-4f59-b39a-7b3148dc0cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:46.810176 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb64ed-5676-4f59-b39a-7b3148dc0cc4 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:46.811371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb64ed-5676-4f59-b39a-7b3148dc0cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:46.812833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb64ed-5676-4f59-b39a-7b3148dc0cc4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:46.814843 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 139/268] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:46 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:46.820596 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277e0a3-c6e4-4180-9246-97ab05a382ed None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:46.920234 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277e0a3-c6e4-4180-9246-97ab05a382ed None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:46.954996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c790f9-253f-4a4b-8930-272c387d6a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:46.955667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c790f9-253f-4a4b-8930-272c387d6a51 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:46.955952 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c790f9-253f-4a4b-8930-272c387d6a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:46.956229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c790f9-253f-4a4b-8930-272c387d6a51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:46.957097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c790f9-253f-4a4b-8930-272c387d6a51 None admin] RBAC: Adding query filter params (role.id=472b056b3a5047109259d7fad9133274, scope.project.id=6199907f9ce64320bb281523e68ea62a, user.id=8a994fcb2b3945f08f4775525e6c6b97) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:46.957419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c790f9-253f-4a4b-8930-272c387d6a51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:46.958882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c790f9-253f-4a4b-8930-272c387d6a51 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:46.965410 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 130/269] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:46 2022] GET /identity/v3/role_assignments?user.id=8a994fcb2b3945f08f4775525e6c6b97&scope.project.id=6199907f9ce64320bb281523e68ea62a&role.id=472b056b3a5047109259d7fad9133274 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:47.573533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7cfbb-e1ad-429e-8b9e-7eaa4dab5f4c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:47.574042 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7cfbb-e1ad-429e-8b9e-7eaa4dab5f4c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:47.574116 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7cfbb-e1ad-429e-8b9e-7eaa4dab5f4c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:47.575971 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 140/270] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:47.581582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe71d6-ecaa-4fcb-8722-ba08e6c8e503 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:47.582348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe71d6-ecaa-4fcb-8722-ba08e6c8e503 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:47.582773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe71d6-ecaa-4fcb-8722-ba08e6c8e503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:47.600353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-5abe71d6-ecaa-4fcb-8722-ba08e6c8e503 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:47.601838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5abe71d6-ecaa-4fcb-8722-ba08e6c8e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:47.638810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c9336-18c5-4259-984a-f599c42be0a0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:47.639449 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c9336-18c5-4259-984a-f599c42be0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:47.639925 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c9336-18c5-4259-984a-f599c42be0a0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:47.642546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 141/271] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:13:47.648425 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8be0-94c7-4950-a232-7715eaaed6d4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:47.649009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8be0-94c7-4950-a232-7715eaaed6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:47.649504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff8be0-94c7-4950-a232-7715eaaed6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:47.667772 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9fff8be0-94c7-4950-a232-7715eaaed6d4 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:47.669551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9fff8be0-94c7-4950-a232-7715eaaed6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:47.674473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 131/272] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:47.700558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe71d6-ecaa-4fcb-8722-ba08e6c8e503 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:47.743087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 142/273] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:47.769072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff8be0-94c7-4950-a232-7715eaaed6d4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:47.801243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe71d6-ecaa-4fcb-8722-ba08e6c8e503 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:47.835710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc5ea0-e8f2-4b1e-a98e-f225b5b80389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:47.836443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5ea0-e8f2-4b1e-a98e-f225b5b80389 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:47.836725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5ea0-e8f2-4b1e-a98e-f225b5b80389 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:47.837011 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5ea0-e8f2-4b1e-a98e-f225b5b80389 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:47.838203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc5ea0-e8f2-4b1e-a98e-f225b5b80389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:47.839654 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc5ea0-e8f2-4b1e-a98e-f225b5b80389 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:47.841359 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 132/274] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:47.846683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc5ea0-e8f2-4b1e-a98e-f225b5b80389 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:47.870227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff8be0-94c7-4950-a232-7715eaaed6d4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:47.904618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b41494-2ace-4715-b899-6309c433fe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:47.905445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b41494-2ace-4715-b899-6309c433fe30 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:47.905730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b41494-2ace-4715-b899-6309c433fe30 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:47.906005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b41494-2ace-4715-b899-6309c433fe30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:47.916504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b41494-2ace-4715-b899-6309c433fe30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-13b41494-2ace-4715-b899-6309c433fe30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:47.924795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:47.925885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:47.929768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:47.929768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:47.929768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:47.929768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:47.929768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:47.929768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:47.929768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:47.929768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:47.929768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:47.929768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:47.929768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:47.929768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:47.929768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 143/275] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:13:47.929768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54c557-dfa4-43fc-a433-941985627251 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:47.930488 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54c557-dfa4-43fc-a433-941985627251 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:47.930488 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54c557-dfa4-43fc-a433-941985627251 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:47.933245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 144/276] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:47.934018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54c557-dfa4-43fc-a433-941985627251 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:47.950234 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc5ea0-e8f2-4b1e-a98e-f225b5b80389 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:47.992086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c6dbd-e812-40b4-921e-c1d017f27084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:47.992764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6dbd-e812-40b4-921e-c1d017f27084 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:47.993260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6dbd-e812-40b4-921e-c1d017f27084 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:47.993674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6dbd-e812-40b4-921e-c1d017f27084 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:47.994577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c6dbd-e812-40b4-921e-c1d017f27084 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:47.996283 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c6dbd-e812-40b4-921e-c1d017f27084 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:48.017119 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 133/277] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:13:47 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:13:48.018779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410650b0-3803-452b-86db-d0a9abb97944 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:48.019206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410650b0-3803-452b-86db-d0a9abb97944 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:48.019520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410650b0-3803-452b-86db-d0a9abb97944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:48.040342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-410650b0-3803-452b-86db-d0a9abb97944 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:48.041862 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-410650b0-3803-452b-86db-d0a9abb97944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:48.060384 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54c557-dfa4-43fc-a433-941985627251 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:48.106881 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec440ba-364f-4d6a-a8e0-9fde1a23296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:48.107486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec440ba-364f-4d6a-a8e0-9fde1a23296e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:48.107766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec440ba-364f-4d6a-a8e0-9fde1a23296e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:48.108038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec440ba-364f-4d6a-a8e0-9fde1a23296e None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:48.109422 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec440ba-364f-4d6a-a8e0-9fde1a23296e None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:48.109754 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec440ba-364f-4d6a-a8e0-9fde1a23296e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:48.111530 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec440ba-364f-4d6a-a8e0-9fde1a23296e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:48.123384 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 145/278] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:48.129689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec440ba-364f-4d6a-a8e0-9fde1a23296e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:48.137115 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 134/279] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:48.153602 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410650b0-3803-452b-86db-d0a9abb97944 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:48.266118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec440ba-364f-4d6a-a8e0-9fde1a23296e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:48.273872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410650b0-3803-452b-86db-d0a9abb97944 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:48.307763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315157f9-363e-49dc-a1e5-2c31b7294773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:48.308679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315157f9-363e-49dc-a1e5-2c31b7294773 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:48.308963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315157f9-363e-49dc-a1e5-2c31b7294773 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:48.309267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315157f9-363e-49dc-a1e5-2c31b7294773 None admin] PATH_INFO: `/v3/users/887c95bb230e4806ba31bb92fb6c6431` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:48.326435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fac3b-2a9a-498b-bb6e-1e94e4a3980d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:48.326648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315157f9-363e-49dc-a1e5-2c31b7294773 None admin] RBAC: Authorizing `identity:get_user(user_id=887c95bb230e4806ba31bb92fb6c6431)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:48.327240 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fac3b-2a9a-498b-bb6e-1e94e4a3980d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:48.327521 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fac3b-2a9a-498b-bb6e-1e94e4a3980d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:48.327796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fac3b-2a9a-498b-bb6e-1e94e4a3980d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:48.328065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315157f9-363e-49dc-a1e5-2c31b7294773 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:48.334610 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 146/280] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:48 2022] GET /identity/v3/users/887c95bb230e4806ba31bb92fb6c6431 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:48.335939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315157f9-363e-49dc-a1e5-2c31b7294773 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:48.338606 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fac3b-2a9a-498b-bb6e-1e94e4a3980d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-5c8fac3b-2a9a-498b-bb6e-1e94e4a3980d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:48.348108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:48.349024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:48.349803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:48.349803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:48.349803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:48.349803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:48.349803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:48.349803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:48.349803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:48.349803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:48.349803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:48.349803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:48.349803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:48.349803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:48.350421 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 135/281] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:48.356358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fac3b-2a9a-498b-bb6e-1e94e4a3980d None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:48.468567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315157f9-363e-49dc-a1e5-2c31b7294773 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:48.479550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fac3b-2a9a-498b-bb6e-1e94e4a3980d None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:48.512154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ababef-cec8-4eb6-87d5-2583bca0a310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:48.512928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ababef-cec8-4eb6-87d5-2583bca0a310 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:48.513234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ababef-cec8-4eb6-87d5-2583bca0a310 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:48.513509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ababef-cec8-4eb6-87d5-2583bca0a310 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:48.514546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ababef-cec8-4eb6-87d5-2583bca0a310 None admin] RBAC: Adding query filter params (role.id=dc43ddd6d3b649a187dbfe63b0e20247, user.id=887c95bb230e4806ba31bb92fb6c6431, scope.system=all) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:48.514858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ababef-cec8-4eb6-87d5-2583bca0a310 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:48.515752 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34025c7d-8866-472b-a983-881a7fe2f882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:48.516409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ababef-cec8-4eb6-87d5-2583bca0a310 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:48.516861 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34025c7d-8866-472b-a983-881a7fe2f882 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:48.517358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34025c7d-8866-472b-a983-881a7fe2f882 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:48.517947 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34025c7d-8866-472b-a983-881a7fe2f882 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:48.519564 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34025c7d-8866-472b-a983-881a7fe2f882 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:48.520406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34025c7d-8866-472b-a983-881a7fe2f882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:48.528999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 147/282] 10.222.0.61 () {56 vars in 1308 bytes} [Tue May 10 20:13:48 2022] GET /identity/v3/role_assignments?user.id=887c95bb230e4806ba31bb92fb6c6431&scope.system=all&role.id=dc43ddd6d3b649a187dbfe63b0e20247 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:48.529195 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34025c7d-8866-472b-a983-881a7fe2f882 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:48.536319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 136/283] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:48.542205 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ababef-cec8-4eb6-87d5-2583bca0a310 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:48.652538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ababef-cec8-4eb6-87d5-2583bca0a310 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:48.698393 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9febc4b-4ac0-4cca-a647-5251d35841f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:48.699338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9febc4b-4ac0-4cca-a647-5251d35841f1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:48.700133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9febc4b-4ac0-4cca-a647-5251d35841f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:48.700406 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9febc4b-4ac0-4cca-a647-5251d35841f1 None admin] PATH_INFO: `/v3/users/55ea507cfbe44bfe9f2fc345ef1af19a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:48.701648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9febc4b-4ac0-4cca-a647-5251d35841f1 None admin] RBAC: Authorizing `identity:get_user(user_id=55ea507cfbe44bfe9f2fc345ef1af19a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:48.703108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9febc4b-4ac0-4cca-a647-5251d35841f1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:48.705158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 148/284] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:48 2022] GET /identity/v3/users/55ea507cfbe44bfe9f2fc345ef1af19a => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:48.710584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34025c7d-8866-472b-a983-881a7fe2f882 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:48.842647 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34025c7d-8866-472b-a983-881a7fe2f882 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:48.875877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059ec79-2450-4502-b012-66e94c78079b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:48.876737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059ec79-2450-4502-b012-66e94c78079b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:48.877036 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059ec79-2450-4502-b012-66e94c78079b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:48.877315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059ec79-2450-4502-b012-66e94c78079b None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:48.878501 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059ec79-2450-4502-b012-66e94c78079b None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:48.879938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059ec79-2450-4502-b012-66e94c78079b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:48.881858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 137/285] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:48 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:48.888744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9febc4b-4ac0-4cca-a647-5251d35841f1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:49.021324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9febc4b-4ac0-4cca-a647-5251d35841f1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:49.075882 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f086a3-f14e-4d9e-860d-e123518f82df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:49.076780 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f086a3-f14e-4d9e-860d-e123518f82df None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:49.077087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f086a3-f14e-4d9e-860d-e123518f82df None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:49.077423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f086a3-f14e-4d9e-860d-e123518f82df None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a/users/55ea507cfbe44bfe9f2fc345ef1af19a/roles/4ec76066e1a543478164db1c9d114ce9` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:49.082279 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f086a3-f14e-4d9e-860d-e123518f82df None admin] RBAC: Authorizing `identity:create_grant(project_id=6199907f9ce64320bb281523e68ea62a, user_id=55ea507cfbe44bfe9f2fc345ef1af19a, role_id=4ec76066e1a543478164db1c9d114ce9)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:49.083819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f086a3-f14e-4d9e-860d-e123518f82df None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:49.098632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 149/286] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:13:48 2022] PUT /identity/v3/projects/6199907f9ce64320bb281523e68ea62a/users/55ea507cfbe44bfe9f2fc345ef1af19a/roles/4ec76066e1a543478164db1c9d114ce9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:13:49.198328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da6836-e93a-4865-9645-049b76a46dd0 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:49.198670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da6836-e93a-4865-9645-049b76a46dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:49.198894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da6836-e93a-4865-9645-049b76a46dd0 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:49.200718 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 138/287] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:49.206603 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4ab82-0c32-4e98-9e28-bc7729d205e3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:49.206911 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4ab82-0c32-4e98-9e28-bc7729d205e3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:49.207167 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4ab82-0c32-4e98-9e28-bc7729d205e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:49.234228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d8a4ab82-0c32-4e98-9e28-bc7729d205e3 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:49.235532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d8a4ab82-0c32-4e98-9e28-bc7729d205e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:49.313648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 150/288] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:49.337406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da6836-e93a-4865-9645-049b76a46dd0 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:49.446225 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da6836-e93a-4865-9645-049b76a46dd0 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:49.488635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799116f4-6967-487d-b464-66b980bc70db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:49.489481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799116f4-6967-487d-b464-66b980bc70db None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:49.489764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799116f4-6967-487d-b464-66b980bc70db None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:49.490043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799116f4-6967-487d-b464-66b980bc70db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:49.506126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799116f4-6967-487d-b464-66b980bc70db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-799116f4-6967-487d-b464-66b980bc70db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:49.513892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:49.516039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:49.518134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:49.518134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:49.518134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:49.518134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:49.518134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:49.518134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:49.518134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:49.518134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:49.518134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:49.518134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:49.518134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:49.518134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:49.518134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 139/289] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:49.525048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4ab82-0c32-4e98-9e28-bc7729d205e3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:49.632277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4ab82-0c32-4e98-9e28-bc7729d205e3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:49.672880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e6ca7-d7f3-4dfb-8c6f-142cdefd17fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:49.673647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e6ca7-d7f3-4dfb-8c6f-142cdefd17fd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:49.673844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e6ca7-d7f3-4dfb-8c6f-142cdefd17fd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:49.674095 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e6ca7-d7f3-4dfb-8c6f-142cdefd17fd None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:49.674844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e6ca7-d7f3-4dfb-8c6f-142cdefd17fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:49.675152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e6ca7-d7f3-4dfb-8c6f-142cdefd17fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:49.676535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e6ca7-d7f3-4dfb-8c6f-142cdefd17fd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:49.685366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 151/290] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:49.690743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799116f4-6967-487d-b464-66b980bc70db None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:49.836851 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799116f4-6967-487d-b464-66b980bc70db None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:49.882320 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e416fa-2b3c-4c4a-bca5-530143a70d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:49.883189 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e416fa-2b3c-4c4a-bca5-530143a70d66 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:49.883467 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e416fa-2b3c-4c4a-bca5-530143a70d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:49.883827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e416fa-2b3c-4c4a-bca5-530143a70d66 None admin] PATH_INFO: `/v3/users/a25e29702a4d4772b786ccbf752848c5` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:49.885033 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e416fa-2b3c-4c4a-bca5-530143a70d66 None admin] RBAC: Authorizing `identity:get_user(user_id=a25e29702a4d4772b786ccbf752848c5)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:49.886465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e416fa-2b3c-4c4a-bca5-530143a70d66 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:49.888616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 140/291] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:49 2022] GET /identity/v3/users/a25e29702a4d4772b786ccbf752848c5 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:49.894130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e6ca7-d7f3-4dfb-8c6f-142cdefd17fd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:50.072815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e6ca7-d7f3-4dfb-8c6f-142cdefd17fd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:50.105894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb65374-e4e7-4cb7-baa7-1a3bc5404e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:50.106464 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb65374-e4e7-4cb7-baa7-1a3bc5404e5c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:50.106744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb65374-e4e7-4cb7-baa7-1a3bc5404e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:50.107017 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb65374-e4e7-4cb7-baa7-1a3bc5404e5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:50.184929 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb65374-e4e7-4cb7-baa7-1a3bc5404e5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:50.186400 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb65374-e4e7-4cb7-baa7-1a3bc5404e5c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:50.299914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 152/292] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:50.305590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e416fa-2b3c-4c4a-bca5-530143a70d66 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:50.424224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e416fa-2b3c-4c4a-bca5-530143a70d66 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:50.459930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af889b2-943f-4741-8b44-cb7eab13825a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:50.460794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af889b2-943f-4741-8b44-cb7eab13825a None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:50.461098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af889b2-943f-4741-8b44-cb7eab13825a None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:50.461373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af889b2-943f-4741-8b44-cb7eab13825a None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:50.462541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af889b2-943f-4741-8b44-cb7eab13825a None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:50.463997 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af889b2-943f-4741-8b44-cb7eab13825a None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:50.465940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 141/293] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:50 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:50.471401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb65374-e4e7-4cb7-baa7-1a3bc5404e5c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:50.592669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb65374-e4e7-4cb7-baa7-1a3bc5404e5c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:50.641338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6fa06-20b0-4a0e-a496-9118b6f4f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:50.641992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6fa06-20b0-4a0e-a496-9118b6f4f525 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:50.642272 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6fa06-20b0-4a0e-a496-9118b6f4f525 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:50.642546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6fa06-20b0-4a0e-a496-9118b6f4f525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:50.643374 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6fa06-20b0-4a0e-a496-9118b6f4f525 None admin] RBAC: Adding query filter params (role.id=dc43ddd6d3b649a187dbfe63b0e20247, scope.project.id=6199907f9ce64320bb281523e68ea62a, user.id=a25e29702a4d4772b786ccbf752848c5) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:50.643686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6fa06-20b0-4a0e-a496-9118b6f4f525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:50.645133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6fa06-20b0-4a0e-a496-9118b6f4f525 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:50.653490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 153/294] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:50 2022] GET /identity/v3/role_assignments?user.id=a25e29702a4d4772b786ccbf752848c5&scope.project.id=6199907f9ce64320bb281523e68ea62a&role.id=dc43ddd6d3b649a187dbfe63b0e20247 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:50.788871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088a8ed-740b-4196-86c1-aff7c8f43b60 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:50.789183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088a8ed-740b-4196-86c1-aff7c8f43b60 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:50.789364 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088a8ed-740b-4196-86c1-aff7c8f43b60 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:50.792271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 142/295] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:50.798014 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa19379-3906-4fbc-a91a-e5f390ba3934 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:50.798596 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa19379-3906-4fbc-a91a-e5f390ba3934 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:50.798596 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa19379-3906-4fbc-a91a-e5f390ba3934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:50.822169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-baa19379-3906-4fbc-a91a-e5f390ba3934 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:50.823564 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-baa19379-3906-4fbc-a91a-e5f390ba3934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:50.899077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 154/296] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:50.928797 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088a8ed-740b-4196-86c1-aff7c8f43b60 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:51.047452 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088a8ed-740b-4196-86c1-aff7c8f43b60 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:51.084132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da5ddc-dbfb-4fe3-a092-87cb08eba538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:51.084951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da5ddc-dbfb-4fe3-a092-87cb08eba538 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:51.085284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da5ddc-dbfb-4fe3-a092-87cb08eba538 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:51.085562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da5ddc-dbfb-4fe3-a092-87cb08eba538 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:51.098662 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da5ddc-dbfb-4fe3-a092-87cb08eba538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-f3da5ddc-dbfb-4fe3-a092-87cb08eba538 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:51.107502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:51.108479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:51.109363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:51.109363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:51.109363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:51.109363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:51.109363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:51.109363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:51.109363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:51.109363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:51.109363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:51.109363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:51.109363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:51.109363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:51.109363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 143/297] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:51.114614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa19379-3906-4fbc-a91a-e5f390ba3934 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:51.228702 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa19379-3906-4fbc-a91a-e5f390ba3934 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:51.262205 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767040ff-0d06-4ead-ba16-9b2b98600e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:51.262874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767040ff-0d06-4ead-ba16-9b2b98600e60 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:51.263150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767040ff-0d06-4ead-ba16-9b2b98600e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:51.263424 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767040ff-0d06-4ead-ba16-9b2b98600e60 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:51.264221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767040ff-0d06-4ead-ba16-9b2b98600e60 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:51.264530 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767040ff-0d06-4ead-ba16-9b2b98600e60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:51.265938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767040ff-0d06-4ead-ba16-9b2b98600e60 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:51.274591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 155/298] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:51.280592 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da5ddc-dbfb-4fe3-a092-87cb08eba538 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:51.292385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a850-8d94-4fcd-9122-244ac451ac10 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:51.292676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a850-8d94-4fcd-9122-244ac451ac10 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:51.293022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a850-8d94-4fcd-9122-244ac451ac10 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:51.294367 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 156/299] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:13:51.299281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46167dd0-d137-4c25-a98f-932f52b3b2e7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:51.299513 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46167dd0-d137-4c25-a98f-932f52b3b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:51.299794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46167dd0-d137-4c25-a98f-932f52b3b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:51.317318 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-46167dd0-d137-4c25-a98f-932f52b3b2e7 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:51.318504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-46167dd0-d137-4c25-a98f-932f52b3b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:51.387928 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da5ddc-dbfb-4fe3-a092-87cb08eba538 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:51.405282 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 157/300] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:51.422676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46167dd0-d137-4c25-a98f-932f52b3b2e7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:51.426635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ff5ce-7ceb-4127-a682-9be562fc8ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:51.427781 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ff5ce-7ceb-4127-a682-9be562fc8ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:51.428312 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ff5ce-7ceb-4127-a682-9be562fc8ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:51.428771 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ff5ce-7ceb-4127-a682-9be562fc8ae9 None admin] PATH_INFO: `/v3/users/e9fba90eec0d41cba1f47fa0b9c963cd` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:51.443319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ff5ce-7ceb-4127-a682-9be562fc8ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=e9fba90eec0d41cba1f47fa0b9c963cd)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:51.445165 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ff5ce-7ceb-4127-a682-9be562fc8ae9 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:51.447055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 144/301] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:51 2022] GET /identity/v3/users/e9fba90eec0d41cba1f47fa0b9c963cd => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:51.452889 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ff5ce-7ceb-4127-a682-9be562fc8ae9 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:51.519996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46167dd0-d137-4c25-a98f-932f52b3b2e7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:51.551814 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ff5ce-7ceb-4127-a682-9be562fc8ae9 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:51.553657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3e51a-0987-457f-9ee7-80866e6d37a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:51.555148 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3e51a-0987-457f-9ee7-80866e6d37a8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:51.555148 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3e51a-0987-457f-9ee7-80866e6d37a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:51.555148 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3e51a-0987-457f-9ee7-80866e6d37a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:51.556107 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3e51a-0987-457f-9ee7-80866e6d37a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:51.557601 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3e51a-0987-457f-9ee7-80866e6d37a8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:51.564586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 158/302] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:51.565321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3e51a-0987-457f-9ee7-80866e6d37a8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:51.587996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742a8c4-b5b3-4f4f-9c17-ae49477794ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:51.588673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a8c4-b5b3-4f4f-9c17-ae49477794ee None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:51.588951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a8c4-b5b3-4f4f-9c17-ae49477794ee None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:51.589248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742a8c4-b5b3-4f4f-9c17-ae49477794ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:51.590612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742a8c4-b5b3-4f4f-9c17-ae49477794ee None admin] RBAC: Adding query filter params (role.id=4ec76066e1a543478164db1c9d114ce9, user.id=e9fba90eec0d41cba1f47fa0b9c963cd, scope.system=all) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:51.590923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742a8c4-b5b3-4f4f-9c17-ae49477794ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:51.592346 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742a8c4-b5b3-4f4f-9c17-ae49477794ee None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:51.604193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 145/303] 10.222.0.61 () {56 vars in 1308 bytes} [Tue May 10 20:13:51 2022] GET /identity/v3/role_assignments?user.id=e9fba90eec0d41cba1f47fa0b9c963cd&scope.system=all&role.id=4ec76066e1a543478164db1c9d114ce9 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:51.604193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff09ef-19a6-4249-9cd0-116b21c962ed None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:51.604193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff09ef-19a6-4249-9cd0-116b21c962ed None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:51.604193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff09ef-19a6-4249-9cd0-116b21c962ed None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:51.604193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 146/304] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:51.606327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e78bf5-adb9-4d3d-bbd6-571da378436d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:51.606611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e78bf5-adb9-4d3d-bbd6-571da378436d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:51.606881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e78bf5-adb9-4d3d-bbd6-571da378436d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:51.625538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-32e78bf5-adb9-4d3d-bbd6-571da378436d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:51.626945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-32e78bf5-adb9-4d3d-bbd6-571da378436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:51.696752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3e51a-0987-457f-9ee7-80866e6d37a8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:51.712016 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 147/305] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:51.735309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016fae-6405-4861-ad15-16e6cf3e3eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:51.735661 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e78bf5-adb9-4d3d-bbd6-571da378436d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:51.736571 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016fae-6405-4861-ad15-16e6cf3e3eb6 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:51.737108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016fae-6405-4861-ad15-16e6cf3e3eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:51.737584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016fae-6405-4861-ad15-16e6cf3e3eb6 None admin] PATH_INFO: `/v3/groups` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:51.738492 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016fae-6405-4861-ad15-16e6cf3e3eb6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:51.740174 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016fae-6405-4861-ad15-16e6cf3e3eb6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:51.758885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 159/306] 10.222.0.61 () {60 vars in 1134 bytes} [Tue May 10 20:13:51 2022] POST /identity/v3/groups => generated 229 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:13:51.831185 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44417ac2-0930-484f-bff8-7de4094594ae None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:51.831782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44417ac2-0930-484f-bff8-7de4094594ae None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:51.831782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44417ac2-0930-484f-bff8-7de4094594ae None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:51.833412 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 160/307] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:13:51.839147 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925bdaa-7088-47b0-9ecb-95944f9526c0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:51.840347 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925bdaa-7088-47b0-9ecb-95944f9526c0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:51.840829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925bdaa-7088-47b0-9ecb-95944f9526c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:51.856568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e78bf5-adb9-4d3d-bbd6-571da378436d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:51.859247 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7925bdaa-7088-47b0-9ecb-95944f9526c0 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:51.860560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7925bdaa-7088-47b0-9ecb-95944f9526c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:51.901368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4301e-8fee-4f6a-bb6d-7cd1319e5564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:51.902713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4301e-8fee-4f6a-bb6d-7cd1319e5564 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:51.903060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4301e-8fee-4f6a-bb6d-7cd1319e5564 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:51.903333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4301e-8fee-4f6a-bb6d-7cd1319e5564 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:51.918775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4301e-8fee-4f6a-bb6d-7cd1319e5564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-f6e4301e-8fee-4f6a-bb6d-7cd1319e5564 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:51.930092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:51.931480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:51.932276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:51.932276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:51.932276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:51.932276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:51.932276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:51.932276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:51.932276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:51.932276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:51.932276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:51.932276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:51.932276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:51.932276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:51.932276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 148/308] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:13:51.944998 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4301e-8fee-4f6a-bb6d-7cd1319e5564 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:51.945183 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 161/309] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:51.961367 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925bdaa-7088-47b0-9ecb-95944f9526c0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:52.062868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4301e-8fee-4f6a-bb6d-7cd1319e5564 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:52.087384 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925bdaa-7088-47b0-9ecb-95944f9526c0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:52.096855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844d001-ed8b-48c1-bf5b-a00c0e979327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:52.097560 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844d001-ed8b-48c1-bf5b-a00c0e979327 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:52.097842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844d001-ed8b-48c1-bf5b-a00c0e979327 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:52.098117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844d001-ed8b-48c1-bf5b-a00c0e979327 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:52.098871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844d001-ed8b-48c1-bf5b-a00c0e979327 None admin] RBAC: Adding query filter params (name=member) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:52.099176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844d001-ed8b-48c1-bf5b-a00c0e979327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:52.100544 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844d001-ed8b-48c1-bf5b-a00c0e979327 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:52.110438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 149/310] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:52.115535 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844d001-ed8b-48c1-bf5b-a00c0e979327 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:52.127205 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64df136-c4b8-4dfb-9287-119c78ee3127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:52.128202 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df136-c4b8-4dfb-9287-119c78ee3127 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:52.128547 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df136-c4b8-4dfb-9287-119c78ee3127 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:52.128887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64df136-c4b8-4dfb-9287-119c78ee3127 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:52.139847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64df136-c4b8-4dfb-9287-119c78ee3127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-c64df136-c4b8-4dfb-9287-119c78ee3127 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:52.147833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:52.148879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:52.149786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:52.149786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:52.149786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:52.149786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:52.149786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:52.149786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:52.149786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:52.149786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:52.149786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:52.149786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:52.149786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:52.149786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:52.149786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 162/311] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:13:52.155316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64df136-c4b8-4dfb-9287-119c78ee3127 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:52.219265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844d001-ed8b-48c1-bf5b-a00c0e979327 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:52.252636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090188d-badf-4ebf-8b19-98fdef117085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:52.253324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64df136-c4b8-4dfb-9287-119c78ee3127 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:52.253810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090188d-badf-4ebf-8b19-98fdef117085 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:52.254160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090188d-badf-4ebf-8b19-98fdef117085 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:52.254552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090188d-badf-4ebf-8b19-98fdef117085 None admin] PATH_INFO: `/v3/users/887c95bb230e4806ba31bb92fb6c6431` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:52.255830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090188d-badf-4ebf-8b19-98fdef117085 None admin] RBAC: Authorizing `identity:get_user(user_id=887c95bb230e4806ba31bb92fb6c6431)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:52.257434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090188d-badf-4ebf-8b19-98fdef117085 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:52.259174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 150/312] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:52 2022] GET /identity/v3/users/887c95bb230e4806ba31bb92fb6c6431 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:52.265190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090188d-badf-4ebf-8b19-98fdef117085 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:52.296725 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ab136-89ec-427d-84f1-383ee544ed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:52.297688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ab136-89ec-427d-84f1-383ee544ed61 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:52.297971 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ab136-89ec-427d-84f1-383ee544ed61 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:52.298402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ab136-89ec-427d-84f1-383ee544ed61 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:52.299474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ab136-89ec-427d-84f1-383ee544ed61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:52.299788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ab136-89ec-427d-84f1-383ee544ed61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:52.301652 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ab136-89ec-427d-84f1-383ee544ed61 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:52.312670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 163/313] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:52.319513 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ab136-89ec-427d-84f1-383ee544ed61 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:52.384398 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090188d-badf-4ebf-8b19-98fdef117085 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:52.424440 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae8ca4-9402-471a-ae79-137ff8d85e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:52.425926 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae8ca4-9402-471a-ae79-137ff8d85e59 None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:52.426573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae8ca4-9402-471a-ae79-137ff8d85e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:52.426944 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae8ca4-9402-471a-ae79-137ff8d85e59 None admin] PATH_INFO: `/v3/system/users/887c95bb230e4806ba31bb92fb6c6431/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:52.429315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae8ca4-9402-471a-ae79-137ff8d85e59 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=887c95bb230e4806ba31bb92fb6c6431, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:52.430910 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae8ca4-9402-471a-ae79-137ff8d85e59 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:52.431028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ab136-89ec-427d-84f1-383ee544ed61 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:52.444471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 151/314] 10.222.0.61 () {58 vars in 1334 bytes} [Tue May 10 20:13:52 2022] PUT /identity/v3/system/users/887c95bb230e4806ba31bb92fb6c6431/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:13:52.468118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437160c-17b4-44fe-9cdf-09c25858f653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:52.469042 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437160c-17b4-44fe-9cdf-09c25858f653 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:52.469331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437160c-17b4-44fe-9cdf-09c25858f653 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:52.469607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437160c-17b4-44fe-9cdf-09c25858f653 None admin] PATH_INFO: `/v3/users/55ea507cfbe44bfe9f2fc345ef1af19a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:52.470901 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437160c-17b4-44fe-9cdf-09c25858f653 None admin] RBAC: Authorizing `identity:get_user(user_id=55ea507cfbe44bfe9f2fc345ef1af19a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:52.472412 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437160c-17b4-44fe-9cdf-09c25858f653 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:52.474170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 164/315] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:52 2022] GET /identity/v3/users/55ea507cfbe44bfe9f2fc345ef1af19a => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:52.479931 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae8ca4-9402-471a-ae79-137ff8d85e59 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:52.597094 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae8ca4-9402-471a-ae79-137ff8d85e59 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:52.632706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba5b9-c1ba-45d1-af36-4db114937262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:52.633715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba5b9-c1ba-45d1-af36-4db114937262 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:52.634179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba5b9-c1ba-45d1-af36-4db114937262 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:52.634691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba5b9-c1ba-45d1-af36-4db114937262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:52.706126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aba5b9-c1ba-45d1-af36-4db114937262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:52.707899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aba5b9-c1ba-45d1-af36-4db114937262 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:52.812886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 152/316] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:52.818418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437160c-17b4-44fe-9cdf-09c25858f653 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:52.914901 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437160c-17b4-44fe-9cdf-09c25858f653 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:52.952264 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ee3f6-438d-4812-b7ec-40bd91506a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:52.953585 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ee3f6-438d-4812-b7ec-40bd91506a9c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:52.954079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ee3f6-438d-4812-b7ec-40bd91506a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:52.954558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ee3f6-438d-4812-b7ec-40bd91506a9c None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:52.956097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ee3f6-438d-4812-b7ec-40bd91506a9c None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:52.957907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ee3f6-438d-4812-b7ec-40bd91506a9c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:52.960456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 165/317] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:52 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:52.966090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba5b9-c1ba-45d1-af36-4db114937262 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:53.071675 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba5b9-c1ba-45d1-af36-4db114937262 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:53.107300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f847d18-d167-4abd-9221-4e02217308a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:53.108638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f847d18-d167-4abd-9221-4e02217308a2 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:53.109154 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f847d18-d167-4abd-9221-4e02217308a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:53.109619 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f847d18-d167-4abd-9221-4e02217308a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:53.110645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f847d18-d167-4abd-9221-4e02217308a2 None admin] RBAC: Adding query filter params (role.id=4ec76066e1a543478164db1c9d114ce9, scope.project.id=6199907f9ce64320bb281523e68ea62a, user.id=55ea507cfbe44bfe9f2fc345ef1af19a) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:53.111162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f847d18-d167-4abd-9221-4e02217308a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:53.112811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f847d18-d167-4abd-9221-4e02217308a2 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:53.119550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 153/318] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:13:52 2022] GET /identity/v3/role_assignments?user.id=55ea507cfbe44bfe9f2fc345ef1af19a&scope.project.id=6199907f9ce64320bb281523e68ea62a&role.id=4ec76066e1a543478164db1c9d114ce9 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:53.909390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d16e65-d784-4671-8d4f-b25763d87613 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:53.909760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d16e65-d784-4671-8d4f-b25763d87613 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:53.909941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d16e65-d784-4671-8d4f-b25763d87613 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:53.911301 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 166/319] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:53.916587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7235f-b8b3-4cc5-967a-f4a327e149ae None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:53.916884 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7235f-b8b3-4cc5-967a-f4a327e149ae None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:53.917198 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7235f-b8b3-4cc5-967a-f4a327e149ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:53.933848 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-64d7235f-b8b3-4cc5-967a-f4a327e149ae None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:53.935018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-64d7235f-b8b3-4cc5-967a-f4a327e149ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:54.001315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 154/320] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:54.023189 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d16e65-d784-4671-8d4f-b25763d87613 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:54.064385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49195b4-cc7f-4c3f-8f04-91c47cbebc6e None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:54.064667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49195b4-cc7f-4c3f-8f04-91c47cbebc6e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:54.065139 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49195b4-cc7f-4c3f-8f04-91c47cbebc6e None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:54.066497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 155/321] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:13:54.071397 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bfc0f-1502-4e24-b411-3915ea3ca636 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:54.071683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bfc0f-1502-4e24-b411-3915ea3ca636 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:54.071958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bfc0f-1502-4e24-b411-3915ea3ca636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:54.087650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-117bfc0f-1502-4e24-b411-3915ea3ca636 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:54.088803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-117bfc0f-1502-4e24-b411-3915ea3ca636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:54.126957 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d16e65-d784-4671-8d4f-b25763d87613 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:54.157813 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 156/322] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:13:54.167436 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fff03-7cb8-46c4-bcc3-992ad191738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:54.168750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fff03-7cb8-46c4-bcc3-992ad191738b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:54.169058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fff03-7cb8-46c4-bcc3-992ad191738b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:54.169334 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fff03-7cb8-46c4-bcc3-992ad191738b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:54.179224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fff03-7cb8-46c4-bcc3-992ad191738b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:54.180003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bfc0f-1502-4e24-b411-3915ea3ca636 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-e23fff03-7cb8-46c4-bcc3-992ad191738b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:54.186857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:54.187718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:54.188510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:54.188510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:54.188510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:54.188510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:54.188510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:54.188510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:54.188510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:54.188510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:54.188510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:54.188510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:54.188510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:54.188510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:54.188510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 167/323] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:54.193444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fff03-7cb8-46c4-bcc3-992ad191738b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:54.290496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bfc0f-1502-4e24-b411-3915ea3ca636 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:54.290722 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fff03-7cb8-46c4-bcc3-992ad191738b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:54.322386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6dae3-2a02-46d7-8471-16b4a0fce5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:54.323046 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6dae3-2a02-46d7-8471-16b4a0fce5d2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:54.323325 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6dae3-2a02-46d7-8471-16b4a0fce5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:54.323648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6dae3-2a02-46d7-8471-16b4a0fce5d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:54.324915 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6dae3-2a02-46d7-8471-16b4a0fce5d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:54.325275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baa8b8-8481-4e02-8e21-83c3aecc16ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:54.325380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6dae3-2a02-46d7-8471-16b4a0fce5d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:54.326088 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baa8b8-8481-4e02-8e21-83c3aecc16ef None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:54.326367 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baa8b8-8481-4e02-8e21-83c3aecc16ef None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:54.326634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baa8b8-8481-4e02-8e21-83c3aecc16ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:54.326724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6dae3-2a02-46d7-8471-16b4a0fce5d2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:54.327777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03baa8b8-8481-4e02-8e21-83c3aecc16ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:54.329241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03baa8b8-8481-4e02-8e21-83c3aecc16ef None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:54.331027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 157/324] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:13:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:54.334908 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 168/325] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:54.336303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baa8b8-8481-4e02-8e21-83c3aecc16ef None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:54.341468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6dae3-2a02-46d7-8471-16b4a0fce5d2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:54.435014 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baa8b8-8481-4e02-8e21-83c3aecc16ef None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:54.451706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6dae3-2a02-46d7-8471-16b4a0fce5d2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:54.468658 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8628ef-3d91-4239-b4f2-5aa26ae2dd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:54.469366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8628ef-3d91-4239-b4f2-5aa26ae2dd52 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:54.469646 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8628ef-3d91-4239-b4f2-5aa26ae2dd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:54.469918 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8628ef-3d91-4239-b4f2-5aa26ae2dd52 None admin] PATH_INFO: `/v3/groups` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:54.470600 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8628ef-3d91-4239-b4f2-5aa26ae2dd52 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:54.472009 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8628ef-3d91-4239-b4f2-5aa26ae2dd52 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:54.486762 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 158/326] 10.222.0.61 () {60 vars in 1134 bytes} [Tue May 10 20:13:54 2022] POST /identity/v3/groups => generated 226 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:13:54.487538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c41f7-e229-43ad-9174-0960552bcc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:54.488411 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c41f7-e229-43ad-9174-0960552bcc0e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:54.488947 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c41f7-e229-43ad-9174-0960552bcc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:54.489088 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c41f7-e229-43ad-9174-0960552bcc0e None admin] PATH_INFO: `/v3/users/e9fba90eec0d41cba1f47fa0b9c963cd` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:54.490334 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c41f7-e229-43ad-9174-0960552bcc0e None admin] RBAC: Authorizing `identity:get_user(user_id=e9fba90eec0d41cba1f47fa0b9c963cd)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:54.491821 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c41f7-e229-43ad-9174-0960552bcc0e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:54.498343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 169/327] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:54 2022] GET /identity/v3/users/e9fba90eec0d41cba1f47fa0b9c963cd => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:13:54.499453 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8628ef-3d91-4239-b4f2-5aa26ae2dd52 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:54.602904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8628ef-3d91-4239-b4f2-5aa26ae2dd52 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:54.640782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b4d71-1617-4807-aa45-0ad8dbc72676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:54.641689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4d71-1617-4807-aa45-0ad8dbc72676 None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:54.641972 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4d71-1617-4807-aa45-0ad8dbc72676 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:54.642243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b4d71-1617-4807-aa45-0ad8dbc72676 None admin] PATH_INFO: `/v3/system/users/e9fba90eec0d41cba1f47fa0b9c963cd/roles/4ec76066e1a543478164db1c9d114ce9` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:54.643796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b4d71-1617-4807-aa45-0ad8dbc72676 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e9fba90eec0d41cba1f47fa0b9c963cd, role_id=4ec76066e1a543478164db1c9d114ce9)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:54.645223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b4d71-1617-4807-aa45-0ad8dbc72676 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:54.653884 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 159/328] 10.222.0.61 () {58 vars in 1334 bytes} [Tue May 10 20:13:54 2022] PUT /identity/v3/system/users/e9fba90eec0d41cba1f47fa0b9c963cd/roles/4ec76066e1a543478164db1c9d114ce9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:13:54.801811 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ee63f-7206-41fd-9199-5c3712890daf None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:54.801995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ee63f-7206-41fd-9199-5c3712890daf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:54.802272 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ee63f-7206-41fd-9199-5c3712890daf None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:54.803824 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 170/329] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:54.810375 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971b49c-9f27-4129-af70-6de12c0eaba6 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:54.810681 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971b49c-9f27-4129-af70-6de12c0eaba6 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:54.810923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971b49c-9f27-4129-af70-6de12c0eaba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:54.829094 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-9971b49c-9f27-4129-af70-6de12c0eaba6 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:54.830267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9971b49c-9f27-4129-af70-6de12c0eaba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:54.904623 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 160/330] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:54.928178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ee63f-7206-41fd-9199-5c3712890daf None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:55.039243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ee63f-7206-41fd-9199-5c3712890daf None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:55.074818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2acb7-e894-48e2-a088-ec595a710456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:55.075949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2acb7-e894-48e2-a088-ec595a710456 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:55.076442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2acb7-e894-48e2-a088-ec595a710456 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:55.076917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2acb7-e894-48e2-a088-ec595a710456 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:55.088020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2acb7-e894-48e2-a088-ec595a710456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-15d2acb7-e894-48e2-a088-ec595a710456 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:55.096387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:55.097399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:55.098177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:55.098177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:55.098177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:55.098177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:55.098177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:55.098177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:55.098177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:55.098177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:55.098177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:55.098177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:55.098177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:55.098177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:55.100533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 171/331] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:55.107027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971b49c-9f27-4129-af70-6de12c0eaba6 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:55.219840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971b49c-9f27-4129-af70-6de12c0eaba6 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:55.262075 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95496c-bbae-4cee-91d3-4c7458af4a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:55.262752 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95496c-bbae-4cee-91d3-4c7458af4a47 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:55.263031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95496c-bbae-4cee-91d3-4c7458af4a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:55.263302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95496c-bbae-4cee-91d3-4c7458af4a47 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:55.264060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95496c-bbae-4cee-91d3-4c7458af4a47 None admin] RBAC: Adding query filter params (name=member) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:55.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95496c-bbae-4cee-91d3-4c7458af4a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:55.265784 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95496c-bbae-4cee-91d3-4c7458af4a47 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:55.278225 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 161/332] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:55.283748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2acb7-e894-48e2-a088-ec595a710456 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:55.416711 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2acb7-e894-48e2-a088-ec595a710456 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:55.457698 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212bd6c3-78b7-4536-be4b-07e7dd90710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:55.458969 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bd6c3-78b7-4536-be4b-07e7dd90710d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:55.459535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bd6c3-78b7-4536-be4b-07e7dd90710d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:55.460027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212bd6c3-78b7-4536-be4b-07e7dd90710d None admin] PATH_INFO: `/v3/users/887c95bb230e4806ba31bb92fb6c6431` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:55.461558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bd6c3-78b7-4536-be4b-07e7dd90710d None admin] RBAC: Authorizing `identity:get_user(user_id=887c95bb230e4806ba31bb92fb6c6431)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:55.463192 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212bd6c3-78b7-4536-be4b-07e7dd90710d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:55.465557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 172/333] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:55 2022] GET /identity/v3/users/887c95bb230e4806ba31bb92fb6c6431 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:55.471943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95496c-bbae-4cee-91d3-4c7458af4a47 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:55.625406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95496c-bbae-4cee-91d3-4c7458af4a47 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:55.675201 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36d4c5-6c4e-40aa-babb-a1635e1c982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:55.675790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36d4c5-6c4e-40aa-babb-a1635e1c982e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:55.676071 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36d4c5-6c4e-40aa-babb-a1635e1c982e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:55.676346 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36d4c5-6c4e-40aa-babb-a1635e1c982e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:55.677212 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36d4c5-6c4e-40aa-babb-a1635e1c982e None admin] RBAC: Adding query filter params (role.id=dc43ddd6d3b649a187dbfe63b0e20247, user.id=887c95bb230e4806ba31bb92fb6c6431, scope.system=all) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:55.677528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36d4c5-6c4e-40aa-babb-a1635e1c982e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:55.678969 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36d4c5-6c4e-40aa-babb-a1635e1c982e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:55.695769 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 162/334] 10.222.0.61 () {56 vars in 1308 bytes} [Tue May 10 20:13:55 2022] GET /identity/v3/role_assignments?user.id=887c95bb230e4806ba31bb92fb6c6431&scope.system=all&role.id=dc43ddd6d3b649a187dbfe63b0e20247 => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:57.445827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3af6c-ac98-4c20-b6c5-d2d316b7330d None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:57.446859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3af6c-ac98-4c20-b6c5-d2d316b7330d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:57.447368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3af6c-ac98-4c20-b6c5-d2d316b7330d None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:57.449774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 173/335] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:57.454695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab28c-4f1e-4b0f-bde5-e03931217e9c None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:57.455532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab28c-4f1e-4b0f-bde5-e03931217e9c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:57.456013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab28c-4f1e-4b0f-bde5-e03931217e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:57.478885 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-754ab28c-4f1e-4b0f-bde5-e03931217e9c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:57.483932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-754ab28c-4f1e-4b0f-bde5-e03931217e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:57.532952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184483e6-d000-4dd3-9448-7759fa9073c2 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:57.533631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184483e6-d000-4dd3-9448-7759fa9073c2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:57.534105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184483e6-d000-4dd3-9448-7759fa9073c2 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:57.535658 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 174/336] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:13:57.546579 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90016dab-25e5-46e6-9fb7-aab7a4f0674f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:57.547249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90016dab-25e5-46e6-9fb7-aab7a4f0674f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:57.547746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90016dab-25e5-46e6-9fb7-aab7a4f0674f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:57.575547 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-90016dab-25e5-46e6-9fb7-aab7a4f0674f None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:57.577143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-90016dab-25e5-46e6-9fb7-aab7a4f0674f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:57.590916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 163/337] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:57.590916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaabf6-ff7d-4c41-9e9e-7b641ba0b587 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:57.590916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaabf6-ff7d-4c41-9e9e-7b641ba0b587 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:57.590916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaabf6-ff7d-4c41-9e9e-7b641ba0b587 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:57.591273 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 164/338] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:57.596590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd2b26-a134-4473-8a79-982bdfa31cc6 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:57.596877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd2b26-a134-4473-8a79-982bdfa31cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:57.597184 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd2b26-a134-4473-8a79-982bdfa31cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:57.624360 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-8bcd2b26-a134-4473-8a79-982bdfa31cc6 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:57.625557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-8bcd2b26-a134-4473-8a79-982bdfa31cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:57.710142 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 175/339] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:57.711035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90016dab-25e5-46e6-9fb7-aab7a4f0674f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:57.767994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 165/340] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:57.768892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd2b26-a134-4473-8a79-982bdfa31cc6 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:57.839332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90016dab-25e5-46e6-9fb7-aab7a4f0674f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:57.883069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce674b3-dd1e-48ba-8a84-cffa19fb3733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:57.883880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce674b3-dd1e-48ba-8a84-cffa19fb3733 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:57.884159 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce674b3-dd1e-48ba-8a84-cffa19fb3733 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:57.884461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce674b3-dd1e-48ba-8a84-cffa19fb3733 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:57.908512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce674b3-dd1e-48ba-8a84-cffa19fb3733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-fce674b3-dd1e-48ba-8a84-cffa19fb3733 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:57.925657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:57.926592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:57.927372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:57.927372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:57.927372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:57.927372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:57.927372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:57.927372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:57.927372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:57.927372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:57.927372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:57.927372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:57.927372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:13:57.927372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:57.927372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 176/341] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:57.932545 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce674b3-dd1e-48ba-8a84-cffa19fb3733 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:57.968602 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd2b26-a134-4473-8a79-982bdfa31cc6 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:58.013658 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd397b97-913d-4dfd-a218-4b407821b763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:58.014730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd397b97-913d-4dfd-a218-4b407821b763 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:58.015160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd397b97-913d-4dfd-a218-4b407821b763 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:58.015621 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd397b97-913d-4dfd-a218-4b407821b763 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:58.038265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd397b97-913d-4dfd-a218-4b407821b763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-dd397b97-913d-4dfd-a218-4b407821b763 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:58.046748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:58.047860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:58.048857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:58.048857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:58.048857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:58.048857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:58.048857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:58.048857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:58.048857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:58.048857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:58.048857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:58.048857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:58.048857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:58.048857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:58.055096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 166/342] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:58.056157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd397b97-913d-4dfd-a218-4b407821b763 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:58.084816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce674b3-dd1e-48ba-8a84-cffa19fb3733 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:58.128378 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693472b-13c7-4b25-a302-d90dd3de6883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:58.132995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693472b-13c7-4b25-a302-d90dd3de6883 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:58.132995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693472b-13c7-4b25-a302-d90dd3de6883 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:58.132995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693472b-13c7-4b25-a302-d90dd3de6883 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:58.140599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693472b-13c7-4b25-a302-d90dd3de6883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d693472b-13c7-4b25-a302-d90dd3de6883 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:58.153001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:58.154210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:58.155605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:58.155605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:58.155605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:58.155605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:58.155605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:58.155605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:58.155605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:58.155605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:58.155605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:58.155605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:58.155605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:58.155605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:13:58.155605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 177/343] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:13:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:58.157523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693472b-13c7-4b25-a302-d90dd3de6883 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:58.240618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd397b97-913d-4dfd-a218-4b407821b763 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:58.270903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693472b-13c7-4b25-a302-d90dd3de6883 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:58.281271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec522db-7e2c-4d58-929c-a095ee4b48d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:58.282004 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec522db-7e2c-4d58-929c-a095ee4b48d5 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:58.282233 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec522db-7e2c-4d58-929c-a095ee4b48d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:58.282504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec522db-7e2c-4d58-929c-a095ee4b48d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:58.283265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec522db-7e2c-4d58-929c-a095ee4b48d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:58.283572 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec522db-7e2c-4d58-929c-a095ee4b48d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:58.285371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec522db-7e2c-4d58-929c-a095ee4b48d5 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:58.295490 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 167/344] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:58.298736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec522db-7e2c-4d58-929c-a095ee4b48d5 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:58.317692 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cdbcd-ba41-484c-9792-ad898f33db26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:58.318382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cdbcd-ba41-484c-9792-ad898f33db26 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:58.318666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cdbcd-ba41-484c-9792-ad898f33db26 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:58.318942 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cdbcd-ba41-484c-9792-ad898f33db26 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:58.319703 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cdbcd-ba41-484c-9792-ad898f33db26 None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:58.320008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cdbcd-ba41-484c-9792-ad898f33db26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:58.321443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2cdbcd-ba41-484c-9792-ad898f33db26 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:58.330033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 178/345] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:58.330835 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cdbcd-ba41-484c-9792-ad898f33db26 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:58.400739 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec522db-7e2c-4d58-929c-a095ee4b48d5 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:58.440901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a4223-074b-44d7-be91-792c42c38fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:58.441694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a4223-074b-44d7-be91-792c42c38fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:58.441979 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a4223-074b-44d7-be91-792c42c38fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:58.442254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a4223-074b-44d7-be91-792c42c38fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:58.443020 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a4223-074b-44d7-be91-792c42c38fd0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:58.443326 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a4223-074b-44d7-be91-792c42c38fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:58.445182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a4223-074b-44d7-be91-792c42c38fd0 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:58.454720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 168/346] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:13:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:58.455482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a4223-074b-44d7-be91-792c42c38fd0 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:58.507829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cdbcd-ba41-484c-9792-ad898f33db26 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:58.572124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a4223-074b-44d7-be91-792c42c38fd0 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:58.584419 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51b64a-c972-488d-9746-09a04ebc4cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:58.585331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51b64a-c972-488d-9746-09a04ebc4cea None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:58.585612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51b64a-c972-488d-9746-09a04ebc4cea None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:58.585887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51b64a-c972-488d-9746-09a04ebc4cea None admin] PATH_INFO: `/v3/users/e9fba90eec0d41cba1f47fa0b9c963cd` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:58.590334 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51b64a-c972-488d-9746-09a04ebc4cea None admin] RBAC: Authorizing `identity:get_user(user_id=e9fba90eec0d41cba1f47fa0b9c963cd)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:58.591909 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51b64a-c972-488d-9746-09a04ebc4cea None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:58.593916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 179/347] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:13:58 2022] GET /identity/v3/users/e9fba90eec0d41cba1f47fa0b9c963cd => generated 293 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:58.594699 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51b64a-c972-488d-9746-09a04ebc4cea None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:58.613783 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b308568-7065-4076-b511-84bdee19ac53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:58.614449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b308568-7065-4076-b511-84bdee19ac53 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:58.614739 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b308568-7065-4076-b511-84bdee19ac53 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:58.615016 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b308568-7065-4076-b511-84bdee19ac53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:58.703082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b308568-7065-4076-b511-84bdee19ac53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:58.704556 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b308568-7065-4076-b511-84bdee19ac53 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:58.800706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51b64a-c972-488d-9746-09a04ebc4cea None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:58.826009 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 169/348] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:58.826873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b308568-7065-4076-b511-84bdee19ac53 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:58.843849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7f319-850d-416b-b407-d64952eae844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:58.844511 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f319-850d-416b-b407-d64952eae844 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:58.844797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f319-850d-416b-b407-d64952eae844 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:58.845109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f319-850d-416b-b407-d64952eae844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:58.918403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7f319-850d-416b-b407-d64952eae844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:58.919923 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7f319-850d-416b-b407-d64952eae844 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:58.954143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b308568-7065-4076-b511-84bdee19ac53 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:58.998936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28f42f-0975-46fe-a426-3654707c7ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:58.999617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28f42f-0975-46fe-a426-3654707c7ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:58.999899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28f42f-0975-46fe-a426-3654707c7ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.000174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28f42f-0975-46fe-a426-3654707c7ee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.001053 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28f42f-0975-46fe-a426-3654707c7ee8 None admin] RBAC: Adding query filter params (role.id=4ec76066e1a543478164db1c9d114ce9, user.id=e9fba90eec0d41cba1f47fa0b9c963cd, scope.system=all) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:59.001370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28f42f-0975-46fe-a426-3654707c7ee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:59.003705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28f42f-0975-46fe-a426-3654707c7ee8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:59.020937 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 170/349] 10.222.0.61 () {56 vars in 1308 bytes} [Tue May 10 20:13:58 2022] GET /identity/v3/role_assignments?user.id=e9fba90eec0d41cba1f47fa0b9c963cd&scope.system=all&role.id=4ec76066e1a543478164db1c9d114ce9 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:59.023409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c6cc8-ec17-47f3-88e1-f0e618cd0cab None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:59.023705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c6cc8-ec17-47f3-88e1-f0e618cd0cab None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.024003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c6cc8-ec17-47f3-88e1-f0e618cd0cab None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.030638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 171/350] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:59.030638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c6cc8-ec17-47f3-88e1-f0e618cd0cab None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:59.064727 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 180/351] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:13:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:13:59.066295 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567833e2-da19-4f80-a433-f37fb786ea16 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:59.066738 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567833e2-da19-4f80-a433-f37fb786ea16 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.067152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567833e2-da19-4f80-a433-f37fb786ea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.098477 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-567833e2-da19-4f80-a433-f37fb786ea16 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:59.100046 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-567833e2-da19-4f80-a433-f37fb786ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:59.151886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c6cc8-ec17-47f3-88e1-f0e618cd0cab None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:59.203616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fdb9f-fc47-442b-9238-9775a4bc8b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:59.204808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fdb9f-fc47-442b-9238-9775a4bc8b2d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:59.205385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fdb9f-fc47-442b-9238-9775a4bc8b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.205897 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1fdb9f-fc47-442b-9238-9775a4bc8b2d None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.207444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fdb9f-fc47-442b-9238-9775a4bc8b2d None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:59.209272 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1fdb9f-fc47-442b-9238-9775a4bc8b2d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:59.211315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 172/352] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:59 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:59.212369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fdb9f-fc47-442b-9238-9775a4bc8b2d None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:59.217725 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 181/353] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:59.219438 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266297-57ee-4236-aa91-febca33d0aab None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:59.219926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266297-57ee-4236-aa91-febca33d0aab None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.220393 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266297-57ee-4236-aa91-febca33d0aab None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.222045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 182/354] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:59.223097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53266297-57ee-4236-aa91-febca33d0aab None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:59.344751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53266297-57ee-4236-aa91-febca33d0aab None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:59.357164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1fdb9f-fc47-442b-9238-9775a4bc8b2d None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:59.384564 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8248f8-7a2d-4447-9ed2-c801cb4ecd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:59.385670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8248f8-7a2d-4447-9ed2-c801cb4ecd20 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:59.386125 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8248f8-7a2d-4447-9ed2-c801cb4ecd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.386465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8248f8-7a2d-4447-9ed2-c801cb4ecd20 None admin] PATH_INFO: `/v3/groups/7979a3a79c7d48b0ba9df970a0595d87` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.393631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8248f8-7a2d-4447-9ed2-c801cb4ecd20 None admin] RBAC: Authorizing `identity:get_group(group_id=7979a3a79c7d48b0ba9df970a0595d87)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:59.394683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceae8ab-a857-4d8a-88b7-ac907a1b9f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:59.395104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8248f8-7a2d-4447-9ed2-c801cb4ecd20 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:59.395541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceae8ab-a857-4d8a-88b7-ac907a1b9f88 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:59.395825 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceae8ab-a857-4d8a-88b7-ac907a1b9f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.396098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceae8ab-a857-4d8a-88b7-ac907a1b9f88 None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.396994 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 183/355] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:13:59 2022] GET /identity/v3/groups/7979a3a79c7d48b0ba9df970a0595d87 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:59.397597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceae8ab-a857-4d8a-88b7-ac907a1b9f88 None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:59.398387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd732-1e48-4a6a-a5ff-84a7f7dfe0e3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:59.398692 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd732-1e48-4a6a-a5ff-84a7f7dfe0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.399023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceae8ab-a857-4d8a-88b7-ac907a1b9f88 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:59.399124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd732-1e48-4a6a-a5ff-84a7f7dfe0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.400709 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 173/356] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:13:59 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:59.401524 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceae8ab-a857-4d8a-88b7-ac907a1b9f88 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:59.423398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-42ecd732-1e48-4a6a-a5ff-84a7f7dfe0e3 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:59.424566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-42ecd732-1e48-4a6a-a5ff-84a7f7dfe0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:59.499435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 184/357] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:59.500678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db7d8-a08b-4130-bf1c-e9c9d9341247 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:59.500986 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db7d8-a08b-4130-bf1c-e9c9d9341247 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.501866 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0db7d8-a08b-4130-bf1c-e9c9d9341247 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.502661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 185/358] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:13:59.503348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db7d8-a08b-4130-bf1c-e9c9d9341247 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:59.511725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceae8ab-a857-4d8a-88b7-ac907a1b9f88 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:59.550907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd2aa3-52e8-4652-9000-c5085039b2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:59.551708 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd2aa3-52e8-4652-9000-c5085039b2cf None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:59.552022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd2aa3-52e8-4652-9000-c5085039b2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.552257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd2aa3-52e8-4652-9000-c5085039b2cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.566479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd2aa3-52e8-4652-9000-c5085039b2cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-26cd2aa3-52e8-4652-9000-c5085039b2cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:59.573935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:59.575117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:59.576179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:59.576179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:59.576179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:59.576179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:59.576179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:59.576179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:59.576179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:59.576179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:59.576179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:59.576179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:59.576179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:13:59.576179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:59.576179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 174/359] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:13:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:59.576179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd2aa3-52e8-4652-9000-c5085039b2cf None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:59.637132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0db7d8-a08b-4130-bf1c-e9c9d9341247 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:59.680853 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93e7b1-19bb-47d1-ab53-294b55d6abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:59.682103 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93e7b1-19bb-47d1-ab53-294b55d6abd7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:59.682103 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93e7b1-19bb-47d1-ab53-294b55d6abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.682281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd2aa3-52e8-4652-9000-c5085039b2cf None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:59.682373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93e7b1-19bb-47d1-ab53-294b55d6abd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.682915 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93e7b1-19bb-47d1-ab53-294b55d6abd7 None admin] RBAC: Adding query filter params (group.id=7979a3a79c7d48b0ba9df970a0595d87, role.id=dc43ddd6d3b649a187dbfe63b0e20247, scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:59.683352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93e7b1-19bb-47d1-ab53-294b55d6abd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:59.686170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93e7b1-19bb-47d1-ab53-294b55d6abd7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:59.691768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 186/360] 10.222.0.61 () {56 vars in 1376 bytes} [Tue May 10 20:13:59 2022] GET /identity/v3/role_assignments?group.id=7979a3a79c7d48b0ba9df970a0595d87&scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3&role.id=dc43ddd6d3b649a187dbfe63b0e20247 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:59.693001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc4cfb-7802-4457-a6f2-bee966ea6ee1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:59.693317 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc4cfb-7802-4457-a6f2-bee966ea6ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.693592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc4cfb-7802-4457-a6f2-bee966ea6ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.711243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-29fc4cfb-7802-4457-a6f2-bee966ea6ee1 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:13:59.712605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-29fc4cfb-7802-4457-a6f2-bee966ea6ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:13:59.725749 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfddf9-7a85-437b-8716-36d08b7d39cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:59.726729 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfddf9-7a85-437b-8716-36d08b7d39cd None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:59.727013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfddf9-7a85-437b-8716-36d08b7d39cd None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.727293 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfddf9-7a85-437b-8716-36d08b7d39cd None admin] PATH_INFO: `/v3/groups/7979a3a79c7d48b0ba9df970a0595d87` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.728566 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfddf9-7a85-437b-8716-36d08b7d39cd None admin] RBAC: Authorizing `identity:get_group(group_id=7979a3a79c7d48b0ba9df970a0595d87)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:59.730608 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfddf9-7a85-437b-8716-36d08b7d39cd None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:59.732794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 175/361] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:13:59 2022] GET /identity/v3/groups/7979a3a79c7d48b0ba9df970a0595d87 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:59.733260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfddf9-7a85-437b-8716-36d08b7d39cd None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:59.806994 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 187/362] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:13:59.808286 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc4cfb-7802-4457-a6f2-bee966ea6ee1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:59.860873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfddf9-7a85-437b-8716-36d08b7d39cd None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:59.905785 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aceb3c3-d5b8-48ef-819a-4a8fceee3b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:59.907199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceb3c3-d5b8-48ef-819a-4a8fceee3b65 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:59.907697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceb3c3-d5b8-48ef-819a-4a8fceee3b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.908180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aceb3c3-d5b8-48ef-819a-4a8fceee3b65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.923038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aceb3c3-d5b8-48ef-819a-4a8fceee3b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:13:59.926908 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc4cfb-7802-4457-a6f2-bee966ea6ee1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-8aceb3c3-d5b8-48ef-819a-4a8fceee3b65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:13:59.932026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:13:59.932938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:13:59.933870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:13:59.933870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:13:59.933870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:13:59.933870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:13:59.933870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:13:59.933870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:13:59.933870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:13:59.933870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:13:59.933870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:13:59.933870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:13:59.933870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:13:59.933870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:13:59.936287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 176/363] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:13:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:13:59.937498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aceb3c3-d5b8-48ef-819a-4a8fceee3b65 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:13:59.969891 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944a574-3944-459c-a2a5-0b407815e02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:13:59.970570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944a574-3944-459c-a2a5-0b407815e02a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:13:59.970849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944a574-3944-459c-a2a5-0b407815e02a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:13:59.971119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944a574-3944-459c-a2a5-0b407815e02a None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:13:59.971871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944a574-3944-459c-a2a5-0b407815e02a None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:13:59.972169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944a574-3944-459c-a2a5-0b407815e02a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:13:59.973597 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944a574-3944-459c-a2a5-0b407815e02a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:13:59.989946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 188/364] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:13:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:13:59.993800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944a574-3944-459c-a2a5-0b407815e02a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:00.070908 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aceb3c3-d5b8-48ef-819a-4a8fceee3b65 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:00.112921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944a574-3944-459c-a2a5-0b407815e02a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:00.113204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc1fb4-30d1-4530-80fc-8d6485d658c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:00.113854 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc1fb4-30d1-4530-80fc-8d6485d658c5 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:00.114133 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc1fb4-30d1-4530-80fc-8d6485d658c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:00.114445 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc1fb4-30d1-4530-80fc-8d6485d658c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:00.115224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc1fb4-30d1-4530-80fc-8d6485d658c5 None admin] RBAC: Adding query filter params (group.id=7979a3a79c7d48b0ba9df970a0595d87, role.id=472b056b3a5047109259d7fad9133274, scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:00.115533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc1fb4-30d1-4530-80fc-8d6485d658c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:00.116989 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc1fb4-30d1-4530-80fc-8d6485d658c5 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:00.122640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 177/365] 10.222.0.61 () {56 vars in 1376 bytes} [Tue May 10 20:13:59 2022] GET /identity/v3/role_assignments?group.id=7979a3a79c7d48b0ba9df970a0595d87&scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3&role.id=472b056b3a5047109259d7fad9133274 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:00.123440 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc1fb4-30d1-4530-80fc-8d6485d658c5 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:00.162613 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ad153-759f-455f-8f76-11843759941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:00.163338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ad153-759f-455f-8f76-11843759941d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:00.163618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ad153-759f-455f-8f76-11843759941d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:00.163918 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ad153-759f-455f-8f76-11843759941d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:00.177058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ad153-759f-455f-8f76-11843759941d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-060ad153-759f-455f-8f76-11843759941d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:00.185380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:00.186365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:00.187158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:00.187158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:00.187158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:00.187158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:00.187158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:00.187158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:00.187158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:00.187158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:00.187158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:00.187158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:00.187158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:00.187158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:00.187158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 189/366] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:13:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:00.187977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ad153-759f-455f-8f76-11843759941d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:00.269560 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc1fb4-30d1-4530-80fc-8d6485d658c5 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:00.314327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da051fbf-aff6-4f06-a661-c56e68c67d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:00.315400 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da051fbf-aff6-4f06-a661-c56e68c67d53 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:00.315880 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da051fbf-aff6-4f06-a661-c56e68c67d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:00.316378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da051fbf-aff6-4f06-a661-c56e68c67d53 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:00.317473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da051fbf-aff6-4f06-a661-c56e68c67d53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:00.318044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da051fbf-aff6-4f06-a661-c56e68c67d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:00.319643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da051fbf-aff6-4f06-a661-c56e68c67d53 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:00.320263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ad153-759f-455f-8f76-11843759941d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:00.332030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 178/367] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:00.332030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da051fbf-aff6-4f06-a661-c56e68c67d53 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:00.360704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2251c29-831a-4c35-8a14-536e99ef6b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:00.361424 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2251c29-831a-4c35-8a14-536e99ef6b28 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:00.361707 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2251c29-831a-4c35-8a14-536e99ef6b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:00.361980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2251c29-831a-4c35-8a14-536e99ef6b28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:00.436336 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2251c29-831a-4c35-8a14-536e99ef6b28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:00.438071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2251c29-831a-4c35-8a14-536e99ef6b28 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:00.455745 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da051fbf-aff6-4f06-a661-c56e68c67d53 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:00.497620 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804fc7b-eca3-4cdf-a318-8a953dd4d8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:00.498257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804fc7b-eca3-4cdf-a318-8a953dd4d8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:00.498544 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804fc7b-eca3-4cdf-a318-8a953dd4d8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:00.498823 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804fc7b-eca3-4cdf-a318-8a953dd4d8a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:00.499697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804fc7b-eca3-4cdf-a318-8a953dd4d8a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:00.499878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804fc7b-eca3-4cdf-a318-8a953dd4d8a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:00.501282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804fc7b-eca3-4cdf-a318-8a953dd4d8a6 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:00.510200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 179/368] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:00.511467 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804fc7b-eca3-4cdf-a318-8a953dd4d8a6 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:00.550914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 190/369] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:00.552163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2251c29-831a-4c35-8a14-536e99ef6b28 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:00.622688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804fc7b-eca3-4cdf-a318-8a953dd4d8a6 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:00.656240 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32886af-1bd0-487e-a5c6-a58f04349a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:00.656890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32886af-1bd0-487e-a5c6-a58f04349a38 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:00.657205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32886af-1bd0-487e-a5c6-a58f04349a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:00.657482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32886af-1bd0-487e-a5c6-a58f04349a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:00.659308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2251c29-831a-4c35-8a14-536e99ef6b28 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:00.695532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aef8f1-ddb0-4463-9b10-fccebfc0e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:00.696109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aef8f1-ddb0-4463-9b10-fccebfc0e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:00.696393 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aef8f1-ddb0-4463-9b10-fccebfc0e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:00.696670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aef8f1-ddb0-4463-9b10-fccebfc0e6f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:00.726746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32886af-1bd0-487e-a5c6-a58f04349a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:00.728207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32886af-1bd0-487e-a5c6-a58f04349a38 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:00.773804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aef8f1-ddb0-4463-9b10-fccebfc0e6f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:00.775784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aef8f1-ddb0-4463-9b10-fccebfc0e6f0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:00.834635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 180/370] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:00.835633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32886af-1bd0-487e-a5c6-a58f04349a38 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:00.891814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 191/371] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:00.892738 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aef8f1-ddb0-4463-9b10-fccebfc0e6f0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:00.953186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32886af-1bd0-487e-a5c6-a58f04349a38 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:01.004018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aef8f1-ddb0-4463-9b10-fccebfc0e6f0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:01.007051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdc71b-f354-44a8-805f-a7d68af3fee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:01.007918 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdc71b-f354-44a8-805f-a7d68af3fee1 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:01.008195 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdc71b-f354-44a8-805f-a7d68af3fee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:01.008463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdc71b-f354-44a8-805f-a7d68af3fee1 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:01.010092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdc71b-f354-44a8-805f-a7d68af3fee1 None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:01.011391 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdc71b-f354-44a8-805f-a7d68af3fee1 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:01.013302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 181/372] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:14:00 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:01.014201 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdc71b-f354-44a8-805f-a7d68af3fee1 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:01.053855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abc034-edf1-4bff-8365-b9f3d1814d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:01.055095 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abc034-edf1-4bff-8365-b9f3d1814d06 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:01.055577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abc034-edf1-4bff-8365-b9f3d1814d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:01.056044 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abc034-edf1-4bff-8365-b9f3d1814d06 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:01.057497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abc034-edf1-4bff-8365-b9f3d1814d06 None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:01.059280 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abc034-edf1-4bff-8365-b9f3d1814d06 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:01.061212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 192/373] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:14:00 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:01.062361 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abc034-edf1-4bff-8365-b9f3d1814d06 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:01.124645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdc71b-f354-44a8-805f-a7d68af3fee1 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:01.158473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7554ad-80b2-4d2e-8ade-9ad9ac93d2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:01.159418 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7554ad-80b2-4d2e-8ade-9ad9ac93d2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:01.159624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7554ad-80b2-4d2e-8ade-9ad9ac93d2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:01.159860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7554ad-80b2-4d2e-8ade-9ad9ac93d2c0 None admin] PATH_INFO: `/v3/projects/92bd0a8a7f7646abb6287b06cfd28dac` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:01.161068 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7554ad-80b2-4d2e-8ade-9ad9ac93d2c0 None admin] RBAC: Authorizing `identity:get_project(project_id=92bd0a8a7f7646abb6287b06cfd28dac)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:01.162494 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7554ad-80b2-4d2e-8ade-9ad9ac93d2c0 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:01.164334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 182/374] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:14:01 2022] GET /identity/v3/projects/92bd0a8a7f7646abb6287b06cfd28dac => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:01.164888 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7554ad-80b2-4d2e-8ade-9ad9ac93d2c0 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:01.166226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abc034-edf1-4bff-8365-b9f3d1814d06 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:01.200551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d46ee-3d14-4c28-8497-3ffcfbc0e5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:01.201795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d46ee-3d14-4c28-8497-3ffcfbc0e5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:01.202293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d46ee-3d14-4c28-8497-3ffcfbc0e5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:01.202771 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d46ee-3d14-4c28-8497-3ffcfbc0e5d6 None admin] PATH_INFO: `/v3/groups/7979a3a79c7d48b0ba9df970a0595d87` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:01.204291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d46ee-3d14-4c28-8497-3ffcfbc0e5d6 None admin] RBAC: Authorizing `identity:get_group(group_id=7979a3a79c7d48b0ba9df970a0595d87)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:01.205967 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d46ee-3d14-4c28-8497-3ffcfbc0e5d6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:01.212664 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 193/375] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:14:01 2022] GET /identity/v3/groups/7979a3a79c7d48b0ba9df970a0595d87 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:01.213774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d46ee-3d14-4c28-8497-3ffcfbc0e5d6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:01.262463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7554ad-80b2-4d2e-8ade-9ad9ac93d2c0 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:01.297789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37078069-37de-4279-94c5-08015478f93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:01.298640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37078069-37de-4279-94c5-08015478f93a None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:01.298916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37078069-37de-4279-94c5-08015478f93a None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:01.299203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37078069-37de-4279-94c5-08015478f93a None admin] PATH_INFO: `/v3/groups/7979a3a79c7d48b0ba9df970a0595d87` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:01.300368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37078069-37de-4279-94c5-08015478f93a None admin] RBAC: Authorizing `identity:get_group(group_id=7979a3a79c7d48b0ba9df970a0595d87)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:01.302040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37078069-37de-4279-94c5-08015478f93a None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:01.303720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 183/376] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:14:01 2022] GET /identity/v3/groups/7979a3a79c7d48b0ba9df970a0595d87 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:01.304480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37078069-37de-4279-94c5-08015478f93a None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:01.317690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d46ee-3d14-4c28-8497-3ffcfbc0e5d6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:01.351786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddb24c-cceb-4569-b41c-53db1051c516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:01.353009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddb24c-cceb-4569-b41c-53db1051c516 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:01.353511 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddb24c-cceb-4569-b41c-53db1051c516 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:01.354000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddb24c-cceb-4569-b41c-53db1051c516 None admin] PATH_INFO: `/v3/groups/fca91ff802b842c99f04fccdc7388deb` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:01.359617 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddb24c-cceb-4569-b41c-53db1051c516 None admin] RBAC: Authorizing `identity:get_group(group_id=fca91ff802b842c99f04fccdc7388deb)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:01.361360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddb24c-cceb-4569-b41c-53db1051c516 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:01.363606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 194/377] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:14:01 2022] GET /identity/v3/groups/fca91ff802b842c99f04fccdc7388deb => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:01.364645 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddb24c-cceb-4569-b41c-53db1051c516 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:01.401213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37078069-37de-4279-94c5-08015478f93a None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:01.437317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b319d7-1361-4d5e-936c-467635737e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:01.437996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b319d7-1361-4d5e-936c-467635737e1d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:01.438275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b319d7-1361-4d5e-936c-467635737e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:01.438547 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b319d7-1361-4d5e-936c-467635737e1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:01.439397 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b319d7-1361-4d5e-936c-467635737e1d None admin] RBAC: Adding query filter params (group.id=7979a3a79c7d48b0ba9df970a0595d87, role.id=dc43ddd6d3b649a187dbfe63b0e20247, scope.project.id=6199907f9ce64320bb281523e68ea62a) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:01.439712 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b319d7-1361-4d5e-936c-467635737e1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:01.441477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b319d7-1361-4d5e-936c-467635737e1d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:01.447515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 184/378] 10.222.0.61 () {56 vars in 1376 bytes} [Tue May 10 20:14:01 2022] GET /identity/v3/role_assignments?group.id=7979a3a79c7d48b0ba9df970a0595d87&scope.project.id=6199907f9ce64320bb281523e68ea62a&role.id=dc43ddd6d3b649a187dbfe63b0e20247 => generated 260 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:01.453252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b319d7-1361-4d5e-936c-467635737e1d None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:01.507822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddb24c-cceb-4569-b41c-53db1051c516 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:01.575674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014e166-79b9-40a7-9f01-13f35ddd1437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:01.576582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014e166-79b9-40a7-9f01-13f35ddd1437 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:01.577329 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014e166-79b9-40a7-9f01-13f35ddd1437 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:01.577329 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014e166-79b9-40a7-9f01-13f35ddd1437 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:01.578283 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014e166-79b9-40a7-9f01-13f35ddd1437 None admin] RBAC: Adding query filter params (group.id=7979a3a79c7d48b0ba9df970a0595d87, role.id=472b056b3a5047109259d7fad9133274, scope.project.id=6199907f9ce64320bb281523e68ea62a) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:01.578667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014e166-79b9-40a7-9f01-13f35ddd1437 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:01.580180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014e166-79b9-40a7-9f01-13f35ddd1437 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:01.591905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 195/379] 10.222.0.61 () {56 vars in 1376 bytes} [Tue May 10 20:14:01 2022] GET /identity/v3/role_assignments?group.id=7979a3a79c7d48b0ba9df970a0595d87&scope.project.id=6199907f9ce64320bb281523e68ea62a&role.id=472b056b3a5047109259d7fad9133274 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:01.606903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b319d7-1361-4d5e-936c-467635737e1d None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:01.647028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c119b-7ea1-429b-b6bc-7d13a0a36b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:01.648299 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c119b-7ea1-429b-b6bc-7d13a0a36b7a None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:01.648765 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c119b-7ea1-429b-b6bc-7d13a0a36b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:01.649250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c119b-7ea1-429b-b6bc-7d13a0a36b7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:01.650304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c119b-7ea1-429b-b6bc-7d13a0a36b7a None admin] RBAC: Adding query filter params (group.id=fca91ff802b842c99f04fccdc7388deb, role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=92bd0a8a7f7646abb6287b06cfd28dac) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:01.650820 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c119b-7ea1-429b-b6bc-7d13a0a36b7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:01.653159 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c119b-7ea1-429b-b6bc-7d13a0a36b7a None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:01.659888 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 185/380] 10.222.0.61 () {56 vars in 1376 bytes} [Tue May 10 20:14:01 2022] GET /identity/v3/role_assignments?group.id=fca91ff802b842c99f04fccdc7388deb&scope.project.id=92bd0a8a7f7646abb6287b06cfd28dac&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:02.290874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f1dbb-7589-4b5f-9f3f-b57f29dbc7b0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:02.291365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f1dbb-7589-4b5f-9f3f-b57f29dbc7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:02.291365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f1dbb-7589-4b5f-9f3f-b57f29dbc7b0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:02.292754 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 196/381] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:02.298325 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e2081-6fc4-460d-9e52-693adfac58fe None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:02.298613 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e2081-6fc4-460d-9e52-693adfac58fe None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:02.298887 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e2081-6fc4-460d-9e52-693adfac58fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:02.320913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-d19e2081-6fc4-460d-9e52-693adfac58fe None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:02.322121 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d19e2081-6fc4-460d-9e52-693adfac58fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:02.400228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 186/382] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:02.426296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f1dbb-7589-4b5f-9f3f-b57f29dbc7b0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:02.563739 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f1dbb-7589-4b5f-9f3f-b57f29dbc7b0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:02.601325 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a50e3-a72f-4657-9b8b-40ad54d30eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:02.602140 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a50e3-a72f-4657-9b8b-40ad54d30eba None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:02.602424 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a50e3-a72f-4657-9b8b-40ad54d30eba None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:02.602702 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a50e3-a72f-4657-9b8b-40ad54d30eba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:02.614300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a50e3-a72f-4657-9b8b-40ad54d30eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-e13a50e3-a72f-4657-9b8b-40ad54d30eba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:02.622535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:02.623604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:02.624696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:02.624696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:02.624696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:02.624696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:02.624696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:02.624696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:02.624696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:02.624696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:02.624696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:02.624696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:02.624696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:14:02.624696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:02.624696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 197/383] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:02.630093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e2081-6fc4-460d-9e52-693adfac58fe None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:02.759543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e2081-6fc4-460d-9e52-693adfac58fe None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:02.791589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29907cc5-38e3-4a12-a8d6-68d808343292 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:02.791926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29907cc5-38e3-4a12-a8d6-68d808343292 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:02.792146 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29907cc5-38e3-4a12-a8d6-68d808343292 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:02.797178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 198/384] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:02.800084 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3344581-3277-488d-847c-02c066057719 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:02.800478 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3344581-3277-488d-847c-02c066057719 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:02.800792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3344581-3277-488d-847c-02c066057719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:02.800955 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ed6f4-4735-47b7-bda6-59813c281bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:02.801696 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ed6f4-4735-47b7-bda6-59813c281bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:02.801973 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ed6f4-4735-47b7-bda6-59813c281bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:02.802251 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ed6f4-4735-47b7-bda6-59813c281bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:02.803089 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ed6f4-4735-47b7-bda6-59813c281bf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:02.803392 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ed6f4-4735-47b7-bda6-59813c281bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:02.804769 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ed6f4-4735-47b7-bda6-59813c281bf4 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:02.813709 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 187/385] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:14:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:02.822593 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ed6f4-4735-47b7-bda6-59813c281bf4 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:02.836114 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c3344581-3277-488d-847c-02c066057719 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:02.837341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c3344581-3277-488d-847c-02c066057719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:02.930176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ed6f4-4735-47b7-bda6-59813c281bf4 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:02.978296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a902e91-e249-44fb-a9f2-f107190d9285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:02.979517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a902e91-e249-44fb-a9f2-f107190d9285 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:02.980036 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a902e91-e249-44fb-a9f2-f107190d9285 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:02.980523 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a902e91-e249-44fb-a9f2-f107190d9285 None admin] PATH_INFO: `/v3/groups/7979a3a79c7d48b0ba9df970a0595d87` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:02.982599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a902e91-e249-44fb-a9f2-f107190d9285 None admin] RBAC: Authorizing `identity:get_group(group_id=7979a3a79c7d48b0ba9df970a0595d87)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:02.987401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a902e91-e249-44fb-a9f2-f107190d9285 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:02.991168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 188/386] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:14:02 2022] GET /identity/v3/groups/7979a3a79c7d48b0ba9df970a0595d87 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:02.993164 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 199/387] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:03.006819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a902e91-e249-44fb-a9f2-f107190d9285 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:03.017074 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3344581-3277-488d-847c-02c066057719 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:03.127477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a902e91-e249-44fb-a9f2-f107190d9285 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:03.183512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3344581-3277-488d-847c-02c066057719 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:03.217008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73686075-cafb-4caa-aac9-0d68a0bea8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:03.217894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73686075-cafb-4caa-aac9-0d68a0bea8ea None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:03.218179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73686075-cafb-4caa-aac9-0d68a0bea8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:03.218454 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73686075-cafb-4caa-aac9-0d68a0bea8ea None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:03.219751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73686075-cafb-4caa-aac9-0d68a0bea8ea None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:03.221345 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73686075-cafb-4caa-aac9-0d68a0bea8ea None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:03.227868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 189/388] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:14:03 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:03.229004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73a266-64f2-438e-bf33-c5a5236a1d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:03.229131 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73686075-cafb-4caa-aac9-0d68a0bea8ea None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:03.229829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73a266-64f2-438e-bf33-c5a5236a1d4b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:03.230151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73a266-64f2-438e-bf33-c5a5236a1d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:03.230426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73a266-64f2-438e-bf33-c5a5236a1d4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:03.246495 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73a266-64f2-438e-bf33-c5a5236a1d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-4a73a266-64f2-438e-bf33-c5a5236a1d4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:03.256004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:03.257233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:03.258086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:03.258086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:03.258086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:03.258086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:03.258086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:03.258086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:03.258086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:03.258086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:03.258086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:03.258086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:03.258086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:14:03.258086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:03.258086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 200/389] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:14:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:03.262730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73a266-64f2-438e-bf33-c5a5236a1d4b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:03.349310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73686075-cafb-4caa-aac9-0d68a0bea8ea None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:03.367117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73a266-64f2-438e-bf33-c5a5236a1d4b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:03.393748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67631b9d-f09f-4965-a024-a4d9a9c79df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:03.394572 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67631b9d-f09f-4965-a024-a4d9a9c79df1 None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:03.394853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67631b9d-f09f-4965-a024-a4d9a9c79df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:03.395130 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67631b9d-f09f-4965-a024-a4d9a9c79df1 None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3/groups/7979a3a79c7d48b0ba9df970a0595d87/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:03.397441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67631b9d-f09f-4965-a024-a4d9a9c79df1 None admin] RBAC: Authorizing `identity:create_grant(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3, group_id=7979a3a79c7d48b0ba9df970a0595d87, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:03.399104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67631b9d-f09f-4965-a024-a4d9a9c79df1 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:03.401304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6f9d6-91de-4361-b143-82ac4ff26589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:03.402033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6f9d6-91de-4361-b143-82ac4ff26589 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:03.402317 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6f9d6-91de-4361-b143-82ac4ff26589 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:03.402591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6f9d6-91de-4361-b143-82ac4ff26589 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:03.403375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6f9d6-91de-4361-b143-82ac4ff26589 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:03.403732 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6f9d6-91de-4361-b143-82ac4ff26589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:03.405231 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6f9d6-91de-4361-b143-82ac4ff26589 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:03.415434 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 201/390] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:03.420079 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 190/391] 10.222.0.61 () {58 vars in 1442 bytes} [Tue May 10 20:14:03 2022] PUT /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3/groups/7979a3a79c7d48b0ba9df970a0595d87/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:14:03.421142 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6f9d6-91de-4361-b143-82ac4ff26589 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:03.530164 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6f9d6-91de-4361-b143-82ac4ff26589 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:03.568134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dc093-9078-4546-af53-db84f34ef7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:03.570590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dc093-9078-4546-af53-db84f34ef7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:03.570874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dc093-9078-4546-af53-db84f34ef7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:03.571148 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dc093-9078-4546-af53-db84f34ef7e4 None admin] PATH_INFO: `/v3/groups/7979a3a79c7d48b0ba9df970a0595d87` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:03.572667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dc093-9078-4546-af53-db84f34ef7e4 None admin] RBAC: Authorizing `identity:get_group(group_id=7979a3a79c7d48b0ba9df970a0595d87)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:03.574798 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dc093-9078-4546-af53-db84f34ef7e4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:03.576714 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 202/392] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:14:03 2022] GET /identity/v3/groups/7979a3a79c7d48b0ba9df970a0595d87 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:03.582331 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67631b9d-f09f-4965-a024-a4d9a9c79df1 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:03.690902 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67631b9d-f09f-4965-a024-a4d9a9c79df1 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:03.731545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309221b-eaee-4c0f-9c8d-9261c631ac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:03.732468 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309221b-eaee-4c0f-9c8d-9261c631ac1f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:03.732748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309221b-eaee-4c0f-9c8d-9261c631ac1f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:03.733043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309221b-eaee-4c0f-9c8d-9261c631ac1f None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:03.737811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309221b-eaee-4c0f-9c8d-9261c631ac1f None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:03.739292 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309221b-eaee-4c0f-9c8d-9261c631ac1f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:03.741532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 191/393] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:14:03 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:03.747403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dc093-9078-4546-af53-db84f34ef7e4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:03.850181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dc093-9078-4546-af53-db84f34ef7e4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:03.884253 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e931b-c8c8-43e2-bd0f-9eb585bab4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:03.885167 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e931b-c8c8-43e2-bd0f-9eb585bab4ce None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:03.885450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e931b-c8c8-43e2-bd0f-9eb585bab4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:03.885726 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e931b-c8c8-43e2-bd0f-9eb585bab4ce None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3/groups/7979a3a79c7d48b0ba9df970a0595d87/roles/472b056b3a5047109259d7fad9133274` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:03.889567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e931b-c8c8-43e2-bd0f-9eb585bab4ce None admin] RBAC: Authorizing `identity:create_grant(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3, group_id=7979a3a79c7d48b0ba9df970a0595d87, role_id=472b056b3a5047109259d7fad9133274)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:03.889773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e931b-c8c8-43e2-bd0f-9eb585bab4ce None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:03.906463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 203/394] 10.222.0.61 () {58 vars in 1442 bytes} [Tue May 10 20:14:03 2022] PUT /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3/groups/7979a3a79c7d48b0ba9df970a0595d87/roles/472b056b3a5047109259d7fad9133274 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:14:04.329793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5281a0-1888-4685-beac-dcb82a4ea0a3 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:04.330131 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5281a0-1888-4685-beac-dcb82a4ea0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:04.330298 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5281a0-1888-4685-beac-dcb82a4ea0a3 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:04.331859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 192/395] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:04.336729 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa185e35-a990-44c4-aff2-13f0ad0f9784 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:04.337055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa185e35-a990-44c4-aff2-13f0ad0f9784 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:04.337339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa185e35-a990-44c4-aff2-13f0ad0f9784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:04.361967 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-aa185e35-a990-44c4-aff2-13f0ad0f9784 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:04.363159 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-aa185e35-a990-44c4-aff2-13f0ad0f9784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:04.445885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 204/396] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:04.467347 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5281a0-1888-4685-beac-dcb82a4ea0a3 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:04.626453 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5281a0-1888-4685-beac-dcb82a4ea0a3 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:04.648471 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4843e7-b087-415f-9537-c9fd8ae56f8d None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:04.649135 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4843e7-b087-415f-9537-c9fd8ae56f8d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:04.649607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4843e7-b087-415f-9537-c9fd8ae56f8d None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:04.651453 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 205/397] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:04.656746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71849096-18e3-4367-9b43-fb7deb80b813 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:04.657323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71849096-18e3-4367-9b43-fb7deb80b813 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:04.657795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71849096-18e3-4367-9b43-fb7deb80b813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:04.668850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f427be3-467b-4388-8695-69ae7ccb8977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:04.670015 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f427be3-467b-4388-8695-69ae7ccb8977 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:04.670015 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f427be3-467b-4388-8695-69ae7ccb8977 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:04.670266 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f427be3-467b-4388-8695-69ae7ccb8977 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:04.675789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-71849096-18e3-4367-9b43-fb7deb80b813 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:04.677217 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-71849096-18e3-4367-9b43-fb7deb80b813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:04.688809 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f427be3-467b-4388-8695-69ae7ccb8977 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-5f427be3-467b-4388-8695-69ae7ccb8977 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:04.696487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:04.697824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:04.698650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:04.698650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:04.698650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:04.698650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:04.698650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:04.698650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:04.698650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:04.698650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:04.698650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:04.698650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:04.698650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:14:04.698650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:04.702127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 193/398] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:04.705973 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f427be3-467b-4388-8695-69ae7ccb8977 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:04.764178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 206/399] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:14:04.764178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d02a2c-9a3a-483e-8fcd-6ca12325609d None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:04.764178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d02a2c-9a3a-483e-8fcd-6ca12325609d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:04.764178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d02a2c-9a3a-483e-8fcd-6ca12325609d None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:04.765638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 207/400] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:04.769162 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d69a93-e296-487b-afbe-8daf29758068 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:04.770091 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d69a93-e296-487b-afbe-8daf29758068 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:04.770091 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d69a93-e296-487b-afbe-8daf29758068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:04.800265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b4d69a93-e296-487b-afbe-8daf29758068 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:04.801477 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b4d69a93-e296-487b-afbe-8daf29758068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:04.831862 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f427be3-467b-4388-8695-69ae7ccb8977 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:04.872409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824f39c-6706-4707-925e-16f13ae9fdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:04.873277 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824f39c-6706-4707-925e-16f13ae9fdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:04.873870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824f39c-6706-4707-925e-16f13ae9fdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:04.874151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824f39c-6706-4707-925e-16f13ae9fdf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:04.875216 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824f39c-6706-4707-925e-16f13ae9fdf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:04.875525 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824f39c-6706-4707-925e-16f13ae9fdf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:04.877087 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0824f39c-6706-4707-925e-16f13ae9fdf4 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:04.878331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 208/401] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:04.879510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d69a93-e296-487b-afbe-8daf29758068 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:04.887287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 194/402] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:14:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:04.898142 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824f39c-6706-4707-925e-16f13ae9fdf4 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:04.999834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824f39c-6706-4707-925e-16f13ae9fdf4 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:05.003605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d69a93-e296-487b-afbe-8daf29758068 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:05.034189 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543acb9-40cb-4d4c-9b45-9735a2ebb1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:05.035498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543acb9-40cb-4d4c-9b45-9735a2ebb1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:05.035979 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543acb9-40cb-4d4c-9b45-9735a2ebb1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:05.036449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543acb9-40cb-4d4c-9b45-9735a2ebb1c3 None admin] PATH_INFO: `/v3/groups/7979a3a79c7d48b0ba9df970a0595d87` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:05.037869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543acb9-40cb-4d4c-9b45-9735a2ebb1c3 None admin] RBAC: Authorizing `identity:get_group(group_id=7979a3a79c7d48b0ba9df970a0595d87)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:05.039516 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543acb9-40cb-4d4c-9b45-9735a2ebb1c3 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:05.041670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 195/403] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:14:04 2022] GET /identity/v3/groups/7979a3a79c7d48b0ba9df970a0595d87 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:05.043265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543acb9-40cb-4d4c-9b45-9735a2ebb1c3 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:05.043533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8204fde-f4db-4faa-8c52-9e7f1efddfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:05.044397 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8204fde-f4db-4faa-8c52-9e7f1efddfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:05.044662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8204fde-f4db-4faa-8c52-9e7f1efddfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:05.044897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8204fde-f4db-4faa-8c52-9e7f1efddfa0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:05.057821 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8204fde-f4db-4faa-8c52-9e7f1efddfa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-c8204fde-f4db-4faa-8c52-9e7f1efddfa0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:05.065955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:05.066916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:05.067708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:05.067708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:05.067708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:05.067708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:05.067708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:05.067708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:05.067708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:05.067708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:05.067708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:05.067708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:05.067708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:14:05.067708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:05.067708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 209/404] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:14:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:05.068869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8204fde-f4db-4faa-8c52-9e7f1efddfa0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:05.150050 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543acb9-40cb-4d4c-9b45-9735a2ebb1c3 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:05.167894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8204fde-f4db-4faa-8c52-9e7f1efddfa0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:05.185444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c67f2-fad5-4e9d-b3d8-341360c01993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:05.186998 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c67f2-fad5-4e9d-b3d8-341360c01993 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:05.187489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c67f2-fad5-4e9d-b3d8-341360c01993 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:05.188236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c67f2-fad5-4e9d-b3d8-341360c01993 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:05.201309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c67f2-fad5-4e9d-b3d8-341360c01993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:05.203944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423f604-3111-4859-a557-92b5752ac926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:05.204815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423f604-3111-4859-a557-92b5752ac926 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:05.205143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423f604-3111-4859-a557-92b5752ac926 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:05.205420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423f604-3111-4859-a557-92b5752ac926 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:05.206688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423f604-3111-4859-a557-92b5752ac926 None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:05.208143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423f604-3111-4859-a557-92b5752ac926 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:05.210135 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 210/405] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:14:05 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-545c67f2-fad5-4e9d-b3d8-341360c01993 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:05.210855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:05.211725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:05.212506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:05.212506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:05.212506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:05.212506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:05.212506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:05.212506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:05.212506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:05.212506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:05.212506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:05.212506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:05.212506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:05.212506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:05.213133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423f604-3111-4859-a557-92b5752ac926 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:05.216095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 196/406] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:14:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:05.221899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c67f2-fad5-4e9d-b3d8-341360c01993 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:05.327968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423f604-3111-4859-a557-92b5752ac926 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:05.344271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c67f2-fad5-4e9d-b3d8-341360c01993 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:05.361573 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5892b9-4bf6-4cfd-a51c-e3668c579013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:05.362560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5892b9-4bf6-4cfd-a51c-e3668c579013 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:05.363042 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5892b9-4bf6-4cfd-a51c-e3668c579013 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:05.363513 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5892b9-4bf6-4cfd-a51c-e3668c579013 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:05.364469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5892b9-4bf6-4cfd-a51c-e3668c579013 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:05.364989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5892b9-4bf6-4cfd-a51c-e3668c579013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:05.366563 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5892b9-4bf6-4cfd-a51c-e3668c579013 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:05.374477 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 211/407] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:05.375525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5892b9-4bf6-4cfd-a51c-e3668c579013 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:05.382234 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590f6cc-3b0e-4c4b-ad5c-d2f33cab3a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:05.383131 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590f6cc-3b0e-4c4b-ad5c-d2f33cab3a60 None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:05.383404 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590f6cc-3b0e-4c4b-ad5c-d2f33cab3a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:05.383764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590f6cc-3b0e-4c4b-ad5c-d2f33cab3a60 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a/groups/7979a3a79c7d48b0ba9df970a0595d87/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:05.386742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590f6cc-3b0e-4c4b-ad5c-d2f33cab3a60 None admin] RBAC: Authorizing `identity:create_grant(project_id=6199907f9ce64320bb281523e68ea62a, group_id=7979a3a79c7d48b0ba9df970a0595d87, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:05.388534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590f6cc-3b0e-4c4b-ad5c-d2f33cab3a60 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:05.407531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 197/408] 10.222.0.61 () {58 vars in 1442 bytes} [Tue May 10 20:14:05 2022] PUT /identity/v3/projects/6199907f9ce64320bb281523e68ea62a/groups/7979a3a79c7d48b0ba9df970a0595d87/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:14:05.408735 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590f6cc-3b0e-4c4b-ad5c-d2f33cab3a60 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:05.491145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5892b9-4bf6-4cfd-a51c-e3668c579013 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:05.538898 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81245247-efc0-470d-80c0-c814452860e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:05.546385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245247-efc0-470d-80c0-c814452860e2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:05.546385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245247-efc0-470d-80c0-c814452860e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:05.546385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81245247-efc0-470d-80c0-c814452860e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:05.546385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81245247-efc0-470d-80c0-c814452860e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:05.546385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81245247-efc0-470d-80c0-c814452860e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:05.546385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81245247-efc0-470d-80c0-c814452860e2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:05.550450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590f6cc-3b0e-4c4b-ad5c-d2f33cab3a60 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:05.568819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 212/409] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:05.586666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81245247-efc0-470d-80c0-c814452860e2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:05.611155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d946841-29a5-4cb3-8346-bca5bf422a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:05.612285 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d946841-29a5-4cb3-8346-bca5bf422a2b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:05.612569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d946841-29a5-4cb3-8346-bca5bf422a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:05.612844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d946841-29a5-4cb3-8346-bca5bf422a2b None admin] PATH_INFO: `/v3/groups/7979a3a79c7d48b0ba9df970a0595d87` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:05.614222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d946841-29a5-4cb3-8346-bca5bf422a2b None admin] RBAC: Authorizing `identity:get_group(group_id=7979a3a79c7d48b0ba9df970a0595d87)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:05.615751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d946841-29a5-4cb3-8346-bca5bf422a2b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:05.617886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 198/410] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:14:05 2022] GET /identity/v3/groups/7979a3a79c7d48b0ba9df970a0595d87 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:05.628643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d946841-29a5-4cb3-8346-bca5bf422a2b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:05.729694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81245247-efc0-470d-80c0-c814452860e2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:05.753332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d946841-29a5-4cb3-8346-bca5bf422a2b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:05.765877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab127aa-d458-48c2-929b-1d27d90a9f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:05.766409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab127aa-d458-48c2-929b-1d27d90a9f56 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:05.766689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab127aa-d458-48c2-929b-1d27d90a9f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:05.766964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab127aa-d458-48c2-929b-1d27d90a9f56 None admin] PATH_INFO: `/v3/groups/fca91ff802b842c99f04fccdc7388deb` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:05.768139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab127aa-d458-48c2-929b-1d27d90a9f56 None admin] RBAC: Authorizing `identity:get_group(group_id=fca91ff802b842c99f04fccdc7388deb)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:05.769636 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab127aa-d458-48c2-929b-1d27d90a9f56 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:05.771533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 213/411] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:14:05 2022] GET /identity/v3/groups/fca91ff802b842c99f04fccdc7388deb => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:05.777530 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab127aa-d458-48c2-929b-1d27d90a9f56 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:05.791591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fc7dd-9fbe-4b6b-b2af-91f6a69829a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:05.793413 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fc7dd-9fbe-4b6b-b2af-91f6a69829a9 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:05.793911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fc7dd-9fbe-4b6b-b2af-91f6a69829a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:05.794359 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4fc7dd-9fbe-4b6b-b2af-91f6a69829a9 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:05.795787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fc7dd-9fbe-4b6b-b2af-91f6a69829a9 None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:05.799050 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4fc7dd-9fbe-4b6b-b2af-91f6a69829a9 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:05.801332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 199/412] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:14:05 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:05.806560 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fc7dd-9fbe-4b6b-b2af-91f6a69829a9 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:05.920260 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab127aa-d458-48c2-929b-1d27d90a9f56 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:05.924947 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4fc7dd-9fbe-4b6b-b2af-91f6a69829a9 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:05.956654 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627912b0-aaaa-4e49-9c95-3f27879a8bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:05.958411 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627912b0-aaaa-4e49-9c95-3f27879a8bcc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:05.958875 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627912b0-aaaa-4e49-9c95-3f27879a8bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:05.959451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627912b0-aaaa-4e49-9c95-3f27879a8bcc None admin] PATH_INFO: `/v3/projects/92bd0a8a7f7646abb6287b06cfd28dac` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:05.961527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627912b0-aaaa-4e49-9c95-3f27879a8bcc None admin] RBAC: Authorizing `identity:get_project(project_id=92bd0a8a7f7646abb6287b06cfd28dac)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:05.963260 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627912b0-aaaa-4e49-9c95-3f27879a8bcc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:05.965201 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c87a2-33e7-4df9-abfa-2283bef2c686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:05.966274 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c87a2-33e7-4df9-abfa-2283bef2c686 None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:05.966396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c87a2-33e7-4df9-abfa-2283bef2c686 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:05.966578 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 214/413] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:14:05 2022] GET /identity/v3/projects/92bd0a8a7f7646abb6287b06cfd28dac => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:05.966788 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c87a2-33e7-4df9-abfa-2283bef2c686 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a/groups/7979a3a79c7d48b0ba9df970a0595d87/roles/472b056b3a5047109259d7fad9133274` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:05.969264 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c87a2-33e7-4df9-abfa-2283bef2c686 None admin] RBAC: Authorizing `identity:create_grant(project_id=6199907f9ce64320bb281523e68ea62a, group_id=7979a3a79c7d48b0ba9df970a0595d87, role_id=472b056b3a5047109259d7fad9133274)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:05.970974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c87a2-33e7-4df9-abfa-2283bef2c686 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:05.972786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627912b0-aaaa-4e49-9c95-3f27879a8bcc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:05.992402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 200/414] 10.222.0.61 () {58 vars in 1442 bytes} [Tue May 10 20:14:05 2022] PUT /identity/v3/projects/6199907f9ce64320bb281523e68ea62a/groups/7979a3a79c7d48b0ba9df970a0595d87/roles/472b056b3a5047109259d7fad9133274 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:14:06.090563 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627912b0-aaaa-4e49-9c95-3f27879a8bcc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:06.133876 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383c4e6-0317-47ac-8c50-867d1ad6ba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:06.134816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383c4e6-0317-47ac-8c50-867d1ad6ba69 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:06.135105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383c4e6-0317-47ac-8c50-867d1ad6ba69 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:06.135386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383c4e6-0317-47ac-8c50-867d1ad6ba69 None admin] PATH_INFO: `/v3/projects/92bd0a8a7f7646abb6287b06cfd28dac/groups/fca91ff802b842c99f04fccdc7388deb/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:06.137786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383c4e6-0317-47ac-8c50-867d1ad6ba69 None admin] RBAC: Authorizing `identity:create_grant(project_id=92bd0a8a7f7646abb6287b06cfd28dac, group_id=fca91ff802b842c99f04fccdc7388deb, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:06.139305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383c4e6-0317-47ac-8c50-867d1ad6ba69 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:06.160180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 215/415] 10.222.0.61 () {58 vars in 1442 bytes} [Tue May 10 20:14:05 2022] PUT /identity/v3/projects/92bd0a8a7f7646abb6287b06cfd28dac/groups/fca91ff802b842c99f04fccdc7388deb/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:14:06.335534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20265f16-68f9-42b3-8b9d-632fc27f8681 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:06.336204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20265f16-68f9-42b3-8b9d-632fc27f8681 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:06.336693 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20265f16-68f9-42b3-8b9d-632fc27f8681 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:06.338419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 201/416] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:06.345090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af7690-95ec-43e8-ab68-6b13fa349a03 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:06.345401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af7690-95ec-43e8-ab68-6b13fa349a03 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:06.345657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af7690-95ec-43e8-ab68-6b13fa349a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:06.364009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-89af7690-95ec-43e8-ab68-6b13fa349a03 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:06.365246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-89af7690-95ec-43e8-ab68-6b13fa349a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:06.438231 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 216/417] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:06.460355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20265f16-68f9-42b3-8b9d-632fc27f8681 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:06.613758 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20265f16-68f9-42b3-8b9d-632fc27f8681 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:06.655403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd9cc4-c7e8-423b-9cb9-13398d4a9c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:06.656198 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd9cc4-c7e8-423b-9cb9-13398d4a9c50 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:06.656475 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd9cc4-c7e8-423b-9cb9-13398d4a9c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:06.656744 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd9cc4-c7e8-423b-9cb9-13398d4a9c50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:06.673800 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd9cc4-c7e8-423b-9cb9-13398d4a9c50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-65dd9cc4-c7e8-423b-9cb9-13398d4a9c50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:06.681570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:06.682666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:06.683691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:06.683691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:06.683691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:06.683691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:06.683691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:06.683691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:06.683691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:06.683691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:06.683691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:06.683691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:06.683691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:14:06.683691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:06.683691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 202/418] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:06.692091 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af7690-95ec-43e8-ab68-6b13fa349a03 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:06.732686 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7d55c-bd0c-4f46-9735-cf5e33508673 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:06.732995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7d55c-bd0c-4f46-9735-cf5e33508673 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:06.733278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7d55c-bd0c-4f46-9735-cf5e33508673 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:06.734654 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 203/419] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:14:06.740045 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97f9d6-df89-46e7-9cf3-fcb8c925a035 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:06.740330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97f9d6-df89-46e7-9cf3-fcb8c925a035 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:06.740609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97f9d6-df89-46e7-9cf3-fcb8c925a035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:06.758489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-5d97f9d6-df89-46e7-9cf3-fcb8c925a035 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:06.759794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5d97f9d6-df89-46e7-9cf3-fcb8c925a035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:06.871434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 204/420] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:14:06.887421 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af7690-95ec-43e8-ab68-6b13fa349a03 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:06.906495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97f9d6-df89-46e7-9cf3-fcb8c925a035 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:06.922759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a080b-370a-406a-bef5-7e5846990afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:06.923755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a080b-370a-406a-bef5-7e5846990afd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:06.924275 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a080b-370a-406a-bef5-7e5846990afd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:06.924744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a080b-370a-406a-bef5-7e5846990afd None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:06.925784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a080b-370a-406a-bef5-7e5846990afd None admin] RBAC: Adding query filter params (name=member) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:06.926289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a080b-370a-406a-bef5-7e5846990afd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:06.927881 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a080b-370a-406a-bef5-7e5846990afd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:06.937189 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 217/421] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:14:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:06.942376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a080b-370a-406a-bef5-7e5846990afd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:07.048914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a080b-370a-406a-bef5-7e5846990afd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:07.083455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878244c6-4e96-47d3-8c34-96924fcad3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:07.084200 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878244c6-4e96-47d3-8c34-96924fcad3ea None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:07.084532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878244c6-4e96-47d3-8c34-96924fcad3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:07.084817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878244c6-4e96-47d3-8c34-96924fcad3ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:07.132604 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97f9d6-df89-46e7-9cf3-fcb8c925a035 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:07.153382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878244c6-4e96-47d3-8c34-96924fcad3ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:07.154856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878244c6-4e96-47d3-8c34-96924fcad3ea None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:07.223050 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e00b05-ccc8-4ea6-b537-e8b473a5bdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:07.223874 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e00b05-ccc8-4ea6-b537-e8b473a5bdcf None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:07.224156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e00b05-ccc8-4ea6-b537-e8b473a5bdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:07.224428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e00b05-ccc8-4ea6-b537-e8b473a5bdcf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:07.252838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e00b05-ccc8-4ea6-b537-e8b473a5bdcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-75e00b05-ccc8-4ea6-b537-e8b473a5bdcf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:07.260843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:07.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:07.263206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:07.263206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:07.263206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:07.263206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:07.263206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:07.263206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:07.263206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:07.263206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:07.263206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:07.263206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:07.263206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:14:07.263206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:07.263206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 205/422] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:14:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:07.268065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 218/423] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 20:14:07.268470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e00b05-ccc8-4ea6-b537-e8b473a5bdcf None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:07.273820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878244c6-4e96-47d3-8c34-96924fcad3ea None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:07.366671 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e00b05-ccc8-4ea6-b537-e8b473a5bdcf None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:07.420091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43804f9c-f184-4794-9919-09bace732d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:07.420692 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43804f9c-f184-4794-9919-09bace732d9b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:07.420992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43804f9c-f184-4794-9919-09bace732d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:07.421282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43804f9c-f184-4794-9919-09bace732d9b None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:07.422031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43804f9c-f184-4794-9919-09bace732d9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:07.422339 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43804f9c-f184-4794-9919-09bace732d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:07.423719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43804f9c-f184-4794-9919-09bace732d9b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:07.429229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878244c6-4e96-47d3-8c34-96924fcad3ea None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:07.440652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 206/424] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:07.446055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43804f9c-f184-4794-9919-09bace732d9b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:07.463388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1c358-aa63-4469-8e00-0b7e6435c95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:07.464284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1c358-aa63-4469-8e00-0b7e6435c95f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:07.464614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1c358-aa63-4469-8e00-0b7e6435c95f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:07.464893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1c358-aa63-4469-8e00-0b7e6435c95f None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:07.469556 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1c358-aa63-4469-8e00-0b7e6435c95f None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:07.471847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1c358-aa63-4469-8e00-0b7e6435c95f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:07.479273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 219/425] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:14:07 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:07.482231 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1c358-aa63-4469-8e00-0b7e6435c95f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:07.591436 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1c358-aa63-4469-8e00-0b7e6435c95f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:07.631105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36648e18-4bad-4212-b6ee-50ce6fa27d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:07.631969 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36648e18-4bad-4212-b6ee-50ce6fa27d83 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:07.632250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36648e18-4bad-4212-b6ee-50ce6fa27d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:07.632584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36648e18-4bad-4212-b6ee-50ce6fa27d83 None admin] PATH_INFO: `/v3/groups/7979a3a79c7d48b0ba9df970a0595d87` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:07.633803 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36648e18-4bad-4212-b6ee-50ce6fa27d83 None admin] RBAC: Authorizing `identity:get_group(group_id=7979a3a79c7d48b0ba9df970a0595d87)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:07.635625 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36648e18-4bad-4212-b6ee-50ce6fa27d83 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:07.637914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 220/426] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:14:07 2022] GET /identity/v3/groups/7979a3a79c7d48b0ba9df970a0595d87 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:07.644021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36648e18-4bad-4212-b6ee-50ce6fa27d83 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:07.660448 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43804f9c-f184-4794-9919-09bace732d9b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:07.698674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47392d3-4b73-4f70-bca4-a2290c05a9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:07.699265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47392d3-4b73-4f70-bca4-a2290c05a9ce None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:07.699705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47392d3-4b73-4f70-bca4-a2290c05a9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:07.699990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47392d3-4b73-4f70-bca4-a2290c05a9ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:07.778896 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47392d3-4b73-4f70-bca4-a2290c05a9ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:07.780358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47392d3-4b73-4f70-bca4-a2290c05a9ce None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:07.888291 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 207/427] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 20:14:07.895927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36648e18-4bad-4212-b6ee-50ce6fa27d83 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:07.898171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47392d3-4b73-4f70-bca4-a2290c05a9ce None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:07.942310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20481e-ec96-46ad-8b63-7f9f52dcfd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:07.942983 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20481e-ec96-46ad-8b63-7f9f52dcfd95 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:07.943269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20481e-ec96-46ad-8b63-7f9f52dcfd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:07.943546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20481e-ec96-46ad-8b63-7f9f52dcfd95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:07.944375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20481e-ec96-46ad-8b63-7f9f52dcfd95 None admin] RBAC: Adding query filter params (group.id=7979a3a79c7d48b0ba9df970a0595d87, role.id=dc43ddd6d3b649a187dbfe63b0e20247, scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:07.944688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20481e-ec96-46ad-8b63-7f9f52dcfd95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:07.946214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20481e-ec96-46ad-8b63-7f9f52dcfd95 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:07.961638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 221/428] 10.222.0.61 () {56 vars in 1376 bytes} [Tue May 10 20:14:07 2022] GET /identity/v3/role_assignments?group.id=7979a3a79c7d48b0ba9df970a0595d87&scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3&role.id=dc43ddd6d3b649a187dbfe63b0e20247 => generated 611 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:08.016901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47392d3-4b73-4f70-bca4-a2290c05a9ce None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:08.056595 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821387e-04fc-48e6-af61-fd526d7a7e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:08.057510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821387e-04fc-48e6-af61-fd526d7a7e2b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:08.057793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821387e-04fc-48e6-af61-fd526d7a7e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:08.058609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821387e-04fc-48e6-af61-fd526d7a7e2b None admin] PATH_INFO: `/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:08.066031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821387e-04fc-48e6-af61-fd526d7a7e2b None admin] RBAC: Authorizing `identity:get_project(project_id=738f5f7d460742eaa6d8fe6a6d1d25a3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:08.067534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821387e-04fc-48e6-af61-fd526d7a7e2b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:08.069847 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 208/429] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:14:07 2022] GET /identity/v3/projects/738f5f7d460742eaa6d8fe6a6d1d25a3 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:08.075657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20481e-ec96-46ad-8b63-7f9f52dcfd95 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:08.212205 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20481e-ec96-46ad-8b63-7f9f52dcfd95 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:08.248738 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0809adc-56aa-4daa-b10e-9037d3b75e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:08.249638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0809adc-56aa-4daa-b10e-9037d3b75e93 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:08.249922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0809adc-56aa-4daa-b10e-9037d3b75e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:08.250199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0809adc-56aa-4daa-b10e-9037d3b75e93 None admin] PATH_INFO: `/v3/groups/7979a3a79c7d48b0ba9df970a0595d87` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:08.251392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0809adc-56aa-4daa-b10e-9037d3b75e93 None admin] RBAC: Authorizing `identity:get_group(group_id=7979a3a79c7d48b0ba9df970a0595d87)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:08.252842 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0809adc-56aa-4daa-b10e-9037d3b75e93 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:08.254942 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 222/430] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:14:08 2022] GET /identity/v3/groups/7979a3a79c7d48b0ba9df970a0595d87 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:08.260455 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821387e-04fc-48e6-af61-fd526d7a7e2b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:08.379000 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821387e-04fc-48e6-af61-fd526d7a7e2b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:08.412867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed334be7-bbae-432e-9796-979bfd3918b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:08.413844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334be7-bbae-432e-9796-979bfd3918b6 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:08.414332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334be7-bbae-432e-9796-979bfd3918b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:08.414779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed334be7-bbae-432e-9796-979bfd3918b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:08.415787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed334be7-bbae-432e-9796-979bfd3918b6 None admin] RBAC: Adding query filter params (group.id=7979a3a79c7d48b0ba9df970a0595d87, role.id=472b056b3a5047109259d7fad9133274, scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:08.416273 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed334be7-bbae-432e-9796-979bfd3918b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:08.418441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed334be7-bbae-432e-9796-979bfd3918b6 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:08.425220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 209/431] 10.222.0.61 () {56 vars in 1376 bytes} [Tue May 10 20:14:08 2022] GET /identity/v3/role_assignments?group.id=7979a3a79c7d48b0ba9df970a0595d87&scope.project.id=738f5f7d460742eaa6d8fe6a6d1d25a3&role.id=472b056b3a5047109259d7fad9133274 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:08.437376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ca39-db7d-4536-b48e-f08ad3f27179 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:08.438045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ca39-db7d-4536-b48e-f08ad3f27179 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:08.438518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726ca39-db7d-4536-b48e-f08ad3f27179 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:08.440439 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 223/432] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:08.445811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf32fde-2674-4be9-9fb1-51a908cb671a None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:08.446088 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf32fde-2674-4be9-9fb1-51a908cb671a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:08.446367 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf32fde-2674-4be9-9fb1-51a908cb671a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:08.465844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-cdf32fde-2674-4be9-9fb1-51a908cb671a None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:08.466955 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-cdf32fde-2674-4be9-9fb1-51a908cb671a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:08.554011 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 210/433] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:08.576987 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ca39-db7d-4536-b48e-f08ad3f27179 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:08.709894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726ca39-db7d-4536-b48e-f08ad3f27179 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:08.751650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d133be6a-598d-4956-ae50-16a397755ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:08.752374 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133be6a-598d-4956-ae50-16a397755ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:08.752656 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133be6a-598d-4956-ae50-16a397755ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:08.752930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d133be6a-598d-4956-ae50-16a397755ce0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:08.768594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d133be6a-598d-4956-ae50-16a397755ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d133be6a-598d-4956-ae50-16a397755ce0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:08.776541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:08.777510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:08.778289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:08.778289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:08.778289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:08.778289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:08.778289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:08.778289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:08.778289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:08.778289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:08.778289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:08.778289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:08.778289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:14:08.778289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:08.778289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 224/434] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:08.785204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf32fde-2674-4be9-9fb1-51a908cb671a None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:08.789787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fc81b-806d-47df-848e-be4dfdfbf69b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:08.790076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fc81b-806d-47df-848e-be4dfdfbf69b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:08.790358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fc81b-806d-47df-848e-be4dfdfbf69b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:08.791960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 225/435] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:08.798261 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89019bb4-3431-41de-9560-1966a3316e7e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:08.798550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89019bb4-3431-41de-9560-1966a3316e7e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:08.798831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89019bb4-3431-41de-9560-1966a3316e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:08.820115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-89019bb4-3431-41de-9560-1966a3316e7e None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:08.821324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-89019bb4-3431-41de-9560-1966a3316e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:08.894025 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf32fde-2674-4be9-9fb1-51a908cb671a None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:08.901696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 226/436] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:08.902867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ca4a3-59b4-4ac3-8747-5339c0730b81 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:08.903155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ca4a3-59b4-4ac3-8747-5339c0730b81 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:08.903432 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ca4a3-59b4-4ac3-8747-5339c0730b81 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:08.904692 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 227/437] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:08.911340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fcc3d-0519-4554-9409-eb3550a2ce00 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:08.911978 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fcc3d-0519-4554-9409-eb3550a2ce00 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:08.912566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fcc3d-0519-4554-9409-eb3550a2ce00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:08.931976 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-848fcc3d-0519-4554-9409-eb3550a2ce00 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:08.933780 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-848fcc3d-0519-4554-9409-eb3550a2ce00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:08.939613 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421e595-0e7e-4529-8ecd-385cac6a84cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:08.940520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421e595-0e7e-4529-8ecd-385cac6a84cb None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:08.940624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421e595-0e7e-4529-8ecd-385cac6a84cb None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:08.940849 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421e595-0e7e-4529-8ecd-385cac6a84cb None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:08.941636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421e595-0e7e-4529-8ecd-385cac6a84cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:08.942087 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421e595-0e7e-4529-8ecd-385cac6a84cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:08.944338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421e595-0e7e-4529-8ecd-385cac6a84cb None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:08.951839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 211/438] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:14:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:08.952664 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421e595-0e7e-4529-8ecd-385cac6a84cb None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:09.007992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 228/439] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:14:09.009007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fcc3d-0519-4554-9409-eb3550a2ce00 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:09.076423 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421e595-0e7e-4529-8ecd-385cac6a84cb None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:09.106555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fcc3d-0519-4554-9409-eb3550a2ce00 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:09.107318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d66f4-551b-4d34-92da-971559f2e5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:09.108115 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d66f4-551b-4d34-92da-971559f2e5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:09.108391 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d66f4-551b-4d34-92da-971559f2e5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:09.108666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d66f4-551b-4d34-92da-971559f2e5d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:09.118198 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d66f4-551b-4d34-92da-971559f2e5d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-b47d66f4-551b-4d34-92da-971559f2e5d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:09.126711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:09.127577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:09.128384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:09.128384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:09.128384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:09.128384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:09.128384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:09.128384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:09.128384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:09.128384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:09.128384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:09.128384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:09.128384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:14:09.128384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:09.128384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 212/440] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:14:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:09.129081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d66f4-551b-4d34-92da-971559f2e5d9 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:09.138491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e65482-c428-4d0c-be6d-2c6c3b5b9d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:09.139132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e65482-c428-4d0c-be6d-2c6c3b5b9d22 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:09.139409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e65482-c428-4d0c-be6d-2c6c3b5b9d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:09.139682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e65482-c428-4d0c-be6d-2c6c3b5b9d22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:09.202315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e65482-c428-4d0c-be6d-2c6c3b5b9d22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:09.203768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e65482-c428-4d0c-be6d-2c6c3b5b9d22 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:09.221862 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d66f4-551b-4d34-92da-971559f2e5d9 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:09.253168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b519b3b-7952-41ec-8b16-7490da889127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:09.253949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519b3b-7952-41ec-8b16-7490da889127 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:09.254230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519b3b-7952-41ec-8b16-7490da889127 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:09.254502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b519b3b-7952-41ec-8b16-7490da889127 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:09.264115 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b519b3b-7952-41ec-8b16-7490da889127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-6b519b3b-7952-41ec-8b16-7490da889127 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:09.271634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:09.272741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:09.273576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:09.273576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:09.273576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:09.273576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:09.273576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:09.273576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:09.273576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:09.273576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:09.273576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:09.273576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:09.273576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:09.273576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:09.273576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 213/441] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:14:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:09.274220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b519b3b-7952-41ec-8b16-7490da889127 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:09.298491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 229/442] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:09.299291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e65482-c428-4d0c-be6d-2c6c3b5b9d22 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:09.367533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b519b3b-7952-41ec-8b16-7490da889127 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:09.388400 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e65482-c428-4d0c-be6d-2c6c3b5b9d22 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:09.398410 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28e1eb-d6fe-4d57-86c8-a38f0f2935d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:09.399069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28e1eb-d6fe-4d57-86c8-a38f0f2935d0 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:09.399352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28e1eb-d6fe-4d57-86c8-a38f0f2935d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:09.399626 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28e1eb-d6fe-4d57-86c8-a38f0f2935d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:09.400373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28e1eb-d6fe-4d57-86c8-a38f0f2935d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:09.400676 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28e1eb-d6fe-4d57-86c8-a38f0f2935d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:09.402592 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28e1eb-d6fe-4d57-86c8-a38f0f2935d0 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:09.410086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 214/443] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:09.410934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28e1eb-d6fe-4d57-86c8-a38f0f2935d0 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:09.421062 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f5a4c-bb95-44ba-ad9e-895471b4de06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:09.421734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5a4c-bb95-44ba-ad9e-895471b4de06 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:09.422013 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5a4c-bb95-44ba-ad9e-895471b4de06 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:09.422286 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5a4c-bb95-44ba-ad9e-895471b4de06 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:09.423027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f5a4c-bb95-44ba-ad9e-895471b4de06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:09.423332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f5a4c-bb95-44ba-ad9e-895471b4de06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:09.424695 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f5a4c-bb95-44ba-ad9e-895471b4de06 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:09.432437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 230/444] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:09.433251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f5a4c-bb95-44ba-ad9e-895471b4de06 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:09.507221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28e1eb-d6fe-4d57-86c8-a38f0f2935d0 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:09.524824 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f5a4c-bb95-44ba-ad9e-895471b4de06 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:09.538688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c723c-70f7-4e1a-b767-c04aa76c3871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:09.539545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c723c-70f7-4e1a-b767-c04aa76c3871 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:09.539827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c723c-70f7-4e1a-b767-c04aa76c3871 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:09.540102 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c723c-70f7-4e1a-b767-c04aa76c3871 None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:09.541310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c723c-70f7-4e1a-b767-c04aa76c3871 None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:09.542730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c723c-70f7-4e1a-b767-c04aa76c3871 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:09.544569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 215/445] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:14:09 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:09.545251 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c723c-70f7-4e1a-b767-c04aa76c3871 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:09.556758 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb8eba-19c4-4fcf-836a-3cf6d3a74e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:09.557436 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb8eba-19c4-4fcf-836a-3cf6d3a74e59 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:09.557721 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb8eba-19c4-4fcf-836a-3cf6d3a74e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:09.558520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb8eba-19c4-4fcf-836a-3cf6d3a74e59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:09.620705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb8eba-19c4-4fcf-836a-3cf6d3a74e59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:09.622185 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb8eba-19c4-4fcf-836a-3cf6d3a74e59 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:09.637528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c723c-70f7-4e1a-b767-c04aa76c3871 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:09.668918 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3f7c-03c4-4ba6-9124-fb3bc3816ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:09.669633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3f7c-03c4-4ba6-9124-fb3bc3816ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:09.669915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3f7c-03c4-4ba6-9124-fb3bc3816ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:09.670188 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3f7c-03c4-4ba6-9124-fb3bc3816ff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:09.712853 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 231/446] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:09.713713 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb8eba-19c4-4fcf-836a-3cf6d3a74e59 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:09.733671 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f3f7c-03c4-4ba6-9124-fb3bc3816ff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:09.735122 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f3f7c-03c4-4ba6-9124-fb3bc3816ff9 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:09.804748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb8eba-19c4-4fcf-836a-3cf6d3a74e59 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:09.826966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 216/447] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:09.827790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3f7c-03c4-4ba6-9124-fb3bc3816ff9 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:09.836587 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272831ff-729e-4078-a1db-a12e670937e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:09.837478 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272831ff-729e-4078-a1db-a12e670937e7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:09.837760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272831ff-729e-4078-a1db-a12e670937e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:09.838034 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272831ff-729e-4078-a1db-a12e670937e7 None admin] PATH_INFO: `/v3/groups/7979a3a79c7d48b0ba9df970a0595d87` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:09.839259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272831ff-729e-4078-a1db-a12e670937e7 None admin] RBAC: Authorizing `identity:get_group(group_id=7979a3a79c7d48b0ba9df970a0595d87)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:09.841241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272831ff-729e-4078-a1db-a12e670937e7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:09.842847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 232/448] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:14:09 2022] GET /identity/v3/groups/7979a3a79c7d48b0ba9df970a0595d87 => generated 226 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:09.843600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272831ff-729e-4078-a1db-a12e670937e7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:09.918911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f3f7c-03c4-4ba6-9124-fb3bc3816ff9 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:09.934994 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272831ff-729e-4078-a1db-a12e670937e7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:09.952616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cae49f-5512-4b0b-b3c3-08de96d9043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:09.953500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cae49f-5512-4b0b-b3c3-08de96d9043f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:09.953779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cae49f-5512-4b0b-b3c3-08de96d9043f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:09.954048 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cae49f-5512-4b0b-b3c3-08de96d9043f None admin] PATH_INFO: `/v3/projects/6199907f9ce64320bb281523e68ea62a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:09.955249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cae49f-5512-4b0b-b3c3-08de96d9043f None admin] RBAC: Authorizing `identity:get_project(project_id=6199907f9ce64320bb281523e68ea62a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:09.956696 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cae49f-5512-4b0b-b3c3-08de96d9043f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:09.958395 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 217/449] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:14:09 2022] GET /identity/v3/projects/6199907f9ce64320bb281523e68ea62a => generated 302 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:09.959143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cae49f-5512-4b0b-b3c3-08de96d9043f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:09.974203 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5a91e-1888-4a7c-a1a1-3202469719ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:09.975054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5a91e-1888-4a7c-a1a1-3202469719ee None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:09.975330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5a91e-1888-4a7c-a1a1-3202469719ee None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:09.975600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5a91e-1888-4a7c-a1a1-3202469719ee None admin] PATH_INFO: `/v3/projects/92bd0a8a7f7646abb6287b06cfd28dac` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:09.976759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5a91e-1888-4a7c-a1a1-3202469719ee None admin] RBAC: Authorizing `identity:get_project(project_id=92bd0a8a7f7646abb6287b06cfd28dac)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:09.978250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5a91e-1888-4a7c-a1a1-3202469719ee None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:09.980516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 233/450] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:14:09 2022] GET /identity/v3/projects/92bd0a8a7f7646abb6287b06cfd28dac => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:09.981288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5a91e-1888-4a7c-a1a1-3202469719ee None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:10.053583 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cae49f-5512-4b0b-b3c3-08de96d9043f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:10.073790 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5a91e-1888-4a7c-a1a1-3202469719ee None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:10.084454 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fa54e-0ccd-48ad-b5ea-676847ea259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:10.085135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa54e-0ccd-48ad-b5ea-676847ea259f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:10.085426 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa54e-0ccd-48ad-b5ea-676847ea259f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:10.085682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fa54e-0ccd-48ad-b5ea-676847ea259f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:10.086502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fa54e-0ccd-48ad-b5ea-676847ea259f None admin] RBAC: Adding query filter params (group.id=7979a3a79c7d48b0ba9df970a0595d87, role.id=dc43ddd6d3b649a187dbfe63b0e20247, scope.project.id=6199907f9ce64320bb281523e68ea62a) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:10.086808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fa54e-0ccd-48ad-b5ea-676847ea259f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:10.088219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fa54e-0ccd-48ad-b5ea-676847ea259f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:10.094250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 218/451] 10.222.0.61 () {56 vars in 1376 bytes} [Tue May 10 20:14:09 2022] GET /identity/v3/role_assignments?group.id=7979a3a79c7d48b0ba9df970a0595d87&scope.project.id=6199907f9ce64320bb281523e68ea62a&role.id=dc43ddd6d3b649a187dbfe63b0e20247 => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:10.095003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fa54e-0ccd-48ad-b5ea-676847ea259f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:10.117509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4910609-c02e-4039-94ab-15694eb161fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:10.118377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4910609-c02e-4039-94ab-15694eb161fd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:10.118660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4910609-c02e-4039-94ab-15694eb161fd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:10.118933 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4910609-c02e-4039-94ab-15694eb161fd None admin] PATH_INFO: `/v3/groups/7979a3a79c7d48b0ba9df970a0595d87` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:10.120204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4910609-c02e-4039-94ab-15694eb161fd None admin] RBAC: Authorizing `identity:get_group(group_id=7979a3a79c7d48b0ba9df970a0595d87)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:10.121778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4910609-c02e-4039-94ab-15694eb161fd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:10.123474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 234/452] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:14:09 2022] GET /identity/v3/groups/7979a3a79c7d48b0ba9df970a0595d87 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:10.129445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4910609-c02e-4039-94ab-15694eb161fd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:10.197022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fa54e-0ccd-48ad-b5ea-676847ea259f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:10.232022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4910609-c02e-4039-94ab-15694eb161fd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:10.234180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203003c7-5cc6-4158-a81d-cce4d2306299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:10.235967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203003c7-5cc6-4158-a81d-cce4d2306299 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:10.236244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203003c7-5cc6-4158-a81d-cce4d2306299 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:10.236516 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203003c7-5cc6-4158-a81d-cce4d2306299 None admin] PATH_INFO: `/v3/groups/fca91ff802b842c99f04fccdc7388deb` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:10.237804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203003c7-5cc6-4158-a81d-cce4d2306299 None admin] RBAC: Authorizing `identity:get_group(group_id=fca91ff802b842c99f04fccdc7388deb)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:10.239250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203003c7-5cc6-4158-a81d-cce4d2306299 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:10.242619 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 219/453] 10.222.0.61 () {56 vars in 1180 bytes} [Tue May 10 20:14:10 2022] GET /identity/v3/groups/fca91ff802b842c99f04fccdc7388deb => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:10.247939 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203003c7-5cc6-4158-a81d-cce4d2306299 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:10.271780 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0bf76-62e1-49e6-bb13-0cbdf4bc6dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:10.272693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0bf76-62e1-49e6-bb13-0cbdf4bc6dbc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:10.273005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0bf76-62e1-49e6-bb13-0cbdf4bc6dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:10.273265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0bf76-62e1-49e6-bb13-0cbdf4bc6dbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:10.274086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0bf76-62e1-49e6-bb13-0cbdf4bc6dbc None admin] RBAC: Adding query filter params (group.id=7979a3a79c7d48b0ba9df970a0595d87, role.id=472b056b3a5047109259d7fad9133274, scope.project.id=6199907f9ce64320bb281523e68ea62a) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:10.274395 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0bf76-62e1-49e6-bb13-0cbdf4bc6dbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:10.275830 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0bf76-62e1-49e6-bb13-0cbdf4bc6dbc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:10.282280 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 235/454] 10.222.0.61 () {56 vars in 1376 bytes} [Tue May 10 20:14:10 2022] GET /identity/v3/role_assignments?group.id=7979a3a79c7d48b0ba9df970a0595d87&scope.project.id=6199907f9ce64320bb281523e68ea62a&role.id=472b056b3a5047109259d7fad9133274 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:10.362432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203003c7-5cc6-4158-a81d-cce4d2306299 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:10.399685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ffc52-f29f-42ba-81aa-f12897ba7ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:10.400361 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ffc52-f29f-42ba-81aa-f12897ba7ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:10.400646 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ffc52-f29f-42ba-81aa-f12897ba7ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:10.400922 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ffc52-f29f-42ba-81aa-f12897ba7ab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:10.402373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ffc52-f29f-42ba-81aa-f12897ba7ab6 None admin] RBAC: Adding query filter params (group.id=fca91ff802b842c99f04fccdc7388deb, role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=92bd0a8a7f7646abb6287b06cfd28dac) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:10.402688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ffc52-f29f-42ba-81aa-f12897ba7ab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:10.404148 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ffc52-f29f-42ba-81aa-f12897ba7ab6 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:10.413383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 220/455] 10.222.0.61 () {56 vars in 1376 bytes} [Tue May 10 20:14:10 2022] GET /identity/v3/role_assignments?group.id=fca91ff802b842c99f04fccdc7388deb&scope.project.id=92bd0a8a7f7646abb6287b06cfd28dac&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:13.145388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd921ccc-0e4c-41a3-954c-52c78b411c31 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:13.146382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd921ccc-0e4c-41a3-954c-52c78b411c31 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:13.147224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd921ccc-0e4c-41a3-954c-52c78b411c31 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:13.148852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 236/456] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:13.154356 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081f43a-835e-46af-a0a3-11eeb37c6a48 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:13.155137 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081f43a-835e-46af-a0a3-11eeb37c6a48 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:13.155612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081f43a-835e-46af-a0a3-11eeb37c6a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:13.176895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6081f43a-835e-46af-a0a3-11eeb37c6a48 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:13.178396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6081f43a-835e-46af-a0a3-11eeb37c6a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:13.263413 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 221/457] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:13.295079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd921ccc-0e4c-41a3-954c-52c78b411c31 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:13.413873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd921ccc-0e4c-41a3-954c-52c78b411c31 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:13.459979 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5b5e9-8d0a-4f64-bcfa-5aecd10c3394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:13.461171 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5b5e9-8d0a-4f64-bcfa-5aecd10c3394 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:13.461652 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5b5e9-8d0a-4f64-bcfa-5aecd10c3394 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:13.462118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5b5e9-8d0a-4f64-bcfa-5aecd10c3394 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:13.473214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5b5e9-8d0a-4f64-bcfa-5aecd10c3394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:13.474913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5b5e9-8d0a-4f64-bcfa-5aecd10c3394 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-aeb5b5e9-8d0a-4f64-bcfa-5aecd10c3394 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:13.502801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:13.503716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:13.504565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:13.504565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:13.504565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:13.504565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:13.506826 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 237/458] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:13.512499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081f43a-835e-46af-a0a3-11eeb37c6a48 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:13.545684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478987d7-aca1-4a2f-8db9-8dde0370a7db None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:13.545885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478987d7-aca1-4a2f-8db9-8dde0370a7db None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:13.546410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478987d7-aca1-4a2f-8db9-8dde0370a7db None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:13.548180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 238/459] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:14:13.553165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccbe98-4287-4a8d-83d8-13f8fded55f7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:13.553683 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccbe98-4287-4a8d-83d8-13f8fded55f7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:13.554156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccbe98-4287-4a8d-83d8-13f8fded55f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:13.576813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-35ccbe98-4287-4a8d-83d8-13f8fded55f7 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:13.579022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-35ccbe98-4287-4a8d-83d8-13f8fded55f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:13.666871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 239/460] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:14:13.669129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191d55-a435-4d63-9a23-3e035705dd3c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:13.669684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191d55-a435-4d63-9a23-3e035705dd3c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:13.670149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31191d55-a435-4d63-9a23-3e035705dd3c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:13.676163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 240/461] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:13.679044 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f04d0-d1b2-494d-9585-4a51578ed191 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:13.682587 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f04d0-d1b2-494d-9585-4a51578ed191 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:13.683499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f04d0-d1b2-494d-9585-4a51578ed191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:13.708030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081f43a-835e-46af-a0a3-11eeb37c6a48 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:13.710349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c20f04d0-d1b2-494d-9585-4a51578ed191 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:13.712565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c20f04d0-d1b2-494d-9585-4a51578ed191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:13.742649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e88ef-74c5-4465-89b8-412074f368cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:13.743656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e88ef-74c5-4465-89b8-412074f368cb None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:13.744158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e88ef-74c5-4465-89b8-412074f368cb None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:13.744622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e88ef-74c5-4465-89b8-412074f368cb None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:13.745647 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e88ef-74c5-4465-89b8-412074f368cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:13.746169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e88ef-74c5-4465-89b8-412074f368cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:13.747820 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e88ef-74c5-4465-89b8-412074f368cb None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:13.764704 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 222/462] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:13.765867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e88ef-74c5-4465-89b8-412074f368cb None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:13.801155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 241/463] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:13.801155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f04d0-d1b2-494d-9585-4a51578ed191 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:13.891298 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e88ef-74c5-4465-89b8-412074f368cb None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:13.899659 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f04d0-d1b2-494d-9585-4a51578ed191 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:13.925366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223f748-628b-4795-9ef8-8e0ba6d0a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:13.926496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223f748-628b-4795-9ef8-8e0ba6d0a828 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:13.926996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223f748-628b-4795-9ef8-8e0ba6d0a828 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:13.927458 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223f748-628b-4795-9ef8-8e0ba6d0a828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:13.934687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823b2d9-a1ef-4ebe-9cf2-4fa195fcf414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:13.935357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823b2d9-a1ef-4ebe-9cf2-4fa195fcf414 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:13.935637 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823b2d9-a1ef-4ebe-9cf2-4fa195fcf414 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:13.935911 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823b2d9-a1ef-4ebe-9cf2-4fa195fcf414 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:13.936892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823b2d9-a1ef-4ebe-9cf2-4fa195fcf414 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:13.938106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823b2d9-a1ef-4ebe-9cf2-4fa195fcf414 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:13.941409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223f748-628b-4795-9ef8-8e0ba6d0a828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:13.943049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f223f748-628b-4795-9ef8-8e0ba6d0a828 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:13.965004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 242/464] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:14:13 2022] POST /identity/v3/users => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:14:13.965004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823b2d9-a1ef-4ebe-9cf2-4fa195fcf414 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-f223f748-628b-4795-9ef8-8e0ba6d0a828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:13.965253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:13.966545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:13.967365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:13.967365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:13.967365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:13.967365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:13.967365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 223/465] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:13.976611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223f748-628b-4795-9ef8-8e0ba6d0a828 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:14.082393 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823b2d9-a1ef-4ebe-9cf2-4fa195fcf414 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:14.098694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223f748-628b-4795-9ef8-8e0ba6d0a828 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:14.119892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd77ae2-f410-450f-9748-051d7a5dfba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:14.121310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd77ae2-f410-450f-9748-051d7a5dfba7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:14.121590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd77ae2-f410-450f-9748-051d7a5dfba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:14.121864 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd77ae2-f410-450f-9748-051d7a5dfba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:14.132686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd77ae2-f410-450f-9748-051d7a5dfba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:14.134221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd77ae2-f410-450f-9748-051d7a5dfba7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:14.137025 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342cb74-476e-448f-ade9-a674f1153ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:14.137886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342cb74-476e-448f-ade9-a674f1153ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:14.138309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342cb74-476e-448f-ade9-a674f1153ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:14.138718 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342cb74-476e-448f-ade9-a674f1153ef1 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:14.139614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342cb74-476e-448f-ade9-a674f1153ef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:14.140062 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342cb74-476e-448f-ade9-a674f1153ef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:14.141629 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342cb74-476e-448f-ade9-a674f1153ef1 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ddd77ae2-f410-450f-9748-051d7a5dfba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:14.153626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:14.154858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:14.155678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:14.155678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:14.155678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:14.155678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:14.155678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 243/466] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:14.156476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213d4e2-85d9-4178-bf79-3d7a43d1ee5c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:14.156762 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213d4e2-85d9-4178-bf79-3d7a43d1ee5c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:14.157070 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213d4e2-85d9-4178-bf79-3d7a43d1ee5c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:14.159140 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 224/468] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:14.162586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 244/468] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:14.163941 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115edf47-1591-4a49-8973-b4afe9878e01 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:14.164261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115edf47-1591-4a49-8973-b4afe9878e01 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:14.164485 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115edf47-1591-4a49-8973-b4afe9878e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:14.165881 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213d4e2-85d9-4178-bf79-3d7a43d1ee5c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:14.183195 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-115edf47-1591-4a49-8973-b4afe9878e01 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:14.184497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-115edf47-1591-4a49-8973-b4afe9878e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:14.258277 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 225/469] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:14:14.259486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115edf47-1591-4a49-8973-b4afe9878e01 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:14.287265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213d4e2-85d9-4178-bf79-3d7a43d1ee5c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:14.328880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140533f3-d3cd-47aa-bf05-445af37fa576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:14.329863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140533f3-d3cd-47aa-bf05-445af37fa576 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:14.330334 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140533f3-d3cd-47aa-bf05-445af37fa576 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:14.330599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140533f3-d3cd-47aa-bf05-445af37fa576 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:14.331327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140533f3-d3cd-47aa-bf05-445af37fa576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:14.331622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140533f3-d3cd-47aa-bf05-445af37fa576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:14.333060 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140533f3-d3cd-47aa-bf05-445af37fa576 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:14.352312 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 245/470] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:14.356889 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140533f3-d3cd-47aa-bf05-445af37fa576 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:14.400548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115edf47-1591-4a49-8973-b4afe9878e01 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:14.448192 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4c4ee-5679-4041-b288-096c25a0daf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:14.449820 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c4ee-5679-4041-b288-096c25a0daf8 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:14.450609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c4ee-5679-4041-b288-096c25a0daf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:14.451065 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4c4ee-5679-4041-b288-096c25a0daf8 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:14.452624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4c4ee-5679-4041-b288-096c25a0daf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:14.454976 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4c4ee-5679-4041-b288-096c25a0daf8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:14.458590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140533f3-d3cd-47aa-bf05-445af37fa576 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:14.476836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 226/471] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:14:14 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:14:14.478002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4c4ee-5679-4041-b288-096c25a0daf8 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:14.510655 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a679c1-923c-4153-9a8c-8a28317dc083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:14.511886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a679c1-923c-4153-9a8c-8a28317dc083 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:14.512371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a679c1-923c-4153-9a8c-8a28317dc083 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:14.512861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a679c1-923c-4153-9a8c-8a28317dc083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:14.524726 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a679c1-923c-4153-9a8c-8a28317dc083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:14.526667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a679c1-923c-4153-9a8c-8a28317dc083 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-18a679c1-923c-4153-9a8c-8a28317dc083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:14.546248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:14.547206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:14.548063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:14.548063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:14.548063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:14.548063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:14.550550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 246/472] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:14.552156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a87c1e-0c81-45f0-ae30-508391698920 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:14.552648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a87c1e-0c81-45f0-ae30-508391698920 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:14.553147 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a87c1e-0c81-45f0-ae30-508391698920 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:14.559901 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 247/473] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:14.561187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a87c1e-0c81-45f0-ae30-508391698920 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:14.616256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4c4ee-5679-4041-b288-096c25a0daf8 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:14.656253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbbe1d-2e7c-4391-b3e2-f5f9eaee80bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:14.657378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbbe1d-2e7c-4391-b3e2-f5f9eaee80bc None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:14.657876 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbbe1d-2e7c-4391-b3e2-f5f9eaee80bc None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:14.658352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbbe1d-2e7c-4391-b3e2-f5f9eaee80bc None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:14.659262 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbbe1d-2e7c-4391-b3e2-f5f9eaee80bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:14.661012 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbbe1d-2e7c-4391-b3e2-f5f9eaee80bc None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:14.689793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 227/474] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:14:14 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:14:14.691675 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b6834-66fb-4327-9573-5f20d3adcbe3 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:14.692186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b6834-66fb-4327-9573-5f20d3adcbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:14.692887 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b6834-66fb-4327-9573-5f20d3adcbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:14.697663 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a87c1e-0c81-45f0-ae30-508391698920 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:14.711878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e04b6834-66fb-4327-9573-5f20d3adcbe3 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:14.713510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e04b6834-66fb-4327-9573-5f20d3adcbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:14.745603 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb07cf-45c3-4a6b-a548-bd1c4cb1c873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:14.747003 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb07cf-45c3-4a6b-a548-bd1c4cb1c873 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:14.747644 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb07cf-45c3-4a6b-a548-bd1c4cb1c873 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:14.748456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb07cf-45c3-4a6b-a548-bd1c4cb1c873 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:14.749941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb07cf-45c3-4a6b-a548-bd1c4cb1c873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:14.750578 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb07cf-45c3-4a6b-a548-bd1c4cb1c873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:14.752202 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb07cf-45c3-4a6b-a548-bd1c4cb1c873 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:14.769665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 248/475] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:14.777918 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb07cf-45c3-4a6b-a548-bd1c4cb1c873 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:14.799460 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 228/476] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:14.841642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b6834-66fb-4327-9573-5f20d3adcbe3 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:14.908743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb07cf-45c3-4a6b-a548-bd1c4cb1c873 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:14.957140 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba562-6440-461e-8329-21e24bd7d927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:14.957935 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba562-6440-461e-8329-21e24bd7d927 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:14.958218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba562-6440-461e-8329-21e24bd7d927 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:14.958504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba562-6440-461e-8329-21e24bd7d927 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:14.959221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ba562-6440-461e-8329-21e24bd7d927 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:14.960657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ba562-6440-461e-8329-21e24bd7d927 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:14.994925 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 249/477] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:14:14 2022] POST /identity/v3/users => generated 249 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:14:15.024859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b6834-66fb-4327-9573-5f20d3adcbe3 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:15.075615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58a3e2-7582-4ccf-aaa3-1a70578adb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:15.076602 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58a3e2-7582-4ccf-aaa3-1a70578adb18 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:15.077054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58a3e2-7582-4ccf-aaa3-1a70578adb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:15.077469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58a3e2-7582-4ccf-aaa3-1a70578adb18 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:15.078449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58a3e2-7582-4ccf-aaa3-1a70578adb18 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:15.080016 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58a3e2-7582-4ccf-aaa3-1a70578adb18 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:15.088682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.sql.core [None req-1e58a3e2-7582-4ccf-aaa3-1a70578adb18 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 20:14:15.088682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 20:14:15.088682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [parameters: {'id': 'e6828f562f844e0787a5f98b11ea43e1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 20:14:15.088682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80020) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-1e58a3e2-7582-4ccf-aaa3-1a70578adb18 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application result = self._query(query) May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application conn.query(q) May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application result.read() May 10 20:14:15.106411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return ref.to_dict() May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 20:14:15.107575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application next(self.gen) May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application yield resource May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application next(self.gen) May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self.session.rollback() May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self.force_reraise() May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise self.value May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application session.commit() May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 20:14:15.108706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._prepare_impl() May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self.session.flush() May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._flush(objects) May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application compat.raise_( May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application flush_context.execute() May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rec.execute(self) May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 20:14:15.109795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 20:14:15.110869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application result = self._query(query) May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application conn.query(q) May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application result.read() May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 20:14:15.111850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [parameters: {'id': 'e6828f562f844e0787a5f98b11ea43e1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:15.112670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 20:14:15.113754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:15.116532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 229/478] 10.222.0.61 () {60 vars in 1131 bytes} [Tue May 10 20:14:14 2022] POST /identity/v3/roles => generated 144 bytes in 275 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:15.123268 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba562-6440-461e-8329-21e24bd7d927 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:15.240297 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba562-6440-461e-8329-21e24bd7d927 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:15.274063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1d874-1f42-47f9-8983-264089577971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:15.274928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d874-1f42-47f9-8983-264089577971 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:15.275210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d874-1f42-47f9-8983-264089577971 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:15.275586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d874-1f42-47f9-8983-264089577971 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:15.285569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1d874-1f42-47f9-8983-264089577971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-49d1d874-1f42-47f9-8983-264089577971 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:15.294092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:15.294977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:15.295800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:15.295800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:15.295800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:15.295800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:15.295800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:15.295800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:15.295800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:15.295800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:15.295800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:15.295800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:15.295800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:14:15.295800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:15.295800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 250/479] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:14:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:15.301583 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58a3e2-7582-4ccf-aaa3-1a70578adb18 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:15.410056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58a3e2-7582-4ccf-aaa3-1a70578adb18 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:15.450664 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2a338-6679-47bf-b777-8b88afd8cd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:15.451334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a338-6679-47bf-b777-8b88afd8cd8b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:15.451615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a338-6679-47bf-b777-8b88afd8cd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:15.451889 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2a338-6679-47bf-b777-8b88afd8cd8b None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:15.452692 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2a338-6679-47bf-b777-8b88afd8cd8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:15.453022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2a338-6679-47bf-b777-8b88afd8cd8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:15.454429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2a338-6679-47bf-b777-8b88afd8cd8b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:15.463316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 230/480] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:16.730329 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd860293-5e8a-4ce9-9d19-05df62d2e374 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:16.731368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd860293-5e8a-4ce9-9d19-05df62d2e374 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:16.731902 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd860293-5e8a-4ce9-9d19-05df62d2e374 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:16.733880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 251/481] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:16.739702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306f82d-5bac-405d-afd9-9457e1773808 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:16.740542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306f82d-5bac-405d-afd9-9457e1773808 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:16.741057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306f82d-5bac-405d-afd9-9457e1773808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:16.758480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-d306f82d-5bac-405d-afd9-9457e1773808 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:16.759926 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d306f82d-5bac-405d-afd9-9457e1773808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:16.826496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 231/482] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:16.849475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd860293-5e8a-4ce9-9d19-05df62d2e374 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:16.952566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd860293-5e8a-4ce9-9d19-05df62d2e374 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:16.988042 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee010710-3c75-4588-8c87-5629a75e8d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:16.988893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee010710-3c75-4588-8c87-5629a75e8d0d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:16.989209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee010710-3c75-4588-8c87-5629a75e8d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:16.989488 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee010710-3c75-4588-8c87-5629a75e8d0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:16.999829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee010710-3c75-4588-8c87-5629a75e8d0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ee010710-3c75-4588-8c87-5629a75e8d0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:17.007736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:17.008690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:17.009526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:17.009526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:17.009526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:17.009526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:17.009526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:17.009526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:17.009526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:17.009526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:17.009526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:17.009526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:17.009526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:17.009526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:17.009526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 252/483] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:17.015787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306f82d-5bac-405d-afd9-9457e1773808 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:17.136886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306f82d-5bac-405d-afd9-9457e1773808 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:17.172166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280a7bc-5c84-452e-893e-6f961798970e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:17.172833 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280a7bc-5c84-452e-893e-6f961798970e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:17.173147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280a7bc-5c84-452e-893e-6f961798970e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:17.173423 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280a7bc-5c84-452e-893e-6f961798970e None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:17.174176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280a7bc-5c84-452e-893e-6f961798970e None admin] RBAC: Adding query filter params (name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:17.174480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280a7bc-5c84-452e-893e-6f961798970e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:17.175858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280a7bc-5c84-452e-893e-6f961798970e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:17.185045 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 232/484] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:17.190006 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee010710-3c75-4588-8c87-5629a75e8d0d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:17.302279 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee010710-3c75-4588-8c87-5629a75e8d0d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:17.315519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c54d8-e191-462d-b747-cb19c04e242f None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:17.315812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c54d8-e191-462d-b747-cb19c04e242f None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:17.316092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c54d8-e191-462d-b747-cb19c04e242f None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:17.317722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 233/485] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:17.322522 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d14f51-9730-4095-883e-9b79d2388629 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:17.323035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d14f51-9730-4095-883e-9b79d2388629 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:17.324067 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d14f51-9730-4095-883e-9b79d2388629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:17.336495 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926d4b5-7cb5-4122-a4d9-50315f33884e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:17.337321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926d4b5-7cb5-4122-a4d9-50315f33884e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:17.337628 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926d4b5-7cb5-4122-a4d9-50315f33884e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:17.337874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926d4b5-7cb5-4122-a4d9-50315f33884e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:17.352995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926d4b5-7cb5-4122-a4d9-50315f33884e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:17.352995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926d4b5-7cb5-4122-a4d9-50315f33884e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:17.361953 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b8d14f51-9730-4095-883e-9b79d2388629 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:17.363392 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b8d14f51-9730-4095-883e-9b79d2388629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-a926d4b5-7cb5-4122-a4d9-50315f33884e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:17.367256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:17.368092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:17.368953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:17.368953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:17.368953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:17.368953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:17.368953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 253/486] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:17.374648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926d4b5-7cb5-4122-a4d9-50315f33884e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:17.476173 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926d4b5-7cb5-4122-a4d9-50315f33884e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:17.478501 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 234/487] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:17.512094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54514c-ef4b-463a-8d00-1ca64dd14b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:17.512764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54514c-ef4b-463a-8d00-1ca64dd14b18 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:17.513075 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54514c-ef4b-463a-8d00-1ca64dd14b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:17.513354 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54514c-ef4b-463a-8d00-1ca64dd14b18 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:17.514149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54514c-ef4b-463a-8d00-1ca64dd14b18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:17.514462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54514c-ef4b-463a-8d00-1ca64dd14b18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:17.515905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54514c-ef4b-463a-8d00-1ca64dd14b18 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:17.518529 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d14f51-9730-4095-883e-9b79d2388629 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:17.530914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 254/488] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:17.536437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54514c-ef4b-463a-8d00-1ca64dd14b18 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:17.636723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54514c-ef4b-463a-8d00-1ca64dd14b18 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:17.671258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0a32e-0e42-48b2-89ac-1563e9255974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:17.672051 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0a32e-0e42-48b2-89ac-1563e9255974 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:17.672333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0a32e-0e42-48b2-89ac-1563e9255974 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:17.672611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0a32e-0e42-48b2-89ac-1563e9255974 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:17.685772 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0a32e-0e42-48b2-89ac-1563e9255974 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:17.687235 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0a32e-0e42-48b2-89ac-1563e9255974 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:17.691353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d14f51-9730-4095-883e-9b79d2388629 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-2be0a32e-0e42-48b2-89ac-1563e9255974 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:17.712310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:17.713302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:17.714246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:17.714246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:17.714246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:17.714246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:17.714246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:17.714246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:17.714246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:17.714246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:17.714246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:14:17.714246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:17.714246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 255/489] 10.222.0.61 () {56 vars in 1093 bytes} [Tue May 10 20:14:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:17.715285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed0c86-598b-4562-9526-e755ff746eab None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:17.715377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed0c86-598b-4562-9526-e755ff746eab None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:17.715658 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed0c86-598b-4562-9526-e755ff746eab None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:17.721448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 256/490] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:17.722418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed0c86-598b-4562-9526-e755ff746eab None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:17.735917 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8deac-e0bc-4c67-a4ff-04e21267f183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:17.737154 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8deac-e0bc-4c67-a4ff-04e21267f183 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:17.737613 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8deac-e0bc-4c67-a4ff-04e21267f183 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:17.738428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8deac-e0bc-4c67-a4ff-04e21267f183 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:17.751969 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8deac-e0bc-4c67-a4ff-04e21267f183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-fce8deac-e0bc-4c67-a4ff-04e21267f183 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:17.762183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:17.763061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:17.763834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:17.763834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:17.763834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:17.763834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:17.763834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:17.763834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:17.763834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:17.763834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:17.763834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:17.763834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:17.763834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:17.763834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:17.771169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 235/491] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:17.771169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65886d4d-331c-47d7-af27-a7890c9ec5fb None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:17.771169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65886d4d-331c-47d7-af27-a7890c9ec5fb None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:17.771169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65886d4d-331c-47d7-af27-a7890c9ec5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:17.793238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-65886d4d-331c-47d7-af27-a7890c9ec5fb None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:17.794421 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-65886d4d-331c-47d7-af27-a7890c9ec5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:17.852073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed0c86-598b-4562-9526-e755ff746eab None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:17.872041 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 236/492] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:17.872041 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65886d4d-331c-47d7-af27-a7890c9ec5fb None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:17.906117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a7811-a0cf-4148-9b7c-59258d6e069f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:17.907098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a7811-a0cf-4148-9b7c-59258d6e069f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:17.907594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a7811-a0cf-4148-9b7c-59258d6e069f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:17.908058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a7811-a0cf-4148-9b7c-59258d6e069f None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:17.909129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a7811-a0cf-4148-9b7c-59258d6e069f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:17.909633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a7811-a0cf-4148-9b7c-59258d6e069f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:17.911273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a7811-a0cf-4148-9b7c-59258d6e069f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:17.948270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 257/493] 10.222.0.61 () {56 vars in 1133 bytes} [Tue May 10 20:14:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:17.949457 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a7811-a0cf-4148-9b7c-59258d6e069f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:17.987159 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65886d4d-331c-47d7-af27-a7890c9ec5fb None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:18.021517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6a4dd-9ddd-44b4-9228-5e489fbfa377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:18.022450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6a4dd-9ddd-44b4-9228-5e489fbfa377 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.022787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6a4dd-9ddd-44b4-9228-5e489fbfa377 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.023063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6a4dd-9ddd-44b4-9228-5e489fbfa377 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.023860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6a4dd-9ddd-44b4-9228-5e489fbfa377 None admin] RBAC: Adding query filter params (name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:18.024171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6a4dd-9ddd-44b4-9228-5e489fbfa377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:18.025563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca6a4dd-9ddd-44b4-9228-5e489fbfa377 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:18.034276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 237/494] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:18.035088 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6a4dd-9ddd-44b4-9228-5e489fbfa377 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:18.054060 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a7811-a0cf-4148-9b7c-59258d6e069f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:18.086071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18721c-c776-471a-8207-b5a3a55e60e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:18.086862 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18721c-c776-471a-8207-b5a3a55e60e8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.087144 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18721c-c776-471a-8207-b5a3a55e60e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.087408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18721c-c776-471a-8207-b5a3a55e60e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.097659 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18721c-c776-471a-8207-b5a3a55e60e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-fd18721c-c776-471a-8207-b5a3a55e60e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:18.105752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:18.106649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:18.107448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:18.107448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:18.107448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:18.107448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:18.107448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:18.107448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:18.107448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:18.107448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:18.107448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:18.107448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:18.107448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:18.107448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:18.107448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 258/495] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:18.108111 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222a431-2741-4573-89dc-3516f5706dd3 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.108642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222a431-2741-4573-89dc-3516f5706dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.108642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222a431-2741-4573-89dc-3516f5706dd3 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.110017 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 259/496] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:18.114018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222a431-2741-4573-89dc-3516f5706dd3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:18.144481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6a4dd-9ddd-44b4-9228-5e489fbfa377 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:18.185451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8a0cb-4991-43c0-925e-da0cf31218f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:18.186071 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a0cb-4991-43c0-925e-da0cf31218f8 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.186352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a0cb-4991-43c0-925e-da0cf31218f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.186625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8a0cb-4991-43c0-925e-da0cf31218f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.219678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222a431-2741-4573-89dc-3516f5706dd3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:18.252815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8a0cb-4991-43c0-925e-da0cf31218f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:18.253867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca341e2-e57e-457f-91af-ebe38361f9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:18.254659 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca341e2-e57e-457f-91af-ebe38361f9fc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.254943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca341e2-e57e-457f-91af-ebe38361f9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.255081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea8a0cb-4991-43c0-925e-da0cf31218f8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:18.255215 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca341e2-e57e-457f-91af-ebe38361f9fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.265550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca341e2-e57e-457f-91af-ebe38361f9fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:18.266998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca341e2-e57e-457f-91af-ebe38361f9fc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-dca341e2-e57e-457f-91af-ebe38361f9fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:18.284801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:18.285852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:18.287031 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:18.287031 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:18.287031 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:18.287031 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:18.287031 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 260/497] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:18.289806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca341e2-e57e-457f-91af-ebe38361f9fc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:18.356944 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 238/498] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:18.358259 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d67782-fd53-4843-9f72-d5651cdb10da None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.358552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d67782-fd53-4843-9f72-d5651cdb10da None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.358824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d67782-fd53-4843-9f72-d5651cdb10da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.373935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-c4d67782-fd53-4843-9f72-d5651cdb10da None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:18.375109 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c4d67782-fd53-4843-9f72-d5651cdb10da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:18.386775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca341e2-e57e-457f-91af-ebe38361f9fc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:18.418979 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16c1c4-4c9c-48ef-b617-53f1efc7d2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:18.419636 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16c1c4-4c9c-48ef-b617-53f1efc7d2af None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.419921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16c1c4-4c9c-48ef-b617-53f1efc7d2af None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.420198 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16c1c4-4c9c-48ef-b617-53f1efc7d2af None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.420937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16c1c4-4c9c-48ef-b617-53f1efc7d2af None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:18.421274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16c1c4-4c9c-48ef-b617-53f1efc7d2af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:18.422633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16c1c4-4c9c-48ef-b617-53f1efc7d2af None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:18.430269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 261/499] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:18.431035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16c1c4-4c9c-48ef-b617-53f1efc7d2af None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:18.438557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 239/500] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:18.439778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c6fc8-4122-4608-889e-cd44ac144ceb None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.440063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c6fc8-4122-4608-889e-cd44ac144ceb None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.440333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c6fc8-4122-4608-889e-cd44ac144ceb None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.441750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 240/501] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:18.446189 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c6fc8-4122-4608-889e-cd44ac144ceb None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:18.523755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16c1c4-4c9c-48ef-b617-53f1efc7d2af None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:18.541894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c6fc8-4122-4608-889e-cd44ac144ceb None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:18.554478 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4da65b-c24a-4fba-b57c-e878325b5182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:18.555126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4da65b-c24a-4fba-b57c-e878325b5182 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.555402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4da65b-c24a-4fba-b57c-e878325b5182 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.555670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4da65b-c24a-4fba-b57c-e878325b5182 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.556381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4da65b-c24a-4fba-b57c-e878325b5182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:18.556685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4da65b-c24a-4fba-b57c-e878325b5182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:18.558100 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4da65b-c24a-4fba-b57c-e878325b5182 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:18.569195 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 262/502] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:18.569997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4da65b-c24a-4fba-b57c-e878325b5182 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:18.577096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43568dca-7306-4d73-8cec-276c3a49ab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:18.577890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43568dca-7306-4d73-8cec-276c3a49ab46 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.578179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43568dca-7306-4d73-8cec-276c3a49ab46 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.578459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43568dca-7306-4d73-8cec-276c3a49ab46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.588327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43568dca-7306-4d73-8cec-276c3a49ab46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:18.590331 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43568dca-7306-4d73-8cec-276c3a49ab46 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-43568dca-7306-4d73-8cec-276c3a49ab46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:18.607037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:18.608052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:18.608943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:18.608943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:18.608943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:18.608943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:18.608943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 241/503] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:18.609726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49c70-ab43-4bb8-b7b6-6c2d36645916 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.610008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49c70-ab43-4bb8-b7b6-6c2d36645916 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.610280 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49c70-ab43-4bb8-b7b6-6c2d36645916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.625887 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-69b49c70-ab43-4bb8-b7b6-6c2d36645916 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:18.627028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-69b49c70-ab43-4bb8-b7b6-6c2d36645916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:18.670581 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4da65b-c24a-4fba-b57c-e878325b5182 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:18.692746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 242/504] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:18.693547 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49c70-ab43-4bb8-b7b6-6c2d36645916 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:18.704416 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef406558-b30a-44eb-9e27-550fe46f6b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:18.705323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406558-b30a-44eb-9e27-550fe46f6b36 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.705672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406558-b30a-44eb-9e27-550fe46f6b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.705950 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef406558-b30a-44eb-9e27-550fe46f6b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.715993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef406558-b30a-44eb-9e27-550fe46f6b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:18.717497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef406558-b30a-44eb-9e27-550fe46f6b36 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ef406558-b30a-44eb-9e27-550fe46f6b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:18.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:18.735190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:18.736058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:18.736058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:18.736058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:18.736058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:18.736058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 263/505] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:18.736499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef406558-b30a-44eb-9e27-550fe46f6b36 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:18.788364 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49c70-ab43-4bb8-b7b6-6c2d36645916 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:18.819887 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a20923-55d0-4e3c-9967-b56095976349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:18.820677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a20923-55d0-4e3c-9967-b56095976349 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.820957 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a20923-55d0-4e3c-9967-b56095976349 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.821255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a20923-55d0-4e3c-9967-b56095976349 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.831365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a20923-55d0-4e3c-9967-b56095976349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:18.832272 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef406558-b30a-44eb-9e27-550fe46f6b36 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-86a20923-55d0-4e3c-9967-b56095976349 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:18.838974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:18.839836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:18.840673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:18.840673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:18.840673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:18.840673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:18.840673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:18.840673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:18.840673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:18.840673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:18.840673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:18.840673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:18.840673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:18.840673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:18.840673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 243/506] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:18.841798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a20923-55d0-4e3c-9967-b56095976349 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:18.865390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b9478-beeb-4901-af19-b4450113c9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:18.866182 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b9478-beeb-4901-af19-b4450113c9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.866460 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b9478-beeb-4901-af19-b4450113c9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.866733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b9478-beeb-4901-af19-b4450113c9f4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.874000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b9478-beeb-4901-af19-b4450113c9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:18.875446 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b9478-beeb-4901-af19-b4450113c9f4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-767b9478-beeb-4901-af19-b4450113c9f4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:18.890523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:18.891408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:18.892316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:18.892316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:18.892316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:18.892316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:18.892316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:18.892316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:18.892316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:18.892316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:18.892316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 20:14:18.892316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:18.892316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 264/507] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:18.892876 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b9478-beeb-4901-af19-b4450113c9f4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:18.938981 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a20923-55d0-4e3c-9967-b56095976349 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:18.972134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee3328-3f73-46eb-a1b4-86d3bed27b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:18.972134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee3328-3f73-46eb-a1b4-86d3bed27b5f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:18.972134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee3328-3f73-46eb-a1b4-86d3bed27b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:18.972134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee3328-3f73-46eb-a1b4-86d3bed27b5f None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:18.972495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee3328-3f73-46eb-a1b4-86d3bed27b5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:18.972495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee3328-3f73-46eb-a1b4-86d3bed27b5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:18.973878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee3328-3f73-46eb-a1b4-86d3bed27b5f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:18.985954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 244/508] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:18.986770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee3328-3f73-46eb-a1b4-86d3bed27b5f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:18.989760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b9478-beeb-4901-af19-b4450113c9f4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:19.022666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef71bb8-8ece-40a7-91ad-9f3bca62422d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:19.023456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef71bb8-8ece-40a7-91ad-9f3bca62422d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:19.023744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef71bb8-8ece-40a7-91ad-9f3bca62422d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:19.024017 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef71bb8-8ece-40a7-91ad-9f3bca62422d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:19.033579 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef71bb8-8ece-40a7-91ad-9f3bca62422d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:19.035016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef71bb8-8ece-40a7-91ad-9f3bca62422d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-5ef71bb8-8ece-40a7-91ad-9f3bca62422d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:19.052273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:19.053456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:19.054403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:19.054403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:19.054403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:19.054403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:19.057277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 265/509] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:19.058552 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef71bb8-8ece-40a7-91ad-9f3bca62422d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:19.080101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee3328-3f73-46eb-a1b4-86d3bed27b5f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:19.112012 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1f0ff-259b-43a9-94f5-919b93c45f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:19.112671 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f0ff-259b-43a9-94f5-919b93c45f07 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:19.112956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f0ff-259b-43a9-94f5-919b93c45f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:19.113258 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f0ff-259b-43a9-94f5-919b93c45f07 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:19.113971 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1f0ff-259b-43a9-94f5-919b93c45f07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:19.114276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1f0ff-259b-43a9-94f5-919b93c45f07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:19.115627 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1f0ff-259b-43a9-94f5-919b93c45f07 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:19.126994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 245/510] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:19.127566 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1f0ff-259b-43a9-94f5-919b93c45f07 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:19.150665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef71bb8-8ece-40a7-91ad-9f3bca62422d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:19.184215 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604524a-ec01-4c0a-b923-6bc89ef35a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:19.184881 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604524a-ec01-4c0a-b923-6bc89ef35a13 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:19.185197 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604524a-ec01-4c0a-b923-6bc89ef35a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:19.185477 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604524a-ec01-4c0a-b923-6bc89ef35a13 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:19.186225 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604524a-ec01-4c0a-b923-6bc89ef35a13 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:19.186536 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604524a-ec01-4c0a-b923-6bc89ef35a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:19.187896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604524a-ec01-4c0a-b923-6bc89ef35a13 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:19.195620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 266/511] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:19.196406 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604524a-ec01-4c0a-b923-6bc89ef35a13 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:19.224045 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1f0ff-259b-43a9-94f5-919b93c45f07 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:19.255655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ec5b0-ab7c-45eb-888f-b83939a725e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:19.256318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ec5b0-ab7c-45eb-888f-b83939a725e4 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:19.256598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ec5b0-ab7c-45eb-888f-b83939a725e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:19.256870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ec5b0-ab7c-45eb-888f-b83939a725e4 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:19.257726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ec5b0-ab7c-45eb-888f-b83939a725e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:19.258034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ec5b0-ab7c-45eb-888f-b83939a725e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:19.259443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ec5b0-ab7c-45eb-888f-b83939a725e4 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:19.288649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604524a-ec01-4c0a-b923-6bc89ef35a13 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:19.294802 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 246/512] 10.222.0.61 () {56 vars in 1137 bytes} [Tue May 10 20:14:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:19.295601 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ec5b0-ab7c-45eb-888f-b83939a725e4 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:19.320563 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db86436-595f-41a5-8cbb-a7596441e56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:19.321381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db86436-595f-41a5-8cbb-a7596441e56d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:19.321661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db86436-595f-41a5-8cbb-a7596441e56d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:19.321952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db86436-595f-41a5-8cbb-a7596441e56d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:19.328253 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db86436-595f-41a5-8cbb-a7596441e56d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:19.329705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db86436-595f-41a5-8cbb-a7596441e56d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-9db86436-595f-41a5-8cbb-a7596441e56d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:19.343922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:19.344823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:19.345930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:19.345930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:19.345930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:19.345930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:19.345930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:19.345930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:19.345930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:19.345930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:19.345930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 267/513] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:19.346685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db86436-595f-41a5-8cbb-a7596441e56d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:19.389741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ec5b0-ab7c-45eb-888f-b83939a725e4 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:19.422800 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd1a63-dde4-4922-8b67-aa37d6038439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:19.423459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd1a63-dde4-4922-8b67-aa37d6038439 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:19.423740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd1a63-dde4-4922-8b67-aa37d6038439 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:19.424015 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd1a63-dde4-4922-8b67-aa37d6038439 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:19.424734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd1a63-dde4-4922-8b67-aa37d6038439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:19.425072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd1a63-dde4-4922-8b67-aa37d6038439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:19.426519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd1a63-dde4-4922-8b67-aa37d6038439 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:19.437621 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 247/514] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:19.438474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd1a63-dde4-4922-8b67-aa37d6038439 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:19.448249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db86436-595f-41a5-8cbb-a7596441e56d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:19.480111 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2209ce-0f3b-4e18-add8-820da4b5b2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:19.480831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2209ce-0f3b-4e18-add8-820da4b5b2df None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:19.481143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2209ce-0f3b-4e18-add8-820da4b5b2df None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:19.481429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2209ce-0f3b-4e18-add8-820da4b5b2df None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:19.488756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2209ce-0f3b-4e18-add8-820da4b5b2df None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:19.490241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2209ce-0f3b-4e18-add8-820da4b5b2df None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-1f2209ce-0f3b-4e18-add8-820da4b5b2df None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:19.505877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:19.506968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:19.508224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:19.508224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:19.508224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:19.508224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:19.508224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:19.508224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:19.508224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:19.508224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:19.508224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:14:19.508224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:19.508224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 268/515] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:19.508224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2209ce-0f3b-4e18-add8-820da4b5b2df None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:19.532584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd1a63-dde4-4922-8b67-aa37d6038439 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:19.563690 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80354a05-9161-4010-bd9b-b1852edf12c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:19.564469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80354a05-9161-4010-bd9b-b1852edf12c8 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:19.564752 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80354a05-9161-4010-bd9b-b1852edf12c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:19.565064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80354a05-9161-4010-bd9b-b1852edf12c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:19.576166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80354a05-9161-4010-bd9b-b1852edf12c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:19.577635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80354a05-9161-4010-bd9b-b1852edf12c8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-80354a05-9161-4010-bd9b-b1852edf12c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:19.594625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:19.595514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:19.596349 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:19.596349 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:19.596349 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:19.596349 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:19.596349 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 248/516] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:19.596604 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80354a05-9161-4010-bd9b-b1852edf12c8 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:19.603788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2209ce-0f3b-4e18-add8-820da4b5b2df None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:19.635757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e39dc-7943-4501-ae22-b6ed9be1cdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:19.636401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e39dc-7943-4501-ae22-b6ed9be1cdb6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:19.636688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e39dc-7943-4501-ae22-b6ed9be1cdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:19.636993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e39dc-7943-4501-ae22-b6ed9be1cdb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:19.692325 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80354a05-9161-4010-bd9b-b1852edf12c8 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:19.699387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e39dc-7943-4501-ae22-b6ed9be1cdb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:19.700860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e39dc-7943-4501-ae22-b6ed9be1cdb6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:19.724073 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc1dd3-9aab-4589-b712-f9917aac6acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:19.724738 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc1dd3-9aab-4589-b712-f9917aac6acb None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:19.725051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc1dd3-9aab-4589-b712-f9917aac6acb None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:19.725330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc1dd3-9aab-4589-b712-f9917aac6acb None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:19.726116 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc1dd3-9aab-4589-b712-f9917aac6acb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:19.726424 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc1dd3-9aab-4589-b712-f9917aac6acb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:19.727869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc1dd3-9aab-4589-b712-f9917aac6acb None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:19.746085 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 249/517] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:19.746809 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc1dd3-9aab-4589-b712-f9917aac6acb None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:19.796239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 269/518] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:19.797297 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e39dc-7943-4501-ae22-b6ed9be1cdb6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:19.839790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc1dd3-9aab-4589-b712-f9917aac6acb None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:19.870744 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67060d-8b7a-4579-bcdd-295ef730ae5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:19.871405 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67060d-8b7a-4579-bcdd-295ef730ae5f None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:19.871688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67060d-8b7a-4579-bcdd-295ef730ae5f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:19.871959 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67060d-8b7a-4579-bcdd-295ef730ae5f None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:19.872651 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67060d-8b7a-4579-bcdd-295ef730ae5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:19.874126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67060d-8b7a-4579-bcdd-295ef730ae5f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:19.888749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e39dc-7943-4501-ae22-b6ed9be1cdb6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:19.893311 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 250/519] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:14:19 2022] POST /identity/v3/users => generated 247 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:14:19.894140 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67060d-8b7a-4579-bcdd-295ef730ae5f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:19.924183 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29490cf4-b3d4-4215-bbdd-d762754e0e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:19.924864 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29490cf4-b3d4-4215-bbdd-d762754e0e5e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:19.925199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29490cf4-b3d4-4215-bbdd-d762754e0e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:19.925479 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29490cf4-b3d4-4215-bbdd-d762754e0e5e None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:19.926331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29490cf4-b3d4-4215-bbdd-d762754e0e5e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:19.926772 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29490cf4-b3d4-4215-bbdd-d762754e0e5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:19.928220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29490cf4-b3d4-4215-bbdd-d762754e0e5e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:19.946716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 270/520] 10.222.0.61 () {56 vars in 1137 bytes} [Tue May 10 20:14:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:19.947692 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29490cf4-b3d4-4215-bbdd-d762754e0e5e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:20.000731 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67060d-8b7a-4579-bcdd-295ef730ae5f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:20.035691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a93bd-8724-4288-99a1-921c17b38462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:20.036413 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a93bd-8724-4288-99a1-921c17b38462 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:20.036702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a93bd-8724-4288-99a1-921c17b38462 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:20.037115 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a93bd-8724-4288-99a1-921c17b38462 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:20.037753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a93bd-8724-4288-99a1-921c17b38462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:20.038065 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a93bd-8724-4288-99a1-921c17b38462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:20.039483 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a93bd-8724-4288-99a1-921c17b38462 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:20.052097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 251/521] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:20.053026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a93bd-8724-4288-99a1-921c17b38462 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:20.057969 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29490cf4-b3d4-4215-bbdd-d762754e0e5e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:20.094986 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249da24-c0b5-40f0-b0d5-48b23f2446c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:20.095653 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249da24-c0b5-40f0-b0d5-48b23f2446c4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:20.095941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249da24-c0b5-40f0-b0d5-48b23f2446c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:20.096250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249da24-c0b5-40f0-b0d5-48b23f2446c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:20.097097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249da24-c0b5-40f0-b0d5-48b23f2446c4 None admin] RBAC: Adding query filter params (role.id=fd14ccb80b45427381dd82c06ef844b4, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:20.097420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249da24-c0b5-40f0-b0d5-48b23f2446c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:20.098891 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249da24-c0b5-40f0-b0d5-48b23f2446c4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:20.104686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 271/522] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:19 2022] GET /identity/v3/role_assignments?user.id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=fd14ccb80b45427381dd82c06ef844b4 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:20.105521 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249da24-c0b5-40f0-b0d5-48b23f2446c4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:20.165205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a93bd-8724-4288-99a1-921c17b38462 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:20.208367 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccac0f-85f8-4775-b3e7-d261518db4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:20.209228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccac0f-85f8-4775-b3e7-d261518db4cd None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:20.209519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccac0f-85f8-4775-b3e7-d261518db4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:20.209799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccac0f-85f8-4775-b3e7-d261518db4cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:20.214881 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249da24-c0b5-40f0-b0d5-48b23f2446c4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:20.221251 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccac0f-85f8-4775-b3e7-d261518db4cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:20.222744 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccac0f-85f8-4775-b3e7-d261518db4cd None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-c4ccac0f-85f8-4775-b3e7-d261518db4cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:20.243558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:20.244694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:20.246183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:20.246183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:20.246183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:20.246183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:20.246183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 252/523] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:20.246183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccac0f-85f8-4775-b3e7-d261518db4cd None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:20.251707 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca16bb-ae58-430a-a807-5d5eb88e1803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:20.252302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca16bb-ae58-430a-a807-5d5eb88e1803 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:20.252583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca16bb-ae58-430a-a807-5d5eb88e1803 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:20.252857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca16bb-ae58-430a-a807-5d5eb88e1803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:20.325943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca16bb-ae58-430a-a807-5d5eb88e1803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:20.327385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca16bb-ae58-430a-a807-5d5eb88e1803 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:20.352185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccac0f-85f8-4775-b3e7-d261518db4cd None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:20.387565 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e606c-ce3e-427f-bb9a-f2b731dace05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:20.388374 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e606c-ce3e-427f-bb9a-f2b731dace05 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:20.388710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e606c-ce3e-427f-bb9a-f2b731dace05 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:20.389012 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217e606c-ce3e-427f-bb9a-f2b731dace05 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:20.396512 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e606c-ce3e-427f-bb9a-f2b731dace05 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:20.398265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217e606c-ce3e-427f-bb9a-f2b731dace05 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-217e606c-ce3e-427f-bb9a-f2b731dace05 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:20.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:20.416489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:20.417638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:20.417638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:20.417638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:20.417638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:20.417638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:20.417638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:20.417638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:20.417638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:20.417638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 20:14:20.417638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:20.417638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 253/524] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:20.418270 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e606c-ce3e-427f-bb9a-f2b731dace05 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:20.427615 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 272/525] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:20.428455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca16bb-ae58-430a-a807-5d5eb88e1803 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:20.518949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217e606c-ce3e-427f-bb9a-f2b731dace05 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:20.526007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca16bb-ae58-430a-a807-5d5eb88e1803 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:20.553556 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59972d-2ac8-416a-aaaf-11bd91b6de0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:20.554282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59972d-2ac8-416a-aaaf-11bd91b6de0b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:20.554570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59972d-2ac8-416a-aaaf-11bd91b6de0b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:20.554848 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59972d-2ac8-416a-aaaf-11bd91b6de0b None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:20.555649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59972d-2ac8-416a-aaaf-11bd91b6de0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:20.555958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59972d-2ac8-416a-aaaf-11bd91b6de0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:20.557361 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59972d-2ac8-416a-aaaf-11bd91b6de0b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:20.559701 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a97cfd-5d66-4b45-91bb-a3703f5cbc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:20.560371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a97cfd-5d66-4b45-91bb-a3703f5cbc5b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:20.560651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a97cfd-5d66-4b45-91bb-a3703f5cbc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:20.560924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a97cfd-5d66-4b45-91bb-a3703f5cbc5b None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:20.561782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a97cfd-5d66-4b45-91bb-a3703f5cbc5b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:20.562090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a97cfd-5d66-4b45-91bb-a3703f5cbc5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:20.563500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a97cfd-5d66-4b45-91bb-a3703f5cbc5b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:20.569664 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 254/526] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:20.570501 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59972d-2ac8-416a-aaaf-11bd91b6de0b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:20.581048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 273/527] 10.222.0.61 () {56 vars in 1139 bytes} [Tue May 10 20:14:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:20.581751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a97cfd-5d66-4b45-91bb-a3703f5cbc5b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:20.682377 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59972d-2ac8-416a-aaaf-11bd91b6de0b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:20.691917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a97cfd-5d66-4b45-91bb-a3703f5cbc5b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:20.718154 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943c89e-1176-47f1-8e38-a8787d415825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:20.718951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c89e-1176-47f1-8e38-a8787d415825 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:20.719237 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c89e-1176-47f1-8e38-a8787d415825 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:20.719518 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943c89e-1176-47f1-8e38-a8787d415825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:20.730889 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943c89e-1176-47f1-8e38-a8787d415825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:20.732339 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2943c89e-1176-47f1-8e38-a8787d415825 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:20.732926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2e999-70dd-4e2e-9ff2-383c35f04104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:20.733847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2e999-70dd-4e2e-9ff2-383c35f04104 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:20.734234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2e999-70dd-4e2e-9ff2-383c35f04104 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:20.734710 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2e999-70dd-4e2e-9ff2-383c35f04104 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:20.742856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2e999-70dd-4e2e-9ff2-383c35f04104 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:20.744393 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2e999-70dd-4e2e-9ff2-383c35f04104 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-2943c89e-1176-47f1-8e38-a8787d415825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:20.750816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:20.751830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:20.752872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:20.752872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:20.752872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:20.752872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:20.754728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 255/528] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:20.755726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943c89e-1176-47f1-8e38-a8787d415825 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-26d2e999-70dd-4e2e-9ff2-383c35f04104 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:20.761327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:20.762373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:20.763365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:20.763365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:20.763365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:20.763365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:20.763365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:20.763365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:20.763365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:20.763365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:20.769457 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 274/529] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:20.770385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2e999-70dd-4e2e-9ff2-383c35f04104 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:20.860437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943c89e-1176-47f1-8e38-a8787d415825 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:20.868835 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2e999-70dd-4e2e-9ff2-383c35f04104 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:20.895942 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a0786-bad3-4e08-ae9b-956f9aba6e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:20.896825 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a0786-bad3-4e08-ae9b-956f9aba6e5c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:20.897568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a0786-bad3-4e08-ae9b-956f9aba6e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:20.898033 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a0786-bad3-4e08-ae9b-956f9aba6e5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:20.903763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9d4df-1d04-46e7-80cf-708e1ff5473f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:20.904500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9d4df-1d04-46e7-80cf-708e1ff5473f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:20.904855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9d4df-1d04-46e7-80cf-708e1ff5473f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:20.905244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9d4df-1d04-46e7-80cf-708e1ff5473f None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:20.906035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9d4df-1d04-46e7-80cf-708e1ff5473f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:20.906410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9d4df-1d04-46e7-80cf-708e1ff5473f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:20.907854 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9d4df-1d04-46e7-80cf-708e1ff5473f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:20.920561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 275/530] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:20.921622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9d4df-1d04-46e7-80cf-708e1ff5473f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:20.972096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a0786-bad3-4e08-ae9b-956f9aba6e5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:20.972096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a0786-bad3-4e08-ae9b-956f9aba6e5c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:21.035514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9d4df-1d04-46e7-80cf-708e1ff5473f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:21.075398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aca45-43c3-4f79-8519-2d4f9b7f5dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:21.076056 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aca45-43c3-4f79-8519-2d4f9b7f5dbe None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:21.076181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 256/531] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:21.076339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aca45-43c3-4f79-8519-2d4f9b7f5dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:21.076617 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aca45-43c3-4f79-8519-2d4f9b7f5dbe None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:21.077264 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a0786-bad3-4e08-ae9b-956f9aba6e5c None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:21.077418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4aca45-43c3-4f79-8519-2d4f9b7f5dbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:21.077730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4aca45-43c3-4f79-8519-2d4f9b7f5dbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:21.079239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4aca45-43c3-4f79-8519-2d4f9b7f5dbe None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:21.102167 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 276/532] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:21.103018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aca45-43c3-4f79-8519-2d4f9b7f5dbe None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:21.200771 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a0786-bad3-4e08-ae9b-956f9aba6e5c None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:21.203243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aca45-43c3-4f79-8519-2d4f9b7f5dbe None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:21.247804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26538812-2df1-474e-9f65-c3a9ad116a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:21.248620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538812-2df1-474e-9f65-c3a9ad116a1a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:21.248904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538812-2df1-474e-9f65-c3a9ad116a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:21.249204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26538812-2df1-474e-9f65-c3a9ad116a1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:21.250485 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e485f0a-08e8-403d-896b-eddf92a55170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:21.251292 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e485f0a-08e8-403d-896b-eddf92a55170 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:21.251569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e485f0a-08e8-403d-896b-eddf92a55170 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:21.251839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e485f0a-08e8-403d-896b-eddf92a55170 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:21.265413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26538812-2df1-474e-9f65-c3a9ad116a1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:21.266884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26538812-2df1-474e-9f65-c3a9ad116a1a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:21.268087 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e485f0a-08e8-403d-896b-eddf92a55170 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:21.269772 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e485f0a-08e8-403d-896b-eddf92a55170 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-8e485f0a-08e8-403d-896b-eddf92a55170 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:21.285653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:21.286496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:21.287348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:21.287348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:21.287348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:21.287348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:21.287348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:21.287348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:21.287348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:21.287348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-26538812-2df1-474e-9f65-c3a9ad116a1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:21.287861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:21.288602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:21.290238 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:21.290238 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:21.290238 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:21.290238 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:21.290238 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 277/533] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:21.290238 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26538812-2df1-474e-9f65-c3a9ad116a1a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:21.293265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 257/534] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:21.294446 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e485f0a-08e8-403d-896b-eddf92a55170 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:21.397951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e485f0a-08e8-403d-896b-eddf92a55170 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:21.412619 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26538812-2df1-474e-9f65-c3a9ad116a1a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:21.447262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef20045-ee1d-4313-aa3a-1a8e1caf32a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:21.447501 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6749d-b358-4456-ac36-848147b6f94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:21.448679 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6749d-b358-4456-ac36-848147b6f94c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:21.448966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6749d-b358-4456-ac36-848147b6f94c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:21.449267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6749d-b358-4456-ac36-848147b6f94c None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:21.449657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef20045-ee1d-4313-aa3a-1a8e1caf32a7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:21.449995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6749d-b358-4456-ac36-848147b6f94c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:21.450305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6749d-b358-4456-ac36-848147b6f94c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:21.450578 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef20045-ee1d-4313-aa3a-1a8e1caf32a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:21.451041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef20045-ee1d-4313-aa3a-1a8e1caf32a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:21.451663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6749d-b358-4456-ac36-848147b6f94c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:21.452278 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef20045-ee1d-4313-aa3a-1a8e1caf32a7 None admin] RBAC: Adding query filter params (role.id=fd14ccb80b45427381dd82c06ef844b4, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=9f59e7ae8da841dc809355fa8e4be488) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:21.452783 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef20045-ee1d-4313-aa3a-1a8e1caf32a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:21.454508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef20045-ee1d-4313-aa3a-1a8e1caf32a7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:21.460223 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 278/535] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:21 2022] GET /identity/v3/role_assignments?user.id=9f59e7ae8da841dc809355fa8e4be488&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=fd14ccb80b45427381dd82c06ef844b4 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:21.461273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef20045-ee1d-4313-aa3a-1a8e1caf32a7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:21.466656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 258/536] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:21.474090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6749d-b358-4456-ac36-848147b6f94c None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:21.616732 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef20045-ee1d-4313-aa3a-1a8e1caf32a7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:21.660528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b353d-d1f4-4578-9aa3-3e729da6c6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:21.661613 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b353d-d1f4-4578-9aa3-3e729da6c6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:21.662100 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b353d-d1f4-4578-9aa3-3e729da6c6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:21.662572 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b353d-d1f4-4578-9aa3-3e729da6c6b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:21.663561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b353d-d1f4-4578-9aa3-3e729da6c6b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:21.664070 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b353d-d1f4-4578-9aa3-3e729da6c6b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:21.665742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b353d-d1f4-4578-9aa3-3e729da6c6b3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:21.672097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6749d-b358-4456-ac36-848147b6f94c None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:21.688615 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 279/537] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:21.694073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b353d-d1f4-4578-9aa3-3e729da6c6b3 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:21.714049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85083936-304b-42dd-90fa-5430a3c6a3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:21.715907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85083936-304b-42dd-90fa-5430a3c6a3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:21.717374 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85083936-304b-42dd-90fa-5430a3c6a3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:21.719098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85083936-304b-42dd-90fa-5430a3c6a3d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:21.729719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85083936-304b-42dd-90fa-5430a3c6a3d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:21.731805 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85083936-304b-42dd-90fa-5430a3c6a3d1 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-85083936-304b-42dd-90fa-5430a3c6a3d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:21.747406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:21.748301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:21.749187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:21.749187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:21.749187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:21.749187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:21.749187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:21.749187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:21.749187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:21.749187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:21.753092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 259/538] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:21.756998 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85083936-304b-42dd-90fa-5430a3c6a3d1 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:21.854662 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85083936-304b-42dd-90fa-5430a3c6a3d1 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:21.878386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b353d-d1f4-4578-9aa3-3e729da6c6b3 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:21.892995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4a62e-15db-4462-a2d1-dabb9c71c998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:21.892995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4a62e-15db-4462-a2d1-dabb9c71c998 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:21.892995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4a62e-15db-4462-a2d1-dabb9c71c998 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:21.892995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4a62e-15db-4462-a2d1-dabb9c71c998 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:21.893719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4a62e-15db-4462-a2d1-dabb9c71c998 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:21.893719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4a62e-15db-4462-a2d1-dabb9c71c998 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:21.893719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4a62e-15db-4462-a2d1-dabb9c71c998 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:21.910506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 260/539] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:21.911629 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4a62e-15db-4462-a2d1-dabb9c71c998 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:21.941683 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d1d07-e4be-4605-9377-aac24bebeb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:21.943034 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1d07-e4be-4605-9377-aac24bebeb54 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:21.943555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1d07-e4be-4605-9377-aac24bebeb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:21.944040 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1d07-e4be-4605-9377-aac24bebeb54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:21.945106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d1d07-e4be-4605-9377-aac24bebeb54 None admin] RBAC: Adding query filter params (role.id=fd14ccb80b45427381dd82c06ef844b4, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=f319323b3f3547849d452c1361764005) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:21.945646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d1d07-e4be-4605-9377-aac24bebeb54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:21.947337 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d1d07-e4be-4605-9377-aac24bebeb54 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:21.958576 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 280/540] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:21 2022] GET /identity/v3/role_assignments?user.id=f319323b3f3547849d452c1361764005&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=fd14ccb80b45427381dd82c06ef844b4 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:22.044367 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4a62e-15db-4462-a2d1-dabb9c71c998 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:22.087310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63673463-786d-4049-b308-501480a9296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:22.088343 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63673463-786d-4049-b308-501480a9296f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:22.088898 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63673463-786d-4049-b308-501480a9296f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:22.089423 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63673463-786d-4049-b308-501480a9296f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:22.090455 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63673463-786d-4049-b308-501480a9296f None admin] RBAC: Adding query filter params (role.id=fd14ccb80b45427381dd82c06ef844b4, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=e31558db83834034b7183223bbd0f84a) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:22.090993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63673463-786d-4049-b308-501480a9296f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:22.092636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63673463-786d-4049-b308-501480a9296f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:22.101773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 261/541] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:21 2022] GET /identity/v3/role_assignments?user.id=e31558db83834034b7183223bbd0f84a&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=fd14ccb80b45427381dd82c06ef844b4 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:22.411500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cdfd0-abd0-4d19-81a1-0dfdeb8713f0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:22.411902 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cdfd0-abd0-4d19-81a1-0dfdeb8713f0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:22.412105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cdfd0-abd0-4d19-81a1-0dfdeb8713f0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:22.413493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 281/542] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:22.420831 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668f59-8382-4eaf-97eb-532fc918b410 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:22.421442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668f59-8382-4eaf-97eb-532fc918b410 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:22.421923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69668f59-8382-4eaf-97eb-532fc918b410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:22.440923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-69668f59-8382-4eaf-97eb-532fc918b410 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:22.442473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-69668f59-8382-4eaf-97eb-532fc918b410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:22.500173 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f077-e6a0-41f9-a72c-921bfbc53ee2 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:22.500485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f077-e6a0-41f9-a72c-921bfbc53ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:22.500734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f077-e6a0-41f9-a72c-921bfbc53ee2 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:22.502483 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 282/543] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:22.509267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cdfcb-bbde-49d6-b058-7e263da6813a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:22.509553 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cdfcb-bbde-49d6-b058-7e263da6813a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:22.509831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cdfcb-bbde-49d6-b058-7e263da6813a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:22.517468 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 262/544] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:22.527665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-677cdfcb-bbde-49d6-b058-7e263da6813a None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:22.528845 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-677cdfcb-bbde-49d6-b058-7e263da6813a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:22.540955 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69668f59-8382-4eaf-97eb-532fc918b410 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:22.631276 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 283/545] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:14:22.680393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69668f59-8382-4eaf-97eb-532fc918b410 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:22.684295 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cdfcb-bbde-49d6-b058-7e263da6813a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:22.752488 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28853dfb-5071-409c-9c4d-4d7dd5af4bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:22.753721 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28853dfb-5071-409c-9c4d-4d7dd5af4bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:22.754210 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28853dfb-5071-409c-9c4d-4d7dd5af4bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:22.754681 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28853dfb-5071-409c-9c4d-4d7dd5af4bd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:22.781089 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28853dfb-5071-409c-9c4d-4d7dd5af4bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:22.797019 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677cdfcb-bbde-49d6-b058-7e263da6813a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-28853dfb-5071-409c-9c4d-4d7dd5af4bd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:22.797740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:22.798582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:22.799371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:22.799371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:22.799371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:22.799371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:22.799371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:22.799371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:22.799371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:22.799371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:22.799371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:22.799371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:22.799371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:22.799371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:22.802470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 263/546] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:22.808322 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28853dfb-5071-409c-9c4d-4d7dd5af4bd6 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:22.833193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa736b-3aec-498c-baca-f33c0200ae9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:22.835131 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa736b-3aec-498c-baca-f33c0200ae9b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:22.836373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa736b-3aec-498c-baca-f33c0200ae9b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:22.837098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa736b-3aec-498c-baca-f33c0200ae9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:22.859470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa736b-3aec-498c-baca-f33c0200ae9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-72fa736b-3aec-498c-baca-f33c0200ae9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:22.867614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:22.868497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:22.869322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:22.869322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:22.869322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:22.869322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:22.869322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:22.869322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:22.869322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:22.869322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:22.869322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:22.869322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:22.869322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:22.869322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:22.886761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 284/547] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:22.891268 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa736b-3aec-498c-baca-f33c0200ae9b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:23.002104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28853dfb-5071-409c-9c4d-4d7dd5af4bd6 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:23.044875 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa736b-3aec-498c-baca-f33c0200ae9b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:23.078276 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c90dad-aaca-4f3e-abb4-836afaff37d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:23.078942 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c90dad-aaca-4f3e-abb4-836afaff37d2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:23.079223 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c90dad-aaca-4f3e-abb4-836afaff37d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:23.079502 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c90dad-aaca-4f3e-abb4-836afaff37d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:23.080242 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c90dad-aaca-4f3e-abb4-836afaff37d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:23.080545 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c90dad-aaca-4f3e-abb4-836afaff37d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:23.081926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c90dad-aaca-4f3e-abb4-836afaff37d2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:23.091356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 285/548] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:23.096996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c90dad-aaca-4f3e-abb4-836afaff37d2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:23.098875 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c05ba-ceab-4c33-90fd-2dfce1be6328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:23.099560 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c05ba-ceab-4c33-90fd-2dfce1be6328 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:23.099837 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c05ba-ceab-4c33-90fd-2dfce1be6328 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:23.100110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c05ba-ceab-4c33-90fd-2dfce1be6328 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:23.100859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c05ba-ceab-4c33-90fd-2dfce1be6328 None admin] RBAC: Adding query filter params (name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:23.101187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c05ba-ceab-4c33-90fd-2dfce1be6328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:23.102550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c05ba-ceab-4c33-90fd-2dfce1be6328 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:23.123732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 264/549] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:23.137824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c05ba-ceab-4c33-90fd-2dfce1be6328 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:23.271595 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c05ba-ceab-4c33-90fd-2dfce1be6328 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:23.308659 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04a426-e56d-4489-8a00-29b0cc93b71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:23.309480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04a426-e56d-4489-8a00-29b0cc93b71c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:23.309761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04a426-e56d-4489-8a00-29b0cc93b71c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:23.310032 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04a426-e56d-4489-8a00-29b0cc93b71c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:23.311406 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c90dad-aaca-4f3e-abb4-836afaff37d2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:23.321391 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04a426-e56d-4489-8a00-29b0cc93b71c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:23.328998 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04a426-e56d-4489-8a00-29b0cc93b71c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-bf04a426-e56d-4489-8a00-29b0cc93b71c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:23.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:23.342924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:23.343763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:23.343763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:23.343763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:23.343763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:23.343763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 265/550] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:23.352502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04a426-e56d-4489-8a00-29b0cc93b71c None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:23.375049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7cbb3-a9be-47f8-882d-63a3e32d9ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:23.375842 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7cbb3-a9be-47f8-882d-63a3e32d9ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:23.376122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7cbb3-a9be-47f8-882d-63a3e32d9ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:23.376397 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7cbb3-a9be-47f8-882d-63a3e32d9ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:23.394625 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7cbb3-a9be-47f8-882d-63a3e32d9ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:23.396103 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7cbb3-a9be-47f8-882d-63a3e32d9ed1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-2ed7cbb3-a9be-47f8-882d-63a3e32d9ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:23.434401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:23.435324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:23.436163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:23.436163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:23.436163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:23.436163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:23.436839 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 286/551] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:23.440997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7cbb3-a9be-47f8-882d-63a3e32d9ed1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:23.538029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04a426-e56d-4489-8a00-29b0cc93b71c None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:23.579611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a62c99-b9fc-4902-b1ec-ca50daf96060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:23.580296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a62c99-b9fc-4902-b1ec-ca50daf96060 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:23.580576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a62c99-b9fc-4902-b1ec-ca50daf96060 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:23.580847 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a62c99-b9fc-4902-b1ec-ca50daf96060 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:23.581628 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a62c99-b9fc-4902-b1ec-ca50daf96060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:23.581935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a62c99-b9fc-4902-b1ec-ca50daf96060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:23.583423 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a62c99-b9fc-4902-b1ec-ca50daf96060 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:23.613054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 266/552] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:23.614093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a62c99-b9fc-4902-b1ec-ca50daf96060 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:23.623367 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7cbb3-a9be-47f8-882d-63a3e32d9ed1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:23.706680 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d3fed-38a7-4daa-b19d-2aac8bc657a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:23.707362 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d3fed-38a7-4daa-b19d-2aac8bc657a4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:23.707642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d3fed-38a7-4daa-b19d-2aac8bc657a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:23.707916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d3fed-38a7-4daa-b19d-2aac8bc657a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:23.708650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d3fed-38a7-4daa-b19d-2aac8bc657a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:23.708958 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d3fed-38a7-4daa-b19d-2aac8bc657a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:23.710366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d3fed-38a7-4daa-b19d-2aac8bc657a4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:23.731338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a62c99-b9fc-4902-b1ec-ca50daf96060 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:23.736640 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 287/553] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:23.753143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d3fed-38a7-4daa-b19d-2aac8bc657a4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:23.774463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ccdf3-85d9-460a-afa9-cc0cc143afd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:23.775267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ccdf3-85d9-460a-afa9-cc0cc143afd5 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:23.775548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ccdf3-85d9-460a-afa9-cc0cc143afd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:23.775818 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ccdf3-85d9-460a-afa9-cc0cc143afd5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:23.784283 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ccdf3-85d9-460a-afa9-cc0cc143afd5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:23.785811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ccdf3-85d9-460a-afa9-cc0cc143afd5 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-a87ccdf3-85d9-460a-afa9-cc0cc143afd5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:23.801252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:23.802362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:23.803476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:23.803476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:23.803476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:23.803476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:23.803476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:23.803476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:23.803476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:23.803476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:23.803476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:14:23.803476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:23.803476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 267/554] 10.222.0.61 () {56 vars in 1093 bytes} [Tue May 10 20:14:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:23.808383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ccdf3-85d9-460a-afa9-cc0cc143afd5 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:23.954747 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ccdf3-85d9-460a-afa9-cc0cc143afd5 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:23.954966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d3fed-38a7-4daa-b19d-2aac8bc657a4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:23.990778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36115e5a-cbf0-47a0-8aaf-5bcaf59f5502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:23.991631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36115e5a-cbf0-47a0-8aaf-5bcaf59f5502 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:23.992052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36115e5a-cbf0-47a0-8aaf-5bcaf59f5502 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:23.992489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36115e5a-cbf0-47a0-8aaf-5bcaf59f5502 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:23.993605 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36115e5a-cbf0-47a0-8aaf-5bcaf59f5502 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:23.994054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36115e5a-cbf0-47a0-8aaf-5bcaf59f5502 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:23.995870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36115e5a-cbf0-47a0-8aaf-5bcaf59f5502 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:23.996622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c2202-6c6e-4d62-882d-c94a22c4e348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:23.997790 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c2202-6c6e-4d62-882d-c94a22c4e348 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:23.998999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c2202-6c6e-4d62-882d-c94a22c4e348 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:23.999428 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c2202-6c6e-4d62-882d-c94a22c4e348 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.008116 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c2202-6c6e-4d62-882d-c94a22c4e348 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:24.010243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c2202-6c6e-4d62-882d-c94a22c4e348 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:24.017013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 268/555] 10.222.0.61 () {56 vars in 1133 bytes} [Tue May 10 20:14:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:24.017013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582cc14-7560-4488-975e-1dae6f01b59c None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:24.017013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582cc14-7560-4488-975e-1dae6f01b59c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:24.017013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582cc14-7560-4488-975e-1dae6f01b59c None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.017013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 269/556] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:24.019062 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582cc14-7560-4488-975e-1dae6f01b59c None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-066c2202-6c6e-4d62-882d-c94a22c4e348 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:24.032494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:24.033480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:24.034368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:24.034368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:24.034368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:24.034368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:24.034368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:24.034368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:24.034368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:24.034368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:24.034368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 20:14:24.034368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:24.037330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 288/557] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:14:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:24.043555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddccf1-bb65-4014-b7ea-7bec7d2031f2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:24.044069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddccf1-bb65-4014-b7ea-7bec7d2031f2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:24.044531 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddccf1-bb65-4014-b7ea-7bec7d2031f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.061473 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d6ddccf1-bb65-4014-b7ea-7bec7d2031f2 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:24.063283 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d6ddccf1-bb65-4014-b7ea-7bec7d2031f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:24.129203 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 289/558] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:24.130317 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddccf1-bb65-4014-b7ea-7bec7d2031f2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:24.160375 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582cc14-7560-4488-975e-1dae6f01b59c None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:24.205284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12fb80-1089-4beb-a9c1-8eefa3f0c1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:24.206076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12fb80-1089-4beb-a9c1-8eefa3f0c1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:24.206355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12fb80-1089-4beb-a9c1-8eefa3f0c1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:24.206623 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12fb80-1089-4beb-a9c1-8eefa3f0c1a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.222567 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12fb80-1089-4beb-a9c1-8eefa3f0c1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:24.224345 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12fb80-1089-4beb-a9c1-8eefa3f0c1a7 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-cb12fb80-1089-4beb-a9c1-8eefa3f0c1a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:24.248707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:24.249640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:24.250473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:24.250473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:24.250473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:24.250473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:24.257660 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 270/559] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:24.258256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12fb80-1089-4beb-a9c1-8eefa3f0c1a7 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:24.265233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddccf1-bb65-4014-b7ea-7bec7d2031f2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:24.299655 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefc267-6c7f-4313-a26d-976c8e427bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:24.300332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefc267-6c7f-4313-a26d-976c8e427bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:24.300611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefc267-6c7f-4313-a26d-976c8e427bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:24.300889 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefc267-6c7f-4313-a26d-976c8e427bf9 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.301851 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefc267-6c7f-4313-a26d-976c8e427bf9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:24.302052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefc267-6c7f-4313-a26d-976c8e427bf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:24.303637 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefc267-6c7f-4313-a26d-976c8e427bf9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:24.325303 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 290/560] 10.222.0.61 () {56 vars in 1135 bytes} [Tue May 10 20:14:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:24.326117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefc267-6c7f-4313-a26d-976c8e427bf9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:24.376117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12fb80-1089-4beb-a9c1-8eefa3f0c1a7 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:24.411118 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29eacb-8b42-469e-93fb-6ffb5b913819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:24.412271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29eacb-8b42-469e-93fb-6ffb5b913819 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:24.412797 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29eacb-8b42-469e-93fb-6ffb5b913819 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:24.413301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29eacb-8b42-469e-93fb-6ffb5b913819 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.426313 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29eacb-8b42-469e-93fb-6ffb5b913819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:24.430621 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefc267-6c7f-4313-a26d-976c8e427bf9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-bc29eacb-8b42-469e-93fb-6ffb5b913819 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:24.436281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:24.437205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:24.438506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:24.438506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:24.438506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:24.438506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:24.438506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:24.438506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:24.438506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:24.438506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:24.438506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:24.438506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:24.438506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:24.438506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:24.445322 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 271/561] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:24.446465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29eacb-8b42-469e-93fb-6ffb5b913819 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:24.466582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa0110-c8d2-4482-b4bc-7d754eca6cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:24.467347 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa0110-c8d2-4482-b4bc-7d754eca6cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:24.467630 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa0110-c8d2-4482-b4bc-7d754eca6cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:24.467904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa0110-c8d2-4482-b4bc-7d754eca6cc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.468710 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa0110-c8d2-4482-b4bc-7d754eca6cc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:24.469081 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa0110-c8d2-4482-b4bc-7d754eca6cc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:24.470467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa0110-c8d2-4482-b4bc-7d754eca6cc8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:24.482855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 291/562] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:24.488056 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa0110-c8d2-4482-b4bc-7d754eca6cc8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:24.554607 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29eacb-8b42-469e-93fb-6ffb5b913819 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:24.591486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5042d2-39ee-4d10-8ba4-cac530bec379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:24.592550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5042d2-39ee-4d10-8ba4-cac530bec379 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:24.593091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5042d2-39ee-4d10-8ba4-cac530bec379 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:24.593579 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5042d2-39ee-4d10-8ba4-cac530bec379 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.595751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa0110-c8d2-4482-b4bc-7d754eca6cc8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:24.631320 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72548026-f8f8-458d-b509-02221b240a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:24.631649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72548026-f8f8-458d-b509-02221b240a99 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:24.631930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72548026-f8f8-458d-b509-02221b240a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:24.632261 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72548026-f8f8-458d-b509-02221b240a99 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.633037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72548026-f8f8-458d-b509-02221b240a99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:24.633444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72548026-f8f8-458d-b509-02221b240a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:24.634830 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72548026-f8f8-458d-b509-02221b240a99 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:24.648606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 292/563] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:24.648606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72548026-f8f8-458d-b509-02221b240a99 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:24.671954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5042d2-39ee-4d10-8ba4-cac530bec379 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:24.673801 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5042d2-39ee-4d10-8ba4-cac530bec379 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:24.752337 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72548026-f8f8-458d-b509-02221b240a99 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:24.784607 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 272/564] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:24.784812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66541a38-8a5e-4eda-b3e0-868f55c0b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:24.785834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66541a38-8a5e-4eda-b3e0-868f55c0b6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:24.785960 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5042d2-39ee-4d10-8ba4-cac530bec379 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:24.786121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66541a38-8a5e-4eda-b3e0-868f55c0b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:24.786407 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66541a38-8a5e-4eda-b3e0-868f55c0b6a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.793809 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66541a38-8a5e-4eda-b3e0-868f55c0b6a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:24.795234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66541a38-8a5e-4eda-b3e0-868f55c0b6a6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-66541a38-8a5e-4eda-b3e0-868f55c0b6a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:24.808888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:24.809873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:24.810823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:24.810823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:24.810823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:24.810823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:24.810823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:24.810823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:24.810823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:24.810823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:24.810823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 293/565] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:24.811724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd114d-6eac-4e5e-8006-96b558344325 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:24.811937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd114d-6eac-4e5e-8006-96b558344325 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:24.812213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd114d-6eac-4e5e-8006-96b558344325 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.813465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 294/566] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:24.815745 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4728609-8b86-42ff-8f2b-407a6071bb36 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:24.816069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4728609-8b86-42ff-8f2b-407a6071bb36 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:24.816348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4728609-8b86-42ff-8f2b-407a6071bb36 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.817795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 295/567] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:24.818490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4728609-8b86-42ff-8f2b-407a6071bb36 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:24.883518 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5042d2-39ee-4d10-8ba4-cac530bec379 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:24.912805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4728609-8b86-42ff-8f2b-407a6071bb36 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:24.915469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c8d7b-e94b-42c0-a645-934bb2729017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:24.916344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c8d7b-e94b-42c0-a645-934bb2729017 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:24.916735 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c8d7b-e94b-42c0-a645-934bb2729017 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:24.917119 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c8d7b-e94b-42c0-a645-934bb2729017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.927192 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c8d7b-e94b-42c0-a645-934bb2729017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:24.928608 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c8d7b-e94b-42c0-a645-934bb2729017 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:24.944284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47a937-8653-4993-8c21-47ee810c014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:24.945082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47a937-8653-4993-8c21-47ee810c014b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-142c8d7b-e94b-42c0-a645-934bb2729017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:24.945310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:24.946157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:24.947092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:24.947092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:24.947092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:24.947092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:24.947317 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47a937-8653-4993-8c21-47ee810c014b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:24.947317 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47a937-8653-4993-8c21-47ee810c014b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.947446 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 273/568] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:24.947446 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c8d7b-e94b-42c0-a645-934bb2729017 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:24.956120 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47a937-8653-4993-8c21-47ee810c014b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:24.957689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47a937-8653-4993-8c21-47ee810c014b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-7c47a937-8653-4993-8c21-47ee810c014b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:24.976486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:24.977467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:24.978691 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:24.978691 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:24.978691 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:24.978691 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:24.978691 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 296/569] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:24.979198 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ae3b0-e0bd-4e07-bf3f-c36bfaf1669d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:24.979998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ae3b0-e0bd-4e07-bf3f-c36bfaf1669d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:24.980272 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ae3b0-e0bd-4e07-bf3f-c36bfaf1669d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:24.995995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9e1ae3b0-e0bd-4e07-bf3f-c36bfaf1669d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:24.997179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9e1ae3b0-e0bd-4e07-bf3f-c36bfaf1669d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:25.046375 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c8d7b-e94b-42c0-a645-934bb2729017 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:25.058469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 297/570] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:25.059700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b27677-a00a-4d2e-b7d3-8016319a7068 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:25.059988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b27677-a00a-4d2e-b7d3-8016319a7068 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:25.060516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b27677-a00a-4d2e-b7d3-8016319a7068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:25.075858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b5b27677-a00a-4d2e-b7d3-8016319a7068 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:25.077036 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b5b27677-a00a-4d2e-b7d3-8016319a7068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:25.079281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d020b64-1352-4d70-b329-28388b4e4d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:25.079938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d020b64-1352-4d70-b329-28388b4e4d22 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:25.080304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d020b64-1352-4d70-b329-28388b4e4d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:25.080580 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d020b64-1352-4d70-b329-28388b4e4d22 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:25.081384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d020b64-1352-4d70-b329-28388b4e4d22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:25.081691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d020b64-1352-4d70-b329-28388b4e4d22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:25.083102 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d020b64-1352-4d70-b329-28388b4e4d22 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:25.094737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 274/571] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:25.095509 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d020b64-1352-4d70-b329-28388b4e4d22 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:25.139319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 298/572] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:25.140072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b27677-a00a-4d2e-b7d3-8016319a7068 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:25.186897 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d020b64-1352-4d70-b329-28388b4e4d22 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:25.218343 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03840c55-339a-4ac9-a180-96b9fbdf0844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:25.218994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03840c55-339a-4ac9-a180-96b9fbdf0844 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:25.219271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03840c55-339a-4ac9-a180-96b9fbdf0844 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:25.219542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03840c55-339a-4ac9-a180-96b9fbdf0844 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:25.220284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03840c55-339a-4ac9-a180-96b9fbdf0844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:25.220590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03840c55-339a-4ac9-a180-96b9fbdf0844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:25.221984 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03840c55-339a-4ac9-a180-96b9fbdf0844 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:25.232158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b27677-a00a-4d2e-b7d3-8016319a7068 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:25.233690 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 275/573] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:25.234468 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03840c55-339a-4ac9-a180-96b9fbdf0844 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:25.264081 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756dd20-75a7-4b42-9f58-15c9c12d2113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:25.264740 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756dd20-75a7-4b42-9f58-15c9c12d2113 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:25.265045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756dd20-75a7-4b42-9f58-15c9c12d2113 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:25.265319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756dd20-75a7-4b42-9f58-15c9c12d2113 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:25.266023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756dd20-75a7-4b42-9f58-15c9c12d2113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:25.266328 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756dd20-75a7-4b42-9f58-15c9c12d2113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:25.267682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756dd20-75a7-4b42-9f58-15c9c12d2113 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:25.279053 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 299/574] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:25.279859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756dd20-75a7-4b42-9f58-15c9c12d2113 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:25.332641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03840c55-339a-4ac9-a180-96b9fbdf0844 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:25.364128 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c24809-9371-4963-a00a-033f6913fe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:25.364908 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c24809-9371-4963-a00a-033f6913fe14 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:25.365221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c24809-9371-4963-a00a-033f6913fe14 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:25.365493 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c24809-9371-4963-a00a-033f6913fe14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:25.369260 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756dd20-75a7-4b42-9f58-15c9c12d2113 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:25.375703 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c24809-9371-4963-a00a-033f6913fe14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-15c24809-9371-4963-a00a-033f6913fe14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:25.383256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:25.384369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:25.385257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:25.385257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:25.385257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:25.385257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:25.385257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:25.385257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:25.385257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:25.385257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:25.385257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:25.385257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:25.385257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:25.385257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:25.385257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 276/575] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:25.385257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c24809-9371-4963-a00a-033f6913fe14 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:25.403234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a616e8-4c41-4181-966d-5ab7e82c33ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:25.404049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a616e8-4c41-4181-966d-5ab7e82c33ac None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:25.404328 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a616e8-4c41-4181-966d-5ab7e82c33ac None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:25.404600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a616e8-4c41-4181-966d-5ab7e82c33ac None admin] PATH_INFO: `/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/8c3c6fe7e21c4c1ebc01cf91c3c05c4f/roles/fd14ccb80b45427381dd82c06ef844b4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:25.418982 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a616e8-4c41-4181-966d-5ab7e82c33ac None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b37547e1bf4906b65ac39aad3a608c, user_id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f, role_id=fd14ccb80b45427381dd82c06ef844b4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:25.420409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a616e8-4c41-4181-966d-5ab7e82c33ac None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:25.432213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 300/576] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:14:25 2022] PUT /identity/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/8c3c6fe7e21c4c1ebc01cf91c3c05c4f/roles/fd14ccb80b45427381dd82c06ef844b4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:14:25.433527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a616e8-4c41-4181-966d-5ab7e82c33ac None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:25.501421 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c24809-9371-4963-a00a-033f6913fe14 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:25.536507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e063de2-1bea-4573-9472-6eb741b05273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:25.536904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a616e8-4c41-4181-966d-5ab7e82c33ac None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:25.537335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e063de2-1bea-4573-9472-6eb741b05273 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:25.537618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e063de2-1bea-4573-9472-6eb741b05273 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:25.537889 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e063de2-1bea-4573-9472-6eb741b05273 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:25.548987 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e063de2-1bea-4573-9472-6eb741b05273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-5e063de2-1bea-4573-9472-6eb741b05273 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:25.556812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:25.558431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:25.559269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:25.559269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:25.559269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:25.559269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:25.559269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:25.559269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:25.559269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:25.559269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:25.559269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:25.559269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:25.559269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:25.559269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:25.559269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 277/577] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:25.560567 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e063de2-1bea-4573-9472-6eb741b05273 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:25.578220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e5651-9355-4d8f-9b79-266977d83053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:25.579032 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e5651-9355-4d8f-9b79-266977d83053 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:25.579377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e5651-9355-4d8f-9b79-266977d83053 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:25.579650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e5651-9355-4d8f-9b79-266977d83053 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:25.588118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e5651-9355-4d8f-9b79-266977d83053 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:25.589705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e5651-9355-4d8f-9b79-266977d83053 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ea2e5651-9355-4d8f-9b79-266977d83053 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:25.604742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:25.605817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:25.606774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:25.606774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:25.606774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:25.606774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:25.606774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:25.606774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:25.606774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:25.606774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:25.606774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 20:14:25.606774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:25.606774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 301/578] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:25.606774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e5651-9355-4d8f-9b79-266977d83053 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:25.672470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e063de2-1bea-4573-9472-6eb741b05273 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:25.705268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e96ef-0aa4-4214-91b5-2f443baa8048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:25.705706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e5651-9355-4d8f-9b79-266977d83053 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:25.706064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e96ef-0aa4-4214-91b5-2f443baa8048 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:25.706345 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e96ef-0aa4-4214-91b5-2f443baa8048 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:25.706617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e96ef-0aa4-4214-91b5-2f443baa8048 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:25.713846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e96ef-0aa4-4214-91b5-2f443baa8048 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:25.715327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e96ef-0aa4-4214-91b5-2f443baa8048 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-ce4e96ef-0aa4-4214-91b5-2f443baa8048 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:25.729842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:25.730743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:25.731614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:25.731614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:25.731614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:25.731614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:25.731614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:25.731614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:25.731614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:25.731614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:25.731614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 278/579] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:25.732095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e96ef-0aa4-4214-91b5-2f443baa8048 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:25.743947 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612b7c6-9392-42da-9e3f-bdc15fcd8b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:25.744625 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612b7c6-9392-42da-9e3f-bdc15fcd8b49 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:25.745504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612b7c6-9392-42da-9e3f-bdc15fcd8b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:25.745790 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612b7c6-9392-42da-9e3f-bdc15fcd8b49 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:25.746557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612b7c6-9392-42da-9e3f-bdc15fcd8b49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:25.746845 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612b7c6-9392-42da-9e3f-bdc15fcd8b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:25.748207 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612b7c6-9392-42da-9e3f-bdc15fcd8b49 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:25.760390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 302/580] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:25.760390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612b7c6-9392-42da-9e3f-bdc15fcd8b49 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:25.833593 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e96ef-0aa4-4214-91b5-2f443baa8048 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:25.852637 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612b7c6-9392-42da-9e3f-bdc15fcd8b49 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:25.866576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85c173-0dea-43b3-a438-e640db528e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:25.867244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85c173-0dea-43b3-a438-e640db528e65 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:25.867531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85c173-0dea-43b3-a438-e640db528e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:25.867806 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85c173-0dea-43b3-a438-e640db528e65 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:25.868551 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85c173-0dea-43b3-a438-e640db528e65 None admin] RBAC: Adding query filter params (name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:25.868858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85c173-0dea-43b3-a438-e640db528e65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:25.870830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85c173-0dea-43b3-a438-e640db528e65 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:25.883206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 279/581] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:25.883206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85c173-0dea-43b3-a438-e640db528e65 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:25.890229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d7758-806d-4b6c-9211-5ff0cf048182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:25.890904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d7758-806d-4b6c-9211-5ff0cf048182 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:25.891185 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d7758-806d-4b6c-9211-5ff0cf048182 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:25.891458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d7758-806d-4b6c-9211-5ff0cf048182 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:25.892285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d7758-806d-4b6c-9211-5ff0cf048182 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:25.892592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d7758-806d-4b6c-9211-5ff0cf048182 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:25.894072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d7758-806d-4b6c-9211-5ff0cf048182 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:25.911710 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 303/582] 10.222.0.61 () {56 vars in 1137 bytes} [Tue May 10 20:14:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:25.912533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d7758-806d-4b6c-9211-5ff0cf048182 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:25.981698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85c173-0dea-43b3-a438-e640db528e65 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:26.008315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d7758-806d-4b6c-9211-5ff0cf048182 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:26.014867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23b0df-fbb1-4173-b32c-ec03ff919ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:26.015537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23b0df-fbb1-4173-b32c-ec03ff919ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:26.015820 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23b0df-fbb1-4173-b32c-ec03ff919ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:26.016099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23b0df-fbb1-4173-b32c-ec03ff919ac5 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:26.016877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23b0df-fbb1-4173-b32c-ec03ff919ac5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:26.017220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23b0df-fbb1-4173-b32c-ec03ff919ac5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:26.018647 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23b0df-fbb1-4173-b32c-ec03ff919ac5 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:26.036004 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 280/583] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:26.036004 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23b0df-fbb1-4173-b32c-ec03ff919ac5 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:26.040568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fa672-2010-49b8-b263-434c59afcb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:26.041391 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fa672-2010-49b8-b263-434c59afcb9f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:26.042206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fa672-2010-49b8-b263-434c59afcb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:26.042481 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fa672-2010-49b8-b263-434c59afcb9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:26.052566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fa672-2010-49b8-b263-434c59afcb9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:26.054115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fa672-2010-49b8-b263-434c59afcb9f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-fe4fa672-2010-49b8-b263-434c59afcb9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:26.071415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:26.072291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:26.078666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:26.078666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:26.078666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:26.078666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:26.078666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 304/584] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:26.078666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fa672-2010-49b8-b263-434c59afcb9f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:26.145003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23b0df-fbb1-4173-b32c-ec03ff919ac5 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:26.173661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fa672-2010-49b8-b263-434c59afcb9f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:26.180607 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d3b54-6b15-413d-9623-b2cf1979f27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:26.180607 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d3b54-6b15-413d-9623-b2cf1979f27d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:26.180607 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d3b54-6b15-413d-9623-b2cf1979f27d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:26.180607 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d3b54-6b15-413d-9623-b2cf1979f27d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:26.190608 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d3b54-6b15-413d-9623-b2cf1979f27d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:26.192141 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d3b54-6b15-413d-9623-b2cf1979f27d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:26.206169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97280e-af81-4c0f-9a8f-8ca5a4e1d0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:26.206962 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97280e-af81-4c0f-9a8f-8ca5a4e1d0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:26.207245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97280e-af81-4c0f-9a8f-8ca5a4e1d0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:26.207518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97280e-af81-4c0f-9a8f-8ca5a4e1d0c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-0d6d3b54-6b15-413d-9623-b2cf1979f27d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:26.210373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:26.211217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:26.212163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:26.212163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:26.212163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:26.212163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:26.217625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 281/585] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:26.218493 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d3b54-6b15-413d-9623-b2cf1979f27d None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:26.219349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97280e-af81-4c0f-9a8f-8ca5a4e1d0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:26.220873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97280e-af81-4c0f-9a8f-8ca5a4e1d0c2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-dc97280e-af81-4c0f-9a8f-8ca5a4e1d0c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:26.239045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:26.239944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:26.240822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:26.240822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:26.240822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:26.240822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:26.240822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 305/586] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:26.241128 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97280e-af81-4c0f-9a8f-8ca5a4e1d0c2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:26.342432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d3b54-6b15-413d-9623-b2cf1979f27d None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:26.346943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97280e-af81-4c0f-9a8f-8ca5a4e1d0c2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:26.377387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6515a3-706e-4664-84b8-f213891942db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:26.378496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6515a3-706e-4664-84b8-f213891942db None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:26.378979 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6515a3-706e-4664-84b8-f213891942db None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:26.379452 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6515a3-706e-4664-84b8-f213891942db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:26.380649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6515a3-706e-4664-84b8-f213891942db None admin] RBAC: Adding query filter params (role.id=fd14ccb80b45427381dd82c06ef844b4, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=6acfba37d6b84bf3a63d40e6e4096f5d) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:26.381094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3846d-ecae-46dc-8b52-ff0e032ee1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:26.381460 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6515a3-706e-4664-84b8-f213891942db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:26.381755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3846d-ecae-46dc-8b52-ff0e032ee1cb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:26.382040 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3846d-ecae-46dc-8b52-ff0e032ee1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:26.382321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3846d-ecae-46dc-8b52-ff0e032ee1cb None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:26.383064 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3846d-ecae-46dc-8b52-ff0e032ee1cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:26.383363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3846d-ecae-46dc-8b52-ff0e032ee1cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:26.384172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6515a3-706e-4664-84b8-f213891942db None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:26.384700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3846d-ecae-46dc-8b52-ff0e032ee1cb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:26.397544 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 282/587] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:26 2022] GET /identity/v3/role_assignments?user.id=6acfba37d6b84bf3a63d40e6e4096f5d&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=fd14ccb80b45427381dd82c06ef844b4 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:26.398823 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6515a3-706e-4664-84b8-f213891942db None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:26.405012 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 306/588] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:26.405012 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3846d-ecae-46dc-8b52-ff0e032ee1cb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:26.523750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6515a3-706e-4664-84b8-f213891942db None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:26.548119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3846d-ecae-46dc-8b52-ff0e032ee1cb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:26.596996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d701e-a9bf-4480-bb1f-927b9645ebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:26.596996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d701e-a9bf-4480-bb1f-927b9645ebf2 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:26.596996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d701e-a9bf-4480-bb1f-927b9645ebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:26.596996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d701e-a9bf-4480-bb1f-927b9645ebf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:26.597425 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d701e-a9bf-4480-bb1f-927b9645ebf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:26.599317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d701e-a9bf-4480-bb1f-927b9645ebf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:26.601716 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d701e-a9bf-4480-bb1f-927b9645ebf2 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:26.609007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aae0f9-b302-4ca2-a008-b3eddd24fd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:26.609007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae0f9-b302-4ca2-a008-b3eddd24fd7b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:26.609007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae0f9-b302-4ca2-a008-b3eddd24fd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:26.609007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae0f9-b302-4ca2-a008-b3eddd24fd7b None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:26.609429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aae0f9-b302-4ca2-a008-b3eddd24fd7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:26.609429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aae0f9-b302-4ca2-a008-b3eddd24fd7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:26.609429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aae0f9-b302-4ca2-a008-b3eddd24fd7b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:26.630484 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 283/589] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:26.630484 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d701e-a9bf-4480-bb1f-927b9645ebf2 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:26.630737 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 307/590] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:26.630737 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aae0f9-b302-4ca2-a008-b3eddd24fd7b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:26.737691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d701e-a9bf-4480-bb1f-927b9645ebf2 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:26.782620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aae0f9-b302-4ca2-a008-b3eddd24fd7b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:26.784816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4998e06-7a95-4bdd-a264-7e02a50ae60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:26.786460 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4998e06-7a95-4bdd-a264-7e02a50ae60d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:26.786743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4998e06-7a95-4bdd-a264-7e02a50ae60d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:26.787015 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4998e06-7a95-4bdd-a264-7e02a50ae60d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:26.796423 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4998e06-7a95-4bdd-a264-7e02a50ae60d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:26.798579 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4998e06-7a95-4bdd-a264-7e02a50ae60d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:26.815807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd06cc-c151-461b-9913-f627b4f2978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-a4998e06-7a95-4bdd-a264-7e02a50ae60d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:26.816296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:26.817257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:26.818222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:26.818222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:26.818222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:26.818222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:26.818222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:26.818222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:26.818222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:26.818222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:26.818222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 20:14:26.818222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:26.818765 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd06cc-c151-461b-9913-f627b4f2978d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:26.818765 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd06cc-c151-461b-9913-f627b4f2978d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:26.818765 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd06cc-c151-461b-9913-f627b4f2978d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:26.818946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 284/591] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:26.818946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4998e06-7a95-4bdd-a264-7e02a50ae60d None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:26.826188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd06cc-c151-461b-9913-f627b4f2978d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:26.827765 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd06cc-c151-461b-9913-f627b4f2978d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-99bd06cc-c151-461b-9913-f627b4f2978d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:26.842567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:26.844220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:26.846232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:26.846232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:26.846232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:26.846232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:26.846232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:26.846232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:26.846232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:26.846232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:26.846232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:14:26.846232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:26.846232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 308/592] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:26.847635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd06cc-c151-461b-9913-f627b4f2978d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:26.928348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4998e06-7a95-4bdd-a264-7e02a50ae60d None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:26.945954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd06cc-c151-461b-9913-f627b4f2978d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:26.961900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b6054-9798-4f48-84a2-2628ca06968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:26.962695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b6054-9798-4f48-84a2-2628ca06968b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:26.962969 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b6054-9798-4f48-84a2-2628ca06968b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:26.963243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b6054-9798-4f48-84a2-2628ca06968b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:26.970105 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b6054-9798-4f48-84a2-2628ca06968b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:26.971562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b6054-9798-4f48-84a2-2628ca06968b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:26.986703 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e266af-1a00-4e21-8900-0b5ce942f5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-d96b6054-9798-4f48-84a2-2628ca06968b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:26.986916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:26.988815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:26.990985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:26.990985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:26.990985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:26.990985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:26.990985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:26.990985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:26.990985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:26.990985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:26.991990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e266af-1a00-4e21-8900-0b5ce942f5fb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:26.991990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e266af-1a00-4e21-8900-0b5ce942f5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:26.991990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e266af-1a00-4e21-8900-0b5ce942f5fb None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:26.992401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 285/593] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:26.992564 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e266af-1a00-4e21-8900-0b5ce942f5fb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:26.992564 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e266af-1a00-4e21-8900-0b5ce942f5fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:26.997199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b6054-9798-4f48-84a2-2628ca06968b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:26.997298 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e266af-1a00-4e21-8900-0b5ce942f5fb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:27.009013 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 309/594] 10.222.0.61 () {56 vars in 1139 bytes} [Tue May 10 20:14:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:27.010122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e266af-1a00-4e21-8900-0b5ce942f5fb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:27.090287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b6054-9798-4f48-84a2-2628ca06968b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:27.109071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e266af-1a00-4e21-8900-0b5ce942f5fb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:27.124137 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f486898-fdcc-4d39-8447-b7d3780ba4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:27.124794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f486898-fdcc-4d39-8447-b7d3780ba4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:27.125165 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f486898-fdcc-4d39-8447-b7d3780ba4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:27.125435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f486898-fdcc-4d39-8447-b7d3780ba4f7 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:27.126291 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f486898-fdcc-4d39-8447-b7d3780ba4f7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:27.126575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f486898-fdcc-4d39-8447-b7d3780ba4f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:27.127991 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f486898-fdcc-4d39-8447-b7d3780ba4f7 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:27.145897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615b682-b366-4516-b3fa-4b78b78de604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:27.146819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615b682-b366-4516-b3fa-4b78b78de604 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:27.147534 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615b682-b366-4516-b3fa-4b78b78de604 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:27.147984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615b682-b366-4516-b3fa-4b78b78de604 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:27.149140 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615b682-b366-4516-b3fa-4b78b78de604 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:27.149658 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615b682-b366-4516-b3fa-4b78b78de604 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:27.150552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 286/595] 10.222.0.61 () {56 vars in 1137 bytes} [Tue May 10 20:14:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:27.151538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f486898-fdcc-4d39-8447-b7d3780ba4f7 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:27.152284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615b682-b366-4516-b3fa-4b78b78de604 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:27.164886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 310/596] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:27.166155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615b682-b366-4516-b3fa-4b78b78de604 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:27.251760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f486898-fdcc-4d39-8447-b7d3780ba4f7 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:27.266433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615b682-b366-4516-b3fa-4b78b78de604 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:27.285865 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47af4e-4c7b-4e10-b667-78b3e1b56ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:27.286707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47af4e-4c7b-4e10-b667-78b3e1b56ded None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:27.286988 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47af4e-4c7b-4e10-b667-78b3e1b56ded None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:27.287260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47af4e-4c7b-4e10-b667-78b3e1b56ded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:27.298482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47af4e-4c7b-4e10-b667-78b3e1b56ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:27.300115 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de47af4e-4c7b-4e10-b667-78b3e1b56ded None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:27.302880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5daa3f-75c2-4093-8687-b4a4de433923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:27.303927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5daa3f-75c2-4093-8687-b4a4de433923 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:27.304410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5daa3f-75c2-4093-8687-b4a4de433923 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:27.304883 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5daa3f-75c2-4093-8687-b4a4de433923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:27.316466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5daa3f-75c2-4093-8687-b4a4de433923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:27.318249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5daa3f-75c2-4093-8687-b4a4de433923 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-de47af4e-4c7b-4e10-b667-78b3e1b56ded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:27.319373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:27.320241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:27.321182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:27.321182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:27.321182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:27.321182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:27.321182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 287/597] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:27.321861 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47af4e-4c7b-4e10-b667-78b3e1b56ded None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-fd5daa3f-75c2-4093-8687-b4a4de433923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:27.338756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:27.339670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:27.340612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:27.340612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:27.340612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:27.340612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:27.342834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 311/598] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:27.343815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5daa3f-75c2-4093-8687-b4a4de433923 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:27.427254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de47af4e-4c7b-4e10-b667-78b3e1b56ded None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:27.445244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5daa3f-75c2-4093-8687-b4a4de433923 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:27.461078 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bd8a5-a6cc-4705-8e55-f673c1607cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:27.462090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd8a5-a6cc-4705-8e55-f673c1607cf0 None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:27.462375 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd8a5-a6cc-4705-8e55-f673c1607cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:27.462644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd8a5-a6cc-4705-8e55-f673c1607cf0 None admin] PATH_INFO: `/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/9f59e7ae8da841dc809355fa8e4be488/roles/fd14ccb80b45427381dd82c06ef844b4` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:27.480242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bd8a5-a6cc-4705-8e55-f673c1607cf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b37547e1bf4906b65ac39aad3a608c, user_id=9f59e7ae8da841dc809355fa8e4be488, role_id=fd14ccb80b45427381dd82c06ef844b4)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:27.484769 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bd8a5-a6cc-4705-8e55-f673c1607cf0 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:27.488885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0840c-e81c-490d-8901-ee20d83193a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:27.490349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0840c-e81c-490d-8901-ee20d83193a7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:27.491000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0840c-e81c-490d-8901-ee20d83193a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:27.491504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0840c-e81c-490d-8901-ee20d83193a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:27.492522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0840c-e81c-490d-8901-ee20d83193a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:27.493167 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0840c-e81c-490d-8901-ee20d83193a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:27.496263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0840c-e81c-490d-8901-ee20d83193a7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:27.501816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 288/599] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:14:27 2022] PUT /identity/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/9f59e7ae8da841dc809355fa8e4be488/roles/fd14ccb80b45427381dd82c06ef844b4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:14:27.502548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bd8a5-a6cc-4705-8e55-f673c1607cf0 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:27.512738 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 312/600] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:27.517838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0840c-e81c-490d-8901-ee20d83193a7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:27.638363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bd8a5-a6cc-4705-8e55-f673c1607cf0 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:27.646174 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0840c-e81c-490d-8901-ee20d83193a7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:27.691385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247658f-c2ce-4132-8cf8-d1f21010b8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:27.692067 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247658f-c2ce-4132-8cf8-d1f21010b8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:27.692345 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247658f-c2ce-4132-8cf8-d1f21010b8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:27.692677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247658f-c2ce-4132-8cf8-d1f21010b8f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:27.693619 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247658f-c2ce-4132-8cf8-d1f21010b8f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:27.694024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247658f-c2ce-4132-8cf8-d1f21010b8f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:27.695525 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247658f-c2ce-4132-8cf8-d1f21010b8f7 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:27.696264 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1479b10-f024-4b98-92b5-02186ef46327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:27.697091 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1479b10-f024-4b98-92b5-02186ef46327 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:27.697373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1479b10-f024-4b98-92b5-02186ef46327 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:27.697643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1479b10-f024-4b98-92b5-02186ef46327 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:27.705532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1479b10-f024-4b98-92b5-02186ef46327 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:27.707135 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1479b10-f024-4b98-92b5-02186ef46327 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:27.708630 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 289/601] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:27.714942 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe012f-1658-4ad7-81ac-b15d38dfc504 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:27.715264 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe012f-1658-4ad7-81ac-b15d38dfc504 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:27.715496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe012f-1658-4ad7-81ac-b15d38dfc504 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:27.717859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 290/602] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:27.718738 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe012f-1658-4ad7-81ac-b15d38dfc504 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d1479b10-f024-4b98-92b5-02186ef46327 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:27.728322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:27.729859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:27.730837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:27.730837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:27.730837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:27.730837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:27.730837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:27.730837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:27.730837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:27.730837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:27.730837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 313/603] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:27.736996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e0fbf-0e0c-415e-89e1-a5fa80862af6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:27.736996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e0fbf-0e0c-415e-89e1-a5fa80862af6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:27.736996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e0fbf-0e0c-415e-89e1-a5fa80862af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:27.750165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-992e0fbf-0e0c-415e-89e1-a5fa80862af6 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:27.751426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-992e0fbf-0e0c-415e-89e1-a5fa80862af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:27.828697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe012f-1658-4ad7-81ac-b15d38dfc504 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:27.833053 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 314/604] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:27.834411 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e0fbf-0e0c-415e-89e1-a5fa80862af6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:27.880291 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729fed4-5d89-4c26-bff2-e34e3eb7b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:27.881521 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729fed4-5d89-4c26-bff2-e34e3eb7b0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:27.882008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729fed4-5d89-4c26-bff2-e34e3eb7b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:27.882479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729fed4-5d89-4c26-bff2-e34e3eb7b0d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:27.890469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729fed4-5d89-4c26-bff2-e34e3eb7b0d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:27.892171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729fed4-5d89-4c26-bff2-e34e3eb7b0d3 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-5729fed4-5d89-4c26-bff2-e34e3eb7b0d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:27.907581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:27.908474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:27.909403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:27.909403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:27.909403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:27.909403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:27.909403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:27.909403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:27.909403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:27.909403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:27.911824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 291/605] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:27.912862 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729fed4-5d89-4c26-bff2-e34e3eb7b0d3 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:27.966448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e0fbf-0e0c-415e-89e1-a5fa80862af6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:28.009117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1d723-430a-42a6-a12b-11f29234bd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:28.011196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d723-430a-42a6-a12b-11f29234bd28 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:28.011694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d723-430a-42a6-a12b-11f29234bd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:28.012183 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d723-430a-42a6-a12b-11f29234bd28 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:28.013202 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1d723-430a-42a6-a12b-11f29234bd28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:28.014153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1d723-430a-42a6-a12b-11f29234bd28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:28.016241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1d723-430a-42a6-a12b-11f29234bd28 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:28.025462 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729fed4-5d89-4c26-bff2-e34e3eb7b0d3 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:28.035900 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 315/606] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:28.037430 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1d723-430a-42a6-a12b-11f29234bd28 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:28.060757 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31effa-b34a-4cbf-aa75-d9f93fcadae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:28.061609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31effa-b34a-4cbf-aa75-d9f93fcadae9 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:28.062023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31effa-b34a-4cbf-aa75-d9f93fcadae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:28.062129 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31effa-b34a-4cbf-aa75-d9f93fcadae9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:28.072741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31effa-b34a-4cbf-aa75-d9f93fcadae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-3a31effa-b34a-4cbf-aa75-d9f93fcadae9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:28.080927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:28.081853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:28.083096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:28.083096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:28.083096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:28.083096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:28.083096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:28.083096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:28.083096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:28.083096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:28.083096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:28.083096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:28.083096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:28.083096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:28.087203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 292/607] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:28.089076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31effa-b34a-4cbf-aa75-d9f93fcadae9 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:28.161495 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1d723-430a-42a6-a12b-11f29234bd28 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:28.193998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483aeb5-0f35-4375-a8ec-6fed19fd0ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:28.194659 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483aeb5-0f35-4375-a8ec-6fed19fd0ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:28.194940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483aeb5-0f35-4375-a8ec-6fed19fd0ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:28.195211 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483aeb5-0f35-4375-a8ec-6fed19fd0ec8 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:28.195978 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483aeb5-0f35-4375-a8ec-6fed19fd0ec8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:28.196279 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483aeb5-0f35-4375-a8ec-6fed19fd0ec8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:28.197719 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9483aeb5-0f35-4375-a8ec-6fed19fd0ec8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:28.214949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31effa-b34a-4cbf-aa75-d9f93fcadae9 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:28.215712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 316/608] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:28.216771 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483aeb5-0f35-4375-a8ec-6fed19fd0ec8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:28.256375 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d2f36-0fe4-4dff-949f-6dda1e25a84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:28.257653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d2f36-0fe4-4dff-949f-6dda1e25a84f None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:28.258481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d2f36-0fe4-4dff-949f-6dda1e25a84f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:28.258964 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d2f36-0fe4-4dff-949f-6dda1e25a84f None admin] PATH_INFO: `/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/e31558db83834034b7183223bbd0f84a/roles/fd14ccb80b45427381dd82c06ef844b4` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:28.279837 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d2f36-0fe4-4dff-949f-6dda1e25a84f None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b37547e1bf4906b65ac39aad3a608c, user_id=e31558db83834034b7183223bbd0f84a, role_id=fd14ccb80b45427381dd82c06ef844b4)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:28.281917 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d2f36-0fe4-4dff-949f-6dda1e25a84f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:28.299265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 293/609] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:14:28 2022] PUT /identity/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/e31558db83834034b7183223bbd0f84a/roles/fd14ccb80b45427381dd82c06ef844b4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:14:28.300486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d2f36-0fe4-4dff-949f-6dda1e25a84f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:28.354641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483aeb5-0f35-4375-a8ec-6fed19fd0ec8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:28.398800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ebce5-c638-4c9d-bb51-d2df0ebc874c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:28.400839 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ebce5-c638-4c9d-bb51-d2df0ebc874c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:28.401601 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ebce5-c638-4c9d-bb51-d2df0ebc874c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:28.402108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ebce5-c638-4c9d-bb51-d2df0ebc874c None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:28.403548 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ebce5-c638-4c9d-bb51-d2df0ebc874c None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:28.404178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ebce5-c638-4c9d-bb51-d2df0ebc874c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:28.406227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ebce5-c638-4c9d-bb51-d2df0ebc874c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:28.418533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 317/610] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:28.425104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ebce5-c638-4c9d-bb51-d2df0ebc874c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:28.538923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d2f36-0fe4-4dff-949f-6dda1e25a84f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:28.543347 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ebce5-c638-4c9d-bb51-d2df0ebc874c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:28.582761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c198d7-3845-43cb-bd73-c65ced098a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:28.584094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c198d7-3845-43cb-bd73-c65ced098a99 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:28.584956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c198d7-3845-43cb-bd73-c65ced098a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:28.585465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c198d7-3845-43cb-bd73-c65ced098a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:28.598473 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c198d7-3845-43cb-bd73-c65ced098a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:28.600595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c198d7-3845-43cb-bd73-c65ced098a99 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:28.603021 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22b7ed-788a-4e57-82cb-b26668ac8e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:28.603916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22b7ed-788a-4e57-82cb-b26668ac8e71 None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:28.604388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22b7ed-788a-4e57-82cb-b26668ac8e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:28.604672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22b7ed-788a-4e57-82cb-b26668ac8e71 None admin] PATH_INFO: `/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/f319323b3f3547849d452c1361764005/roles/fd14ccb80b45427381dd82c06ef844b4` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:28.619420 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22b7ed-788a-4e57-82cb-b26668ac8e71 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b37547e1bf4906b65ac39aad3a608c, user_id=f319323b3f3547849d452c1361764005, role_id=fd14ccb80b45427381dd82c06ef844b4)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-f0c198d7-3845-43cb-bd73-c65ced098a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:28.622512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:28.623385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:28.624309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:28.624309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:28.624309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:28.624309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:28.624539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22b7ed-788a-4e57-82cb-b26668ac8e71 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:28.627205 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 318/611] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:28.634067 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c198d7-3845-43cb-bd73-c65ced098a99 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:28.640953 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 294/612] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:14:28 2022] PUT /identity/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/f319323b3f3547849d452c1361764005/roles/fd14ccb80b45427381dd82c06ef844b4 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:14:28.755138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c198d7-3845-43cb-bd73-c65ced098a99 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:28.802258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bb7a4-8be5-4a1e-bab4-feffbe76f4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:28.803338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bb7a4-8be5-4a1e-bab4-feffbe76f4bc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:28.803910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bb7a4-8be5-4a1e-bab4-feffbe76f4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:28.804404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bb7a4-8be5-4a1e-bab4-feffbe76f4bc None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:28.805452 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bb7a4-8be5-4a1e-bab4-feffbe76f4bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:28.805993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bb7a4-8be5-4a1e-bab4-feffbe76f4bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:28.808232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bb7a4-8be5-4a1e-bab4-feffbe76f4bc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:28.824048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 319/613] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:28.829935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22b7ed-788a-4e57-82cb-b26668ac8e71 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:28.937156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22b7ed-788a-4e57-82cb-b26668ac8e71 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:28.944141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6b6e1-ebef-4088-bd14-5f2c1f9bbb17 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:28.944717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6b6e1-ebef-4088-bd14-5f2c1f9bbb17 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:28.945215 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6b6e1-ebef-4088-bd14-5f2c1f9bbb17 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:28.947079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 320/614] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:14:28.952814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2975f88-d185-4a92-a68e-1db969dd83a1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:28.953394 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2975f88-d185-4a92-a68e-1db969dd83a1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:28.953871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2975f88-d185-4a92-a68e-1db969dd83a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:28.974222 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e2975f88-d185-4a92-a68e-1db969dd83a1 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:28.975407 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e2975f88-d185-4a92-a68e-1db969dd83a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:28.982727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea0bc2-33f0-47f3-b45d-eb2d03f8fde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:28.984409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea0bc2-33f0-47f3-b45d-eb2d03f8fde8 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:28.984909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea0bc2-33f0-47f3-b45d-eb2d03f8fde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:28.985818 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea0bc2-33f0-47f3-b45d-eb2d03f8fde8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:29.000295 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea0bc2-33f0-47f3-b45d-eb2d03f8fde8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:29.002103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea0bc2-33f0-47f3-b45d-eb2d03f8fde8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-50ea0bc2-33f0-47f3-b45d-eb2d03f8fde8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:29.026967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:29.027914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:29.028881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:29.028881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:29.028881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:29.028881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:29.028881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:29.028881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:29.028881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:29.028881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:29.028881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:14:29.028881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:29.040238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 295/615] 10.222.0.61 () {56 vars in 1093 bytes} [Tue May 10 20:14:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:29.050568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea0bc2-33f0-47f3-b45d-eb2d03f8fde8 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:29.089234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 321/616] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:14:29.123740 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2975f88-d185-4a92-a68e-1db969dd83a1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:29.173922 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea0bc2-33f0-47f3-b45d-eb2d03f8fde8 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:29.215308 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bddea-26f9-4b6f-8668-a7f47fe94c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:29.216056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bddea-26f9-4b6f-8668-a7f47fe94c19 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:29.216265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bddea-26f9-4b6f-8668-a7f47fe94c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:29.216540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bddea-26f9-4b6f-8668-a7f47fe94c19 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:29.217413 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1bddea-26f9-4b6f-8668-a7f47fe94c19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:29.217726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1bddea-26f9-4b6f-8668-a7f47fe94c19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:29.220595 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1bddea-26f9-4b6f-8668-a7f47fe94c19 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:29.243554 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 296/617] 10.222.0.61 () {56 vars in 1133 bytes} [Tue May 10 20:14:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:29.248838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bddea-26f9-4b6f-8668-a7f47fe94c19 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:29.322247 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2975f88-d185-4a92-a68e-1db969dd83a1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:29.373274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259c9b3-fd36-4830-ac7a-039b0351aace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:29.374072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259c9b3-fd36-4830-ac7a-039b0351aace None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:29.374400 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259c9b3-fd36-4830-ac7a-039b0351aace None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:29.374677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d259c9b3-fd36-4830-ac7a-039b0351aace None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:29.394662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d259c9b3-fd36-4830-ac7a-039b0351aace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d259c9b3-fd36-4830-ac7a-039b0351aace None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:29.407688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:29.408860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:29.409924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:29.409924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:29.409924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:29.409924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:29.409924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:29.409924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:29.409924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:29.409924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:29.409924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:29.409924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:29.409924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:29.409924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:29.410680 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 322/618] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:29.417438 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259c9b3-fd36-4830-ac7a-039b0351aace None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:29.425108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bddea-26f9-4b6f-8668-a7f47fe94c19 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:29.466268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194184a-5c34-4b06-ba25-80237a8da8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:29.466926 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194184a-5c34-4b06-ba25-80237a8da8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:29.467267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194184a-5c34-4b06-ba25-80237a8da8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:29.467539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194184a-5c34-4b06-ba25-80237a8da8f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:29.560206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d259c9b3-fd36-4830-ac7a-039b0351aace None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:29.595975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194184a-5c34-4b06-ba25-80237a8da8f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:29.597368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194184a-5c34-4b06-ba25-80237a8da8f9 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:29.600557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2b82c-9021-4d69-92f4-b745fbcbb2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:29.601248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2b82c-9021-4d69-92f4-b745fbcbb2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:29.601529 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2b82c-9021-4d69-92f4-b745fbcbb2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:29.601804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2b82c-9021-4d69-92f4-b745fbcbb2d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:29.602550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2b82c-9021-4d69-92f4-b745fbcbb2d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:29.602854 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2b82c-9021-4d69-92f4-b745fbcbb2d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:29.604243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2b82c-9021-4d69-92f4-b745fbcbb2d4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:29.620583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 323/619] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:29.626918 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2b82c-9021-4d69-92f4-b745fbcbb2d4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:29.725975 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2b82c-9021-4d69-92f4-b745fbcbb2d4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:29.766632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296b5cf-885f-4c5d-8b30-f88232803bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:29.767776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296b5cf-885f-4c5d-8b30-f88232803bdf None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:29.768259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296b5cf-885f-4c5d-8b30-f88232803bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:29.768763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296b5cf-885f-4c5d-8b30-f88232803bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:29.778613 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 297/620] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:29.783807 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194184a-5c34-4b06-ba25-80237a8da8f9 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:29.797842 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296b5cf-885f-4c5d-8b30-f88232803bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:29.800493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c296b5cf-885f-4c5d-8b30-f88232803bdf None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-c296b5cf-885f-4c5d-8b30-f88232803bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:29.834646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:29.835620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:29.836522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:29.836522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:29.836522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:29.836522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:29.836522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 324/621] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:29.843297 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296b5cf-885f-4c5d-8b30-f88232803bdf None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:29.906528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194184a-5c34-4b06-ba25-80237a8da8f9 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:29.940904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d6846-780b-49ef-87aa-5359fe4dd463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:29.941727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d6846-780b-49ef-87aa-5359fe4dd463 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:29.942005 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d6846-780b-49ef-87aa-5359fe4dd463 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:29.942278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d6846-780b-49ef-87aa-5359fe4dd463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:29.952834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d6846-780b-49ef-87aa-5359fe4dd463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:29.954308 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d6846-780b-49ef-87aa-5359fe4dd463 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-209d6846-780b-49ef-87aa-5359fe4dd463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:29.972228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:29.974301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:29.975770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:29.975770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:29.975770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:29.975770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:29.975770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 298/622] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:29.988008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d6846-780b-49ef-87aa-5359fe4dd463 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:30.016486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296b5cf-885f-4c5d-8b30-f88232803bdf None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:30.050000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9072df68-fabe-4d8e-831e-c657916e9356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:30.050673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072df68-fabe-4d8e-831e-c657916e9356 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:30.050953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072df68-fabe-4d8e-831e-c657916e9356 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:30.051226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072df68-fabe-4d8e-831e-c657916e9356 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:30.051929 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072df68-fabe-4d8e-831e-c657916e9356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:30.052231 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072df68-fabe-4d8e-831e-c657916e9356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:30.053629 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9072df68-fabe-4d8e-831e-c657916e9356 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:30.073474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 325/623] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:30.073474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb3bf2-08c5-485c-a2bc-49cecf8fa3a2 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:30.073474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb3bf2-08c5-485c-a2bc-49cecf8fa3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:30.073474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb3bf2-08c5-485c-a2bc-49cecf8fa3a2 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:30.073474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 326/624] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:30.073474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb3bf2-08c5-485c-a2bc-49cecf8fa3a2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:30.143966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d6846-780b-49ef-87aa-5359fe4dd463 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:30.179938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb3bf2-08c5-485c-a2bc-49cecf8fa3a2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:30.193125 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2518c-8d33-48eb-9387-cdc92e2cdb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:30.193804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2518c-8d33-48eb-9387-cdc92e2cdb9b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:30.194096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2518c-8d33-48eb-9387-cdc92e2cdb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:30.194354 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2518c-8d33-48eb-9387-cdc92e2cdb9b None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:30.195087 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2518c-8d33-48eb-9387-cdc92e2cdb9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:30.195392 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2518c-8d33-48eb-9387-cdc92e2cdb9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:30.196779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2518c-8d33-48eb-9387-cdc92e2cdb9b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:30.212677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 299/625] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:30.214327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea2b4b-eaad-429d-967c-49eba2df094b None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:30.214721 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea2b4b-eaad-429d-967c-49eba2df094b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:30.215655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea2b4b-eaad-429d-967c-49eba2df094b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:30.222001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4c4d-e5fc-4877-8425-aac0757e8c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:30.223052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4c4d-e5fc-4877-8425-aac0757e8c19 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:30.223552 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4c4d-e5fc-4877-8425-aac0757e8c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:30.224032 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f4c4d-e5fc-4877-8425-aac0757e8c19 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:30.232585 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f4c4d-e5fc-4877-8425-aac0757e8c19 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:30.234279 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f4c4d-e5fc-4877-8425-aac0757e8c19 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:30.237840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-bdea2b4b-eaad-429d-967c-49eba2df094b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:30.239026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-bdea2b4b-eaad-429d-967c-49eba2df094b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-bd9f4c4d-e5fc-4877-8425-aac0757e8c19 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:30.253139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:30.254077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:30.255016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:30.255016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:30.255016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:30.255016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:30.255016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:30.255016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:30.255016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:30.255016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:30.255016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 20:14:30.255016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:30.258961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 327/626] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:14:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:30.259779 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4c4d-e5fc-4877-8425-aac0757e8c19 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:30.325300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 300/627] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:30.326239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea2b4b-eaad-429d-967c-49eba2df094b None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:30.365433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f4c4d-e5fc-4877-8425-aac0757e8c19 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:30.409930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d1690-3b96-41a5-ae64-71248be0d308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:30.411134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d1690-3b96-41a5-ae64-71248be0d308 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:30.411673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d1690-3b96-41a5-ae64-71248be0d308 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:30.412305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d1690-3b96-41a5-ae64-71248be0d308 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:30.421673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d1690-3b96-41a5-ae64-71248be0d308 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:30.424148 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d1690-3b96-41a5-ae64-71248be0d308 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-697d1690-3b96-41a5-ae64-71248be0d308 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:30.442190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:30.443155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:30.444097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:30.444097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:30.444097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:30.444097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:30.444097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:30.444097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:30.444097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:30.444097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:30.447897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 328/628] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:30.448733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d1690-3b96-41a5-ae64-71248be0d308 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:30.456092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea2b4b-eaad-429d-967c-49eba2df094b None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:30.491171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b7308-a7e5-45ce-96c7-69b9ced977b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:30.492214 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7308-a7e5-45ce-96c7-69b9ced977b3 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:30.492714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7308-a7e5-45ce-96c7-69b9ced977b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:30.493246 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7308-a7e5-45ce-96c7-69b9ced977b3 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:30.494302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b7308-a7e5-45ce-96c7-69b9ced977b3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:30.495447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b7308-a7e5-45ce-96c7-69b9ced977b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:30.497164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b7308-a7e5-45ce-96c7-69b9ced977b3 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:30.515232 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 301/629] 10.222.0.61 () {56 vars in 1135 bytes} [Tue May 10 20:14:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:30.516429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b7308-a7e5-45ce-96c7-69b9ced977b3 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:30.548522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d1690-3b96-41a5-ae64-71248be0d308 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:30.582990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7be05-4443-4c77-aa42-022d718282af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:30.584153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7be05-4443-4c77-aa42-022d718282af None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:30.584275 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7be05-4443-4c77-aa42-022d718282af None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:30.584488 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7be05-4443-4c77-aa42-022d718282af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:30.594882 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7be05-4443-4c77-aa42-022d718282af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-0aa7be05-4443-4c77-aa42-022d718282af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:30.602426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:30.603398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:30.604928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:30.604928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:30.604928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:30.604928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:30.604928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:30.604928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:30.604928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:30.604928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:30.604928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:30.604928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:30.604928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:30.604928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:30.604928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 329/630] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:30.605683 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7be05-4443-4c77-aa42-022d718282af None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:30.630392 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b7308-a7e5-45ce-96c7-69b9ced977b3 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:30.665387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaeb4a-bd98-46b7-b61a-0b851d139f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:30.666447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaeb4a-bd98-46b7-b61a-0b851d139f54 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:30.667484 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaeb4a-bd98-46b7-b61a-0b851d139f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:30.668016 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaeb4a-bd98-46b7-b61a-0b851d139f54 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:30.669054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffaeb4a-bd98-46b7-b61a-0b851d139f54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:30.669588 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffaeb4a-bd98-46b7-b61a-0b851d139f54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:30.671252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffaeb4a-bd98-46b7-b61a-0b851d139f54 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:30.683836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 302/631] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:30.685046 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaeb4a-bd98-46b7-b61a-0b851d139f54 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:30.710273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7be05-4443-4c77-aa42-022d718282af None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:30.743848 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82324a98-f3df-43d4-9f1a-f9b127582c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:30.744679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82324a98-f3df-43d4-9f1a-f9b127582c4f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:30.745100 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82324a98-f3df-43d4-9f1a-f9b127582c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:30.745273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82324a98-f3df-43d4-9f1a-f9b127582c4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:30.755726 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82324a98-f3df-43d4-9f1a-f9b127582c4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:30.757201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82324a98-f3df-43d4-9f1a-f9b127582c4f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-82324a98-f3df-43d4-9f1a-f9b127582c4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:30.774606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:30.776323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:30.777838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:30.777838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:30.777838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:30.777838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:30.777838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 330/632] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:30.777838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82324a98-f3df-43d4-9f1a-f9b127582c4f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:30.801042 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaeb4a-bd98-46b7-b61a-0b851d139f54 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:30.834647 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e5cc5-b853-4adf-a389-e8c259231424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:30.835585 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e5cc5-b853-4adf-a389-e8c259231424 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:30.836016 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e5cc5-b853-4adf-a389-e8c259231424 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:30.836433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e5cc5-b853-4adf-a389-e8c259231424 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:30.837349 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e5cc5-b853-4adf-a389-e8c259231424 None admin] RBAC: Adding query filter params (name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:30.837818 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e5cc5-b853-4adf-a389-e8c259231424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:30.839874 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e5cc5-b853-4adf-a389-e8c259231424 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:30.848383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 303/633] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:30.849410 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e5cc5-b853-4adf-a389-e8c259231424 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:30.877710 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82324a98-f3df-43d4-9f1a-f9b127582c4f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:30.915373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d044a6-8489-4d1f-8710-166d82a2f6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:30.916034 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d044a6-8489-4d1f-8710-166d82a2f6ea None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:30.916315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d044a6-8489-4d1f-8710-166d82a2f6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:30.917187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d044a6-8489-4d1f-8710-166d82a2f6ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:30.918029 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d044a6-8489-4d1f-8710-166d82a2f6ea None admin] RBAC: Adding query filter params (role.id=fd14ccb80b45427381dd82c06ef844b4, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:30.918340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d044a6-8489-4d1f-8710-166d82a2f6ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:30.919777 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d044a6-8489-4d1f-8710-166d82a2f6ea None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:30.933169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 331/634] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:30 2022] GET /identity/v3/role_assignments?user.id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=fd14ccb80b45427381dd82c06ef844b4 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:30.934151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d044a6-8489-4d1f-8710-166d82a2f6ea None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:30.955450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e5cc5-b853-4adf-a389-e8c259231424 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:30.992635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97b569-fc05-4c44-b4de-90bde1462eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:30.993539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97b569-fc05-4c44-b4de-90bde1462eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:30.993986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97b569-fc05-4c44-b4de-90bde1462eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:30.994414 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97b569-fc05-4c44-b4de-90bde1462eb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:30.995319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97b569-fc05-4c44-b4de-90bde1462eb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:30.995789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97b569-fc05-4c44-b4de-90bde1462eb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:30.997386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97b569-fc05-4c44-b4de-90bde1462eb4 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:31.011276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 304/635] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:31.016518 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97b569-fc05-4c44-b4de-90bde1462eb4 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:31.111628 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d044a6-8489-4d1f-8710-166d82a2f6ea None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:31.160609 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfa3df-abf0-4461-a8d5-238579a5bd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:31.162013 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfa3df-abf0-4461-a8d5-238579a5bd6b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:31.162466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfa3df-abf0-4461-a8d5-238579a5bd6b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:31.162889 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfa3df-abf0-4461-a8d5-238579a5bd6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:31.163440 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97b569-fc05-4c44-b4de-90bde1462eb4 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:31.177280 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfa3df-abf0-4461-a8d5-238579a5bd6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:31.179310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfa3df-abf0-4461-a8d5-238579a5bd6b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-fdcfa3df-abf0-4461-a8d5-238579a5bd6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:31.200694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:31.201865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:31.203108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:31.203108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:31.203108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:31.203108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:31.203108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 332/636] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:31.203512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cefd-0557-43f7-bead-9e2988be2165 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:31.203799 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cefd-0557-43f7-bead-9e2988be2165 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:31.204075 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7cefd-0557-43f7-bead-9e2988be2165 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:31.205569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 333/637] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:31.209910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7cefd-0557-43f7-bead-9e2988be2165 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:31.210794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e57efa-aa1c-4ad9-b826-945a13bc98b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:31.211860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e57efa-aa1c-4ad9-b826-945a13bc98b6 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:31.212238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e57efa-aa1c-4ad9-b826-945a13bc98b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:31.212587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e57efa-aa1c-4ad9-b826-945a13bc98b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:31.221823 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e57efa-aa1c-4ad9-b826-945a13bc98b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:31.223276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e57efa-aa1c-4ad9-b826-945a13bc98b6 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-19e57efa-aa1c-4ad9-b826-945a13bc98b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:31.241060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:31.241986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:31.242873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:31.242873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:31.242873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:31.242873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:31.242873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:31.242873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:31.242873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:31.242873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:31.242873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 305/638] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:31.244457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485553fe-c253-433d-87f6-2f85612639fb None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:31.244457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485553fe-c253-433d-87f6-2f85612639fb None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:31.244457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485553fe-c253-433d-87f6-2f85612639fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:31.261603 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-485553fe-c253-433d-87f6-2f85612639fb None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:31.262777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-485553fe-c253-433d-87f6-2f85612639fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:31.325872 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7cefd-0557-43f7-bead-9e2988be2165 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:31.337225 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 306/639] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:31.338070 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485553fe-c253-433d-87f6-2f85612639fb None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:31.364556 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0258357-e6f3-42bf-a85f-61789ccb8b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:31.365258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0258357-e6f3-42bf-a85f-61789ccb8b08 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:31.365548 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0258357-e6f3-42bf-a85f-61789ccb8b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:31.366116 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0258357-e6f3-42bf-a85f-61789ccb8b08 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:31.366526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0258357-e6f3-42bf-a85f-61789ccb8b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:31.366837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0258357-e6f3-42bf-a85f-61789ccb8b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:31.368206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0258357-e6f3-42bf-a85f-61789ccb8b08 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:31.381402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 334/640] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:31.381402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c4e0f-25ed-4cc7-854c-923d667c91b1 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:31.381402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c4e0f-25ed-4cc7-854c-923d667c91b1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:31.381711 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c4e0f-25ed-4cc7-854c-923d667c91b1 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:31.382939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 335/641] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:31.388171 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c4e0f-25ed-4cc7-854c-923d667c91b1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:31.442427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485553fe-c253-433d-87f6-2f85612639fb None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:31.477523 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bcb6d-45f4-4dd6-8625-d7b9cd68e744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:31.478192 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bcb6d-45f4-4dd6-8625-d7b9cd68e744 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:31.478478 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bcb6d-45f4-4dd6-8625-d7b9cd68e744 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:31.478754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bcb6d-45f4-4dd6-8625-d7b9cd68e744 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:31.479539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bcb6d-45f4-4dd6-8625-d7b9cd68e744 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:31.479850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bcb6d-45f4-4dd6-8625-d7b9cd68e744 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:31.481296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bcb6d-45f4-4dd6-8625-d7b9cd68e744 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:31.485481 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c4e0f-25ed-4cc7-854c-923d667c91b1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:31.497706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 307/642] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:31.497706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bcb6d-45f4-4dd6-8625-d7b9cd68e744 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:31.523852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d52cc-a9f3-458c-9e65-92d331292f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:31.524657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d52cc-a9f3-458c-9e65-92d331292f71 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:31.524940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d52cc-a9f3-458c-9e65-92d331292f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:31.525238 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d52cc-a9f3-458c-9e65-92d331292f71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:31.535300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d52cc-a9f3-458c-9e65-92d331292f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-db0d52cc-a9f3-458c-9e65-92d331292f71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:31.542943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:31.544022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:31.544897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:31.544897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:31.544897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:31.544897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:31.544897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:31.544897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:31.544897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:31.544897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:31.544897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:31.544897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:31.544897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:31.544897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:31.544897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 336/643] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:31.545647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ab84f-d440-436c-891e-144761d3cd93 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:31.545647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ab84f-d440-436c-891e-144761d3cd93 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:31.546276 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ab84f-d440-436c-891e-144761d3cd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:31.562132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-525ab84f-d440-436c-891e-144761d3cd93 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:31.563304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-525ab84f-d440-436c-891e-144761d3cd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:31.597656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bcb6d-45f4-4dd6-8625-d7b9cd68e744 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:31.630197 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbdb0b-763b-4764-b847-497bf4bc0b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:31.631328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbdb0b-763b-4764-b847-497bf4bc0b1f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:31.631849 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbdb0b-763b-4764-b847-497bf4bc0b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:31.632342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbdb0b-763b-4764-b847-497bf4bc0b1f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:31.632796 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 337/644] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:31.633643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ab84f-d440-436c-891e-144761d3cd93 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:31.652143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbdb0b-763b-4764-b847-497bf4bc0b1f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:31.654434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbdb0b-763b-4764-b847-497bf4bc0b1f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-d7bbdb0b-763b-4764-b847-497bf4bc0b1f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:31.672534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:31.673632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:31.674871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:31.674871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:31.674871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:31.674871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:31.674871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:31.674871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:31.674871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:31.674871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:31.674871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 20:14:31.674871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:31.676797 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 308/645] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:31.677715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbdb0b-763b-4764-b847-497bf4bc0b1f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:31.734664 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ab84f-d440-436c-891e-144761d3cd93 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:31.767643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82797c6-3387-4fe9-9261-f5b62aea804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:31.768464 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82797c6-3387-4fe9-9261-f5b62aea804b None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:31.768730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82797c6-3387-4fe9-9261-f5b62aea804b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:31.769025 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82797c6-3387-4fe9-9261-f5b62aea804b None admin] PATH_INFO: `/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/6acfba37d6b84bf3a63d40e6e4096f5d/roles/fd14ccb80b45427381dd82c06ef844b4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:31.783476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82797c6-3387-4fe9-9261-f5b62aea804b None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b37547e1bf4906b65ac39aad3a608c, user_id=6acfba37d6b84bf3a63d40e6e4096f5d, role_id=fd14ccb80b45427381dd82c06ef844b4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:31.784526 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbdb0b-763b-4764-b847-497bf4bc0b1f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:31.784908 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82797c6-3387-4fe9-9261-f5b62aea804b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:31.799301 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 338/646] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:14:31 2022] PUT /identity/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/6acfba37d6b84bf3a63d40e6e4096f5d/roles/fd14ccb80b45427381dd82c06ef844b4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:14:31.800109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82797c6-3387-4fe9-9261-f5b62aea804b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:31.834454 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa29b2-e70e-4ec6-8385-d30ae20da72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:31.835539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa29b2-e70e-4ec6-8385-d30ae20da72e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:31.836079 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa29b2-e70e-4ec6-8385-d30ae20da72e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:31.836610 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa29b2-e70e-4ec6-8385-d30ae20da72e None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:31.837703 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa29b2-e70e-4ec6-8385-d30ae20da72e None admin] RBAC: Adding query filter params (name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:31.838263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa29b2-e70e-4ec6-8385-d30ae20da72e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:31.840071 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa29b2-e70e-4ec6-8385-d30ae20da72e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:31.850215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 309/647] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:31.851421 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa29b2-e70e-4ec6-8385-d30ae20da72e None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:31.915153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82797c6-3387-4fe9-9261-f5b62aea804b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:31.953560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8d579-268a-4712-8d0b-de4c02975fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:31.954382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d579-268a-4712-8d0b-de4c02975fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:31.954666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d579-268a-4712-8d0b-de4c02975fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:31.954941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8d579-268a-4712-8d0b-de4c02975fc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:31.964004 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa29b2-e70e-4ec6-8385-d30ae20da72e None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:31.966540 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8d579-268a-4712-8d0b-de4c02975fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-74d8d579-268a-4712-8d0b-de4c02975fc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:31.974516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:31.975551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:31.976371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:31.976371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:31.976371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:31.976371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:31.976371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:31.976371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:31.976371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:31.976371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:31.976371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:31.976371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:31.976371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:31.976371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:31.980801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 339/648] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:31.981772 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8d579-268a-4712-8d0b-de4c02975fc7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:32.006075 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e9186-f24c-49c9-a8d9-6e703d85e9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:32.007086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e9186-f24c-49c9-a8d9-6e703d85e9cb None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:32.007600 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e9186-f24c-49c9-a8d9-6e703d85e9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:32.008082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e9186-f24c-49c9-a8d9-6e703d85e9cb None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:32.010010 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e9186-f24c-49c9-a8d9-6e703d85e9cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:32.010580 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e9186-f24c-49c9-a8d9-6e703d85e9cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:32.012211 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e9186-f24c-49c9-a8d9-6e703d85e9cb None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:32.033018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 310/649] 10.222.0.61 () {56 vars in 1137 bytes} [Tue May 10 20:14:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:32.034258 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e9186-f24c-49c9-a8d9-6e703d85e9cb None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:32.090521 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8d579-268a-4712-8d0b-de4c02975fc7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:32.133250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba17df-7756-471d-b301-1f7a79c501f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:32.134826 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba17df-7756-471d-b301-1f7a79c501f4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:32.135417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba17df-7756-471d-b301-1f7a79c501f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:32.136115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba17df-7756-471d-b301-1f7a79c501f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:32.143293 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e9186-f24c-49c9-a8d9-6e703d85e9cb None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:32.149703 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba17df-7756-471d-b301-1f7a79c501f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:32.152329 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba17df-7756-471d-b301-1f7a79c501f4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-61ba17df-7756-471d-b301-1f7a79c501f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:32.174776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:32.175686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:32.176580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:32.176580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:32.176580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:32.176580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:32.178912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 340/650] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:32.179958 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba17df-7756-471d-b301-1f7a79c501f4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:32.180209 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fa9be-26ff-4276-b254-ba9d473932dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:32.181035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fa9be-26ff-4276-b254-ba9d473932dd None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:32.181396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fa9be-26ff-4276-b254-ba9d473932dd None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:32.181743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fa9be-26ff-4276-b254-ba9d473932dd None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:32.183125 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fa9be-26ff-4276-b254-ba9d473932dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:32.183499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fa9be-26ff-4276-b254-ba9d473932dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:32.185018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fa9be-26ff-4276-b254-ba9d473932dd None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:32.194572 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 311/651] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:32.195195 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fa9be-26ff-4276-b254-ba9d473932dd None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:32.296525 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fa9be-26ff-4276-b254-ba9d473932dd None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:32.306769 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba17df-7756-471d-b301-1f7a79c501f4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:32.337498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac8656-8f11-47e0-8bc5-c8ea71aebd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:32.338828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac8656-8f11-47e0-8bc5-c8ea71aebd65 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:32.339183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac8656-8f11-47e0-8bc5-c8ea71aebd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:32.339531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac8656-8f11-47e0-8bc5-c8ea71aebd65 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:32.340326 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac8656-8f11-47e0-8bc5-c8ea71aebd65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:32.340701 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac8656-8f11-47e0-8bc5-c8ea71aebd65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:32.341927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1926e-6e9b-4569-a59b-cd8cba04868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:32.342226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac8656-8f11-47e0-8bc5-c8ea71aebd65 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:32.343001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1926e-6e9b-4569-a59b-cd8cba04868c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:32.343475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1926e-6e9b-4569-a59b-cd8cba04868c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:32.343932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1926e-6e9b-4569-a59b-cd8cba04868c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:32.360014 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 312/652] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:32.361353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac8656-8f11-47e0-8bc5-c8ea71aebd65 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:32.413508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1926e-6e9b-4569-a59b-cd8cba04868c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:32.415731 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1926e-6e9b-4569-a59b-cd8cba04868c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:32.478951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac8656-8f11-47e0-8bc5-c8ea71aebd65 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:32.514660 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54b6d6-7ace-45e4-a486-06aa7405fba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:32.515858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54b6d6-7ace-45e4-a486-06aa7405fba3 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:32.516372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54b6d6-7ace-45e4-a486-06aa7405fba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:32.516911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54b6d6-7ace-45e4-a486-06aa7405fba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:32.528200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54b6d6-7ace-45e4-a486-06aa7405fba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:32.529916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54b6d6-7ace-45e4-a486-06aa7405fba3 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:32.535077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 341/653] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:32.535926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1926e-6e9b-4569-a59b-cd8cba04868c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-3f54b6d6-7ace-45e4-a486-06aa7405fba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:32.554476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:32.555357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:32.556254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:32.556254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:32.556254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:32.556254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:32.560082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 313/654] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:32.562052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54b6d6-7ace-45e4-a486-06aa7405fba3 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:32.657996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1926e-6e9b-4569-a59b-cd8cba04868c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:32.678842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54b6d6-7ace-45e4-a486-06aa7405fba3 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:32.699642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e49b7-4de5-4513-b372-654a5aecbb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:32.701530 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e49b7-4de5-4513-b372-654a5aecbb38 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:32.701997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e49b7-4de5-4513-b372-654a5aecbb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:32.702486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e49b7-4de5-4513-b372-654a5aecbb38 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:32.712496 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e49b7-4de5-4513-b372-654a5aecbb38 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:32.715476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e49b7-4de5-4513-b372-654a5aecbb38 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:32.719776 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188817e-8c75-4896-81a1-93f2f6399c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:32.720636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188817e-8c75-4896-81a1-93f2f6399c5b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:32.721004 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188817e-8c75-4896-81a1-93f2f6399c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:32.721353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188817e-8c75-4896-81a1-93f2f6399c5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:32.731976 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188817e-8c75-4896-81a1-93f2f6399c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-da4e49b7-4de5-4513-b372-654a5aecbb38 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:32.733442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:32.734360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:32.735308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:32.735308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:32.735308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:32.735308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:32.735308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:32.735308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:32.735308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:32.735308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:32.735308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 20:14:32.735308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:32.735849 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188817e-8c75-4896-81a1-93f2f6399c5b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:32.737876 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 342/655] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:32.739122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e49b7-4de5-4513-b372-654a5aecbb38 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-1188817e-8c75-4896-81a1-93f2f6399c5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:32.757082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:32.758047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:32.758921 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:32.758921 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:32.758921 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:32.758921 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:32.761128 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 314/656] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:32.762100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188817e-8c75-4896-81a1-93f2f6399c5b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:32.852760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e49b7-4de5-4513-b372-654a5aecbb38 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:32.890255 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6deaa4-680f-4164-9516-84ad69516600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:32.890917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6deaa4-680f-4164-9516-84ad69516600 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:32.891193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6deaa4-680f-4164-9516-84ad69516600 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:32.891462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6deaa4-680f-4164-9516-84ad69516600 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:32.892170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6deaa4-680f-4164-9516-84ad69516600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:32.892473 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6deaa4-680f-4164-9516-84ad69516600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:32.894021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6deaa4-680f-4164-9516-84ad69516600 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:32.904782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188817e-8c75-4896-81a1-93f2f6399c5b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:32.909778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 343/657] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:32.910675 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6deaa4-680f-4164-9516-84ad69516600 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:32.948610 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faba254-f60e-4dcb-9b32-62d391066d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:32.949683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faba254-f60e-4dcb-9b32-62d391066d93 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:32.950170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faba254-f60e-4dcb-9b32-62d391066d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:32.951070 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faba254-f60e-4dcb-9b32-62d391066d93 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:32.952110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faba254-f60e-4dcb-9b32-62d391066d93 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:32.952963 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faba254-f60e-4dcb-9b32-62d391066d93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:32.955224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faba254-f60e-4dcb-9b32-62d391066d93 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:32.979178 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 315/658] 10.222.0.61 () {56 vars in 1139 bytes} [Tue May 10 20:14:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:32.981235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faba254-f60e-4dcb-9b32-62d391066d93 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:33.016686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6deaa4-680f-4164-9516-84ad69516600 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:33.051551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c22740-d8a2-4459-8114-94aaec2d5756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:33.052475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c22740-d8a2-4459-8114-94aaec2d5756 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:33.052913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c22740-d8a2-4459-8114-94aaec2d5756 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:33.053349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c22740-d8a2-4459-8114-94aaec2d5756 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:33.054220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c22740-d8a2-4459-8114-94aaec2d5756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:33.054680 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c22740-d8a2-4459-8114-94aaec2d5756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:33.056177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c22740-d8a2-4459-8114-94aaec2d5756 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:33.068429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 344/659] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:33.069563 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c22740-d8a2-4459-8114-94aaec2d5756 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:33.097156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faba254-f60e-4dcb-9b32-62d391066d93 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:33.131852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b071a4-95fc-4df0-b459-1a39a826205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:33.132526 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b071a4-95fc-4df0-b459-1a39a826205a None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:33.132919 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b071a4-95fc-4df0-b459-1a39a826205a None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:33.133296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b071a4-95fc-4df0-b459-1a39a826205a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:33.140739 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b071a4-95fc-4df0-b459-1a39a826205a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:33.142178 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b071a4-95fc-4df0-b459-1a39a826205a None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-12b071a4-95fc-4df0-b459-1a39a826205a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:33.157687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:33.158852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:33.160013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:33.160013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:33.160013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:33.160013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:33.160013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:33.160013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:33.160013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:33.160013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:33.160013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:14:33.160013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:33.165248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 316/660] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:33.166101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b071a4-95fc-4df0-b459-1a39a826205a None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:33.174470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c22740-d8a2-4459-8114-94aaec2d5756 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:33.210532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff376ce-c4cb-4096-970e-15010a6f683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:33.211497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff376ce-c4cb-4096-970e-15010a6f683c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:33.211924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff376ce-c4cb-4096-970e-15010a6f683c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:33.212345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff376ce-c4cb-4096-970e-15010a6f683c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:33.270127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b071a4-95fc-4df0-b459-1a39a826205a None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:33.281339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff376ce-c4cb-4096-970e-15010a6f683c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:33.283011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff376ce-c4cb-4096-970e-15010a6f683c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:33.306288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fd4ba-3615-45ea-bf7c-2b8511d1b103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:33.307110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd4ba-3615-45ea-bf7c-2b8511d1b103 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:33.307389 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd4ba-3615-45ea-bf7c-2b8511d1b103 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:33.307662 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fd4ba-3615-45ea-bf7c-2b8511d1b103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:33.314642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fd4ba-3615-45ea-bf7c-2b8511d1b103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:33.316143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fd4ba-3615-45ea-bf7c-2b8511d1b103 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-6b9fd4ba-3615-45ea-bf7c-2b8511d1b103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:33.330170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:33.331282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:33.332337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:33.332337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:33.332337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:33.332337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:33.332337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:33.332337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:33.332337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:33.332337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:33.335957 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 317/661] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:33.336784 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fd4ba-3615-45ea-bf7c-2b8511d1b103 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:33.386397 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 345/662] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:33.387432 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff376ce-c4cb-4096-970e-15010a6f683c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:33.436360 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fd4ba-3615-45ea-bf7c-2b8511d1b103 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:33.468829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9dcc1-c9ea-4c38-b5f3-5e0bb556268c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:33.469520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9dcc1-c9ea-4c38-b5f3-5e0bb556268c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:33.469801 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9dcc1-c9ea-4c38-b5f3-5e0bb556268c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:33.470072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9dcc1-c9ea-4c38-b5f3-5e0bb556268c None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:33.471221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9dcc1-c9ea-4c38-b5f3-5e0bb556268c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:33.471531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9dcc1-c9ea-4c38-b5f3-5e0bb556268c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:33.472957 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9dcc1-c9ea-4c38-b5f3-5e0bb556268c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:33.487377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff376ce-c4cb-4096-970e-15010a6f683c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:33.489994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 318/663] 10.222.0.61 () {56 vars in 1137 bytes} [Tue May 10 20:14:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:33.491338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e51a4-5a02-46ef-b932-f96e5b16cb0b None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:33.491694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e51a4-5a02-46ef-b932-f96e5b16cb0b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:33.492033 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e51a4-5a02-46ef-b932-f96e5b16cb0b None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:33.495253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 319/664] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:33.495253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e51a4-5a02-46ef-b932-f96e5b16cb0b None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:33.528404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec704f0-124f-48ca-a21e-1802430edc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:33.529093 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec704f0-124f-48ca-a21e-1802430edc2c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:33.529376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec704f0-124f-48ca-a21e-1802430edc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:33.529651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec704f0-124f-48ca-a21e-1802430edc2c None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:33.530427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec704f0-124f-48ca-a21e-1802430edc2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:33.530743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec704f0-124f-48ca-a21e-1802430edc2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:33.532166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec704f0-124f-48ca-a21e-1802430edc2c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:33.543417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 346/665] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:33.544229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec704f0-124f-48ca-a21e-1802430edc2c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:33.612647 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e51a4-5a02-46ef-b932-f96e5b16cb0b None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:33.642534 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec704f0-124f-48ca-a21e-1802430edc2c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:33.646738 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88757125-3b65-49a4-ac8a-878a4aa3786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:33.647977 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88757125-3b65-49a4-ac8a-878a4aa3786c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:33.648466 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88757125-3b65-49a4-ac8a-878a4aa3786c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:33.648914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88757125-3b65-49a4-ac8a-878a4aa3786c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:33.660143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88757125-3b65-49a4-ac8a-878a4aa3786c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:33.661612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88757125-3b65-49a4-ac8a-878a4aa3786c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:33.675101 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b27ac6-8bb3-444c-b65d-3671b8fd51ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:33.675749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b27ac6-8bb3-444c-b65d-3671b8fd51ba None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:33.676028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b27ac6-8bb3-444c-b65d-3671b8fd51ba None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:33.676299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b27ac6-8bb3-444c-b65d-3671b8fd51ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-88757125-3b65-49a4-ac8a-878a4aa3786c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:33.678773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:33.679635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:33.680540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:33.680540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:33.680540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:33.680540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:33.680540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 320/666] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:33.681312 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84eb56-ba6f-4326-8402-d3e805da3b7e None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:33.681496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84eb56-ba6f-4326-8402-d3e805da3b7e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:33.682904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84eb56-ba6f-4326-8402-d3e805da3b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:33.700437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-fc84eb56-ba6f-4326-8402-d3e805da3b7e None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:33.701637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fc84eb56-ba6f-4326-8402-d3e805da3b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:33.748995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b27ac6-8bb3-444c-b65d-3671b8fd51ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:33.750427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b27ac6-8bb3-444c-b65d-3671b8fd51ba None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:33.781331 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 321/667] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:33.782464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84eb56-ba6f-4326-8402-d3e805da3b7e None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:33.846714 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 347/668] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:14:33.847783 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b27ac6-8bb3-444c-b65d-3671b8fd51ba None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:33.887896 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84eb56-ba6f-4326-8402-d3e805da3b7e None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:33.924243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca4230-79c8-4bf0-9768-87234b34f998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:33.924818 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca4230-79c8-4bf0-9768-87234b34f998 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:33.925131 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca4230-79c8-4bf0-9768-87234b34f998 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:33.925407 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca4230-79c8-4bf0-9768-87234b34f998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:33.926237 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca4230-79c8-4bf0-9768-87234b34f998 None admin] RBAC: Adding query filter params (role.id=fd14ccb80b45427381dd82c06ef844b4, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=9f59e7ae8da841dc809355fa8e4be488) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:33.926548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca4230-79c8-4bf0-9768-87234b34f998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:33.928053 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca4230-79c8-4bf0-9768-87234b34f998 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:33.941009 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 322/669] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:33 2022] GET /identity/v3/role_assignments?user.id=9f59e7ae8da841dc809355fa8e4be488&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=fd14ccb80b45427381dd82c06ef844b4 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:33.941009 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca4230-79c8-4bf0-9768-87234b34f998 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:33.948850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b27ac6-8bb3-444c-b65d-3671b8fd51ba None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:33.992226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0352a7-4466-4d44-8f3d-ecc58f9feeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:33.992909 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0352a7-4466-4d44-8f3d-ecc58f9feeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:33.993244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0352a7-4466-4d44-8f3d-ecc58f9feeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:33.993525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0352a7-4466-4d44-8f3d-ecc58f9feeb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:33.994258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0352a7-4466-4d44-8f3d-ecc58f9feeb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:33.995147 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0352a7-4466-4d44-8f3d-ecc58f9feeb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:33.996526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0352a7-4466-4d44-8f3d-ecc58f9feeb6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:34.013409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 348/670] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:34.013409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0352a7-4466-4d44-8f3d-ecc58f9feeb6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:34.079524 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca4230-79c8-4bf0-9768-87234b34f998 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:34.117916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0352a7-4466-4d44-8f3d-ecc58f9feeb6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:34.118164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fce96c-bb97-4b21-b40f-2da7431fee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:34.118921 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fce96c-bb97-4b21-b40f-2da7431fee1d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:34.119204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fce96c-bb97-4b21-b40f-2da7431fee1d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:34.120063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fce96c-bb97-4b21-b40f-2da7431fee1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:34.130697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fce96c-bb97-4b21-b40f-2da7431fee1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-01fce96c-bb97-4b21-b40f-2da7431fee1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:34.138432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:34.139438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:34.140327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:34.140327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:34.140327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:34.140327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:34.140327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:34.140327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:34.140327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:34.140327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:34.140327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:34.140327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:34.140327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:34.140327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:34.141147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 323/671] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:14:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:34.141877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fce96c-bb97-4b21-b40f-2da7431fee1d None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:34.165533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec04104-dee6-4869-bc94-010da04bc7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:34.165739 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec04104-dee6-4869-bc94-010da04bc7ec None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:34.165921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec04104-dee6-4869-bc94-010da04bc7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:34.167339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec04104-dee6-4869-bc94-010da04bc7ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:34.178614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec04104-dee6-4869-bc94-010da04bc7ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:34.180547 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec04104-dee6-4869-bc94-010da04bc7ec None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-2ec04104-dee6-4869-bc94-010da04bc7ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:34.197973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:34.198873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:34.199938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:34.199938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:34.199938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:34.199938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:34.199938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 349/672] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:34.200676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004564e-b2a2-4ac3-bc86-e6dea97451be None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:34.200962 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004564e-b2a2-4ac3-bc86-e6dea97451be None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:34.201321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004564e-b2a2-4ac3-bc86-e6dea97451be None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:34.202511 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 350/673] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:34.204891 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004564e-b2a2-4ac3-bc86-e6dea97451be None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:34.249062 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fce96c-bb97-4b21-b40f-2da7431fee1d None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:34.284823 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5389055-a422-40c3-9bb5-c9027aa8a6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:34.285904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389055-a422-40c3-9bb5-c9027aa8a6ed None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:34.286342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389055-a422-40c3-9bb5-c9027aa8a6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:34.286621 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5389055-a422-40c3-9bb5-c9027aa8a6ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:34.294063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5389055-a422-40c3-9bb5-c9027aa8a6ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:34.295499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5389055-a422-40c3-9bb5-c9027aa8a6ed None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:34.306856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004564e-b2a2-4ac3-bc86-e6dea97451be None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-d5389055-a422-40c3-9bb5-c9027aa8a6ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:34.310994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:34.312181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:34.318304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:34.318304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:34.318304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:34.318304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:34.318304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:34.318304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:34.318304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:34.318304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:34.318304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 324/674] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:34.318304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5389055-a422-40c3-9bb5-c9027aa8a6ed None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:34.343516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703ffe2-e333-46d3-8e8a-01032fb2ce17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:34.344192 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703ffe2-e333-46d3-8e8a-01032fb2ce17 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:34.344473 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703ffe2-e333-46d3-8e8a-01032fb2ce17 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:34.344751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703ffe2-e333-46d3-8e8a-01032fb2ce17 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:34.345539 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703ffe2-e333-46d3-8e8a-01032fb2ce17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:34.345846 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703ffe2-e333-46d3-8e8a-01032fb2ce17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:34.347225 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703ffe2-e333-46d3-8e8a-01032fb2ce17 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:34.360021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 351/675] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:34.360021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6718c1-1764-495d-b178-2cf4df13f4a4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:34.360021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6718c1-1764-495d-b178-2cf4df13f4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:34.360021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6718c1-1764-495d-b178-2cf4df13f4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:34.424188 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5389055-a422-40c3-9bb5-c9027aa8a6ed None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:34.459807 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c172f9d-ecaf-4f2a-8950-e7b9d1bdb68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:34.460407 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c172f9d-ecaf-4f2a-8950-e7b9d1bdb68f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:34.460688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c172f9d-ecaf-4f2a-8950-e7b9d1bdb68f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:34.460960 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c172f9d-ecaf-4f2a-8950-e7b9d1bdb68f None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:34.461720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c172f9d-ecaf-4f2a-8950-e7b9d1bdb68f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:34.462034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c172f9d-ecaf-4f2a-8950-e7b9d1bdb68f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:34.463972 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c172f9d-ecaf-4f2a-8950-e7b9d1bdb68f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:34.480905 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 325/676] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:34.480905 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c172f9d-ecaf-4f2a-8950-e7b9d1bdb68f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:34.495582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2c6718c1-1764-495d-b178-2cf4df13f4a4 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:34.496955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2c6718c1-1764-495d-b178-2cf4df13f4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:34.568260 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 352/677] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:34.569132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6718c1-1764-495d-b178-2cf4df13f4a4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:34.581997 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c172f9d-ecaf-4f2a-8950-e7b9d1bdb68f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:34.616078 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc82756-c502-4765-97af-9fd3c1c1c809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:34.616740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc82756-c502-4765-97af-9fd3c1c1c809 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:34.617059 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc82756-c502-4765-97af-9fd3c1c1c809 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:34.617340 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc82756-c502-4765-97af-9fd3c1c1c809 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:34.618122 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc82756-c502-4765-97af-9fd3c1c1c809 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:34.618431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc82756-c502-4765-97af-9fd3c1c1c809 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:34.619883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc82756-c502-4765-97af-9fd3c1c1c809 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:34.631587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 326/678] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:34.632374 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc82756-c502-4765-97af-9fd3c1c1c809 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:34.691170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6718c1-1764-495d-b178-2cf4df13f4a4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:34.723608 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b0daa-72f7-4fa7-a7c5-e06daa86b601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:34.724629 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b0daa-72f7-4fa7-a7c5-e06daa86b601 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:34.724906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b0daa-72f7-4fa7-a7c5-e06daa86b601 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:34.725227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b0daa-72f7-4fa7-a7c5-e06daa86b601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:34.726967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc82756-c502-4765-97af-9fd3c1c1c809 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:34.735841 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b0daa-72f7-4fa7-a7c5-e06daa86b601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:34.737321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b0daa-72f7-4fa7-a7c5-e06daa86b601 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-a93b0daa-72f7-4fa7-a7c5-e06daa86b601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:34.754751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:34.755712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:34.756623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:34.756623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:34.756623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:34.756623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:34.756623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 353/679] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:34.757027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b0daa-72f7-4fa7-a7c5-e06daa86b601 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:34.765666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c20e00-89b9-4fb0-ae63-9f2919d25fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:34.766470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c20e00-89b9-4fb0-ae63-9f2919d25fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:34.766754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c20e00-89b9-4fb0-ae63-9f2919d25fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:34.767028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c20e00-89b9-4fb0-ae63-9f2919d25fe4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:34.774026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c20e00-89b9-4fb0-ae63-9f2919d25fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:34.775455 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c20e00-89b9-4fb0-ae63-9f2919d25fe4 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-01c20e00-89b9-4fb0-ae63-9f2919d25fe4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:34.789387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:34.790288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:34.791180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:34.791180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:34.791180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:34.791180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:34.791180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:34.791180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:34.791180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:34.791180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:34.791180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 327/680] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:34.791666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c20e00-89b9-4fb0-ae63-9f2919d25fe4 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:34.863352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b0daa-72f7-4fa7-a7c5-e06daa86b601 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:34.893259 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c20e00-89b9-4fb0-ae63-9f2919d25fe4 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:34.896265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7e53c-dbd6-4703-b06e-a0ba9ad36e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:34.897331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7e53c-dbd6-4703-b06e-a0ba9ad36e82 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:34.897612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7e53c-dbd6-4703-b06e-a0ba9ad36e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:34.897881 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7e53c-dbd6-4703-b06e-a0ba9ad36e82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:34.908376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7e53c-dbd6-4703-b06e-a0ba9ad36e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-f5a7e53c-dbd6-4703-b06e-a0ba9ad36e82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:34.916388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:34.917469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:34.918510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:34.918510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:34.918510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:34.918510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:34.918510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:34.918510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:34.918510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:34.918510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:34.918510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:34.918510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:34.918510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:34.918510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:34.920524 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 354/681] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:34.921486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7e53c-dbd6-4703-b06e-a0ba9ad36e82 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:34.925775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652b9e9-e4e6-481c-8535-ec3412a22e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:34.926429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652b9e9-e4e6-481c-8535-ec3412a22e8f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:34.926706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652b9e9-e4e6-481c-8535-ec3412a22e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:34.926975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652b9e9-e4e6-481c-8535-ec3412a22e8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:34.927910 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652b9e9-e4e6-481c-8535-ec3412a22e8f None admin] RBAC: Adding query filter params (role.id=fd14ccb80b45427381dd82c06ef844b4, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=e31558db83834034b7183223bbd0f84a) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:34.928220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652b9e9-e4e6-481c-8535-ec3412a22e8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:34.929666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652b9e9-e4e6-481c-8535-ec3412a22e8f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:34.935353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 328/682] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:34 2022] GET /identity/v3/role_assignments?user.id=e31558db83834034b7183223bbd0f84a&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=fd14ccb80b45427381dd82c06ef844b4 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:34.936104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652b9e9-e4e6-481c-8535-ec3412a22e8f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:35.050310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652b9e9-e4e6-481c-8535-ec3412a22e8f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:35.054919 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7e53c-dbd6-4703-b06e-a0ba9ad36e82 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:35.086688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbef0e6-1271-4e04-840f-6ed214bfceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:35.087490 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbef0e6-1271-4e04-840f-6ed214bfceb5 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:35.087744 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbef0e6-1271-4e04-840f-6ed214bfceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:35.088020 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbef0e6-1271-4e04-840f-6ed214bfceb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:35.089469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbef0e6-1271-4e04-840f-6ed214bfceb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:35.089773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbef0e6-1271-4e04-840f-6ed214bfceb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:35.091234 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbef0e6-1271-4e04-840f-6ed214bfceb5 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:35.093994 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af3f75-20db-485b-b0d8-a3df6193afc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:35.094913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af3f75-20db-485b-b0d8-a3df6193afc7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:35.095379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af3f75-20db-485b-b0d8-a3df6193afc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:35.095834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af3f75-20db-485b-b0d8-a3df6193afc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:35.096761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af3f75-20db-485b-b0d8-a3df6193afc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:35.097308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af3f75-20db-485b-b0d8-a3df6193afc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:35.098893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af3f75-20db-485b-b0d8-a3df6193afc7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:35.109535 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 329/683] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:35.109535 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbef0e6-1271-4e04-840f-6ed214bfceb5 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:35.117789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 355/684] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:35.123492 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af3f75-20db-485b-b0d8-a3df6193afc7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:35.228845 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbef0e6-1271-4e04-840f-6ed214bfceb5 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:35.234660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af3f75-20db-485b-b0d8-a3df6193afc7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:35.263366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2fb7d-1f8f-4fb4-b2fd-461c36d23433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:35.264103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2fb7d-1f8f-4fb4-b2fd-461c36d23433 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:35.264628 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2fb7d-1f8f-4fb4-b2fd-461c36d23433 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:35.265170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2fb7d-1f8f-4fb4-b2fd-461c36d23433 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:35.266301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2fb7d-1f8f-4fb4-b2fd-461c36d23433 None admin] RBAC: Adding query filter params (name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:35.266633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2fb7d-1f8f-4fb4-b2fd-461c36d23433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:35.267994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2fb7d-1f8f-4fb4-b2fd-461c36d23433 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:35.273365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ae823-125b-4ba6-90be-f0b6490d8ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:35.274693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ae823-125b-4ba6-90be-f0b6490d8ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:35.275140 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ae823-125b-4ba6-90be-f0b6490d8ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:35.275555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ae823-125b-4ba6-90be-f0b6490d8ba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:35.277073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ae823-125b-4ba6-90be-f0b6490d8ba1 None admin] RBAC: Adding query filter params (role.id=fd14ccb80b45427381dd82c06ef844b4, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=f319323b3f3547849d452c1361764005) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:35.277632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ae823-125b-4ba6-90be-f0b6490d8ba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:35.278951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 330/685] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:35.279796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2fb7d-1f8f-4fb4-b2fd-461c36d23433 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:35.280888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ae823-125b-4ba6-90be-f0b6490d8ba1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:35.289912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 356/686] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:35 2022] GET /identity/v3/role_assignments?user.id=f319323b3f3547849d452c1361764005&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=fd14ccb80b45427381dd82c06ef844b4 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:35.291963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ae823-125b-4ba6-90be-f0b6490d8ba1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:35.394558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2fb7d-1f8f-4fb4-b2fd-461c36d23433 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:35.433403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531d348-fc05-429a-9476-4f62826b0648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:35.434214 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531d348-fc05-429a-9476-4f62826b0648 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:35.434498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531d348-fc05-429a-9476-4f62826b0648 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:35.434771 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531d348-fc05-429a-9476-4f62826b0648 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:35.449397 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531d348-fc05-429a-9476-4f62826b0648 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:35.453406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531d348-fc05-429a-9476-4f62826b0648 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-d531d348-fc05-429a-9476-4f62826b0648 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:35.481381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:35.482393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:35.483344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:35.483344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:35.483344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:35.483344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:35.483344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:35.483344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:35.483344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:35.483344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:35.483344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:14:35.483344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:35.483344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 331/687] 10.222.0.61 () {56 vars in 1093 bytes} [Tue May 10 20:14:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:35.489630 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531d348-fc05-429a-9476-4f62826b0648 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:35.520527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ae823-125b-4ba6-90be-f0b6490d8ba1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:35.575456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff2dd4-743c-4fd6-ad03-a0d13f8b015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:35.576286 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff2dd4-743c-4fd6-ad03-a0d13f8b015f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:35.576565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff2dd4-743c-4fd6-ad03-a0d13f8b015f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:35.576838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff2dd4-743c-4fd6-ad03-a0d13f8b015f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:35.597847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff2dd4-743c-4fd6-ad03-a0d13f8b015f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:35.599594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff2dd4-743c-4fd6-ad03-a0d13f8b015f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-e6ff2dd4-743c-4fd6-ad03-a0d13f8b015f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:35.618027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:35.619038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:35.619963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:35.619963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:35.619963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:35.619963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:35.622311 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 357/688] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:35.627806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff2dd4-743c-4fd6-ad03-a0d13f8b015f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:35.633585 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531d348-fc05-429a-9476-4f62826b0648 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:35.669301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdb142-486d-432f-b1ee-568ffbf21a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:35.669728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdb142-486d-432f-b1ee-568ffbf21a0b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:35.670006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdb142-486d-432f-b1ee-568ffbf21a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:35.670279 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdb142-486d-432f-b1ee-568ffbf21a0b None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:35.671127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdb142-486d-432f-b1ee-568ffbf21a0b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:35.671434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdb142-486d-432f-b1ee-568ffbf21a0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:35.672899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdb142-486d-432f-b1ee-568ffbf21a0b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:35.694153 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 332/689] 10.222.0.61 () {56 vars in 1133 bytes} [Tue May 10 20:14:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:35.697976 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdb142-486d-432f-b1ee-568ffbf21a0b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:35.750670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff2dd4-743c-4fd6-ad03-a0d13f8b015f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:35.785559 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe649438-656a-4b4c-a2d2-08804aad76ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:35.786331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe649438-656a-4b4c-a2d2-08804aad76ce None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:35.786857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe649438-656a-4b4c-a2d2-08804aad76ce None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:35.787285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe649438-656a-4b4c-a2d2-08804aad76ce None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:35.788077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe649438-656a-4b4c-a2d2-08804aad76ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:35.788451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe649438-656a-4b4c-a2d2-08804aad76ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:35.790885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe649438-656a-4b4c-a2d2-08804aad76ce None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:35.810269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 358/690] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:35.813639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe649438-656a-4b4c-a2d2-08804aad76ce None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:35.825865 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdb142-486d-432f-b1ee-568ffbf21a0b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:35.885821 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523496e-e1ff-404e-ab4b-08abfd961a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:35.886402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523496e-e1ff-404e-ab4b-08abfd961a1f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:35.886687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523496e-e1ff-404e-ab4b-08abfd961a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:35.886959 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523496e-e1ff-404e-ab4b-08abfd961a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:35.930276 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe649438-656a-4b4c-a2d2-08804aad76ce None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:35.965493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efab5ef-4a70-42d7-83ad-44d577e61537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:35.966688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efab5ef-4a70-42d7-83ad-44d577e61537 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:35.967178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efab5ef-4a70-42d7-83ad-44d577e61537 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:35.967657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efab5ef-4a70-42d7-83ad-44d577e61537 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:35.975373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efab5ef-4a70-42d7-83ad-44d577e61537 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:35.977111 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efab5ef-4a70-42d7-83ad-44d577e61537 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-5efab5ef-4a70-42d7-83ad-44d577e61537 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:35.993516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:35.994491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:35.995423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:35.995423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:35.995423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:35.995423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:35.995423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:35.995423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:35.995423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:35.995423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:35.995423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 20:14:35.995423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:35.997982 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 359/691] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:14:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:36.003579 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efab5ef-4a70-42d7-83ad-44d577e61537 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:36.011847 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523496e-e1ff-404e-ab4b-08abfd961a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:36.013422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523496e-e1ff-404e-ab4b-08abfd961a1f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:36.105816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efab5ef-4a70-42d7-83ad-44d577e61537 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:36.135543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 333/692] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 20:14:36.136777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523496e-e1ff-404e-ab4b-08abfd961a1f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:36.140555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a90821-f6a6-4862-9808-75b06394dc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:36.141501 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a90821-f6a6-4862-9808-75b06394dc2d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:36.141986 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a90821-f6a6-4862-9808-75b06394dc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:36.142470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a90821-f6a6-4862-9808-75b06394dc2d None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:36.143513 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a90821-f6a6-4862-9808-75b06394dc2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:36.144079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a90821-f6a6-4862-9808-75b06394dc2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:36.145766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a90821-f6a6-4862-9808-75b06394dc2d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:36.164063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 360/693] 10.222.0.61 () {56 vars in 1135 bytes} [Tue May 10 20:14:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:36.169775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a90821-f6a6-4862-9808-75b06394dc2d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:36.236336 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523496e-e1ff-404e-ab4b-08abfd961a1f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:36.271639 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f1acc-db1a-429a-a796-8d0793b7163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:36.272607 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1acc-db1a-429a-a796-8d0793b7163f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:36.272883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1acc-db1a-429a-a796-8d0793b7163f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:36.273194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f1acc-db1a-429a-a796-8d0793b7163f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:36.274764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a90821-f6a6-4862-9808-75b06394dc2d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:36.283776 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f1acc-db1a-429a-a796-8d0793b7163f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:36.285269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f1acc-db1a-429a-a796-8d0793b7163f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-f05f1acc-db1a-429a-a796-8d0793b7163f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:36.302787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:36.303753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:36.304665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:36.304665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:36.304665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:36.304665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:36.308955 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 334/694] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:36.310222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f1acc-db1a-429a-a796-8d0793b7163f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:36.313775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb99b-a553-46d2-a871-ee2ec89b9d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:36.314682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb99b-a553-46d2-a871-ee2ec89b9d91 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:36.315164 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb99b-a553-46d2-a871-ee2ec89b9d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:36.315641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57beb99b-a553-46d2-a871-ee2ec89b9d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:36.386094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57beb99b-a553-46d2-a871-ee2ec89b9d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:36.387877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57beb99b-a553-46d2-a871-ee2ec89b9d91 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:36.410231 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f1acc-db1a-429a-a796-8d0793b7163f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:36.444345 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c67c5-bd3f-4397-9a2f-90cd74ff9890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:36.445101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c67c5-bd3f-4397-9a2f-90cd74ff9890 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:36.445302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c67c5-bd3f-4397-9a2f-90cd74ff9890 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:36.445575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c67c5-bd3f-4397-9a2f-90cd74ff9890 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:36.446294 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c67c5-bd3f-4397-9a2f-90cd74ff9890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:36.446599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c67c5-bd3f-4397-9a2f-90cd74ff9890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:36.448562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747c67c5-bd3f-4397-9a2f-90cd74ff9890 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:36.465323 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 335/695] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:36.466581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c67c5-bd3f-4397-9a2f-90cd74ff9890 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:36.491070 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 361/696] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 20:14:36.497363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb99b-a553-46d2-a871-ee2ec89b9d91 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:36.569739 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c67c5-bd3f-4397-9a2f-90cd74ff9890 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:36.596170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57beb99b-a553-46d2-a871-ee2ec89b9d91 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:36.604784 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001bfb7-e679-40c0-b148-2dba91472820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:36.605882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001bfb7-e679-40c0-b148-2dba91472820 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:36.606713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001bfb7-e679-40c0-b148-2dba91472820 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:36.607190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001bfb7-e679-40c0-b148-2dba91472820 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:36.616044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001bfb7-e679-40c0-b148-2dba91472820 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:36.618190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001bfb7-e679-40c0-b148-2dba91472820 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:36.632504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a971a-c6e3-4503-b14d-eeee4fe83cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:36.633388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a971a-c6e3-4503-b14d-eeee4fe83cae None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:36.633666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a971a-c6e3-4503-b14d-eeee4fe83cae None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:36.633991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a971a-c6e3-4503-b14d-eeee4fe83cae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-3001bfb7-e679-40c0-b148-2dba91472820 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:36.639242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:36.640114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:36.641129 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:36.641129 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:36.641129 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:36.641129 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:36.641129 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:36.641129 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:36.641129 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:36.641129 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:36.644278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 336/697] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:36.645789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cee63c-89e6-4cdf-a30f-3a3fe9da7dc3 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:36.646296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cee63c-89e6-4cdf-a30f-3a3fe9da7dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:36.647026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cee63c-89e6-4cdf-a30f-3a3fe9da7dc3 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:36.649033 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 337/698] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:36.650074 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cee63c-89e6-4cdf-a30f-3a3fe9da7dc3 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:36.652464 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a971a-c6e3-4503-b14d-eeee4fe83cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:36.655023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a971a-c6e3-4503-b14d-eeee4fe83cae None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-269a971a-c6e3-4503-b14d-eeee4fe83cae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:36.679487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:36.680445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:36.681389 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:36.681389 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:36.681389 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:36.681389 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:36.685301 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 362/699] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:36.686448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91c913-1fb4-492e-a214-c42ef1e7e2dc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:36.686556 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91c913-1fb4-492e-a214-c42ef1e7e2dc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:36.686842 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91c913-1fb4-492e-a214-c42ef1e7e2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:36.704872 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-da91c913-1fb4-492e-a214-c42ef1e7e2dc None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:36.706055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-da91c913-1fb4-492e-a214-c42ef1e7e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:36.768593 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cee63c-89e6-4cdf-a30f-3a3fe9da7dc3 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:36.783835 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 363/700] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:36.784928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91c913-1fb4-492e-a214-c42ef1e7e2dc None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:36.825575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086752db-eab0-4cef-8706-bcf3374e9c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:36.826455 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086752db-eab0-4cef-8706-bcf3374e9c3f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:36.826739 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086752db-eab0-4cef-8706-bcf3374e9c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:36.827011 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086752db-eab0-4cef-8706-bcf3374e9c3f None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:36.827796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086752db-eab0-4cef-8706-bcf3374e9c3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:36.828157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086752db-eab0-4cef-8706-bcf3374e9c3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:36.829856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086752db-eab0-4cef-8706-bcf3374e9c3f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:36.846782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 338/701] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:36.849584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086752db-eab0-4cef-8706-bcf3374e9c3f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:36.900037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91c913-1fb4-492e-a214-c42ef1e7e2dc None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:36.934375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b8920-653a-4dea-8d86-7d72e407bec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:36.935032 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b8920-653a-4dea-8d86-7d72e407bec2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:36.935308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b8920-653a-4dea-8d86-7d72e407bec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:36.935576 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b8920-653a-4dea-8d86-7d72e407bec2 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:36.936284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b8920-653a-4dea-8d86-7d72e407bec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:36.936584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b8920-653a-4dea-8d86-7d72e407bec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:36.938034 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b8920-653a-4dea-8d86-7d72e407bec2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:36.953907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 364/702] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:36.954736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b8920-653a-4dea-8d86-7d72e407bec2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:36.977975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086752db-eab0-4cef-8706-bcf3374e9c3f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:37.020649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f3ea3-d60d-49de-adae-9de9cdf7ed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:37.022541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3ea3-d60d-49de-adae-9de9cdf7ed39 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:37.023303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3ea3-d60d-49de-adae-9de9cdf7ed39 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:37.023803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3ea3-d60d-49de-adae-9de9cdf7ed39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:37.038640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f3ea3-d60d-49de-adae-9de9cdf7ed39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:37.040381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f3ea3-d60d-49de-adae-9de9cdf7ed39 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-a49f3ea3-d60d-49de-adae-9de9cdf7ed39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:37.064249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:37.065245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:37.066143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:37.066143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:37.066143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:37.066143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:37.066376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b8920-653a-4dea-8d86-7d72e407bec2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:37.069143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 339/703] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:37.070150 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f3ea3-d60d-49de-adae-9de9cdf7ed39 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:37.104995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2445e23-4d84-4413-bd42-16786fa0acf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:37.105661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2445e23-4d84-4413-bd42-16786fa0acf6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:37.105940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2445e23-4d84-4413-bd42-16786fa0acf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:37.106214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2445e23-4d84-4413-bd42-16786fa0acf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:37.107087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2445e23-4d84-4413-bd42-16786fa0acf6 None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:37.107397 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2445e23-4d84-4413-bd42-16786fa0acf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:37.108833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2445e23-4d84-4413-bd42-16786fa0acf6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:37.121320 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 365/704] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:36 2022] GET /identity/v3/role_assignments?user.id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:37.122314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2445e23-4d84-4413-bd42-16786fa0acf6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:37.190600 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f3ea3-d60d-49de-adae-9de9cdf7ed39 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:37.230106 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7319d1-dfac-4a1d-ad07-2706967c3698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:37.232163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7319d1-dfac-4a1d-ad07-2706967c3698 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:37.232705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7319d1-dfac-4a1d-ad07-2706967c3698 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:37.233256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7319d1-dfac-4a1d-ad07-2706967c3698 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:37.242149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7319d1-dfac-4a1d-ad07-2706967c3698 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:37.243990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7319d1-dfac-4a1d-ad07-2706967c3698 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-1a7319d1-dfac-4a1d-ad07-2706967c3698 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:37.260641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:37.261657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:37.262541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:37.262541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:37.262541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:37.262541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:37.262541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:37.262541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:37.262541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:37.262541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:37.265515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 340/705] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:37.270754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7319d1-dfac-4a1d-ad07-2706967c3698 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:37.374941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2445e23-4d84-4413-bd42-16786fa0acf6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:37.411588 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7319d1-dfac-4a1d-ad07-2706967c3698 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:37.451046 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720d37d-422d-4a60-ada3-93f433a9b37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:37.452071 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720d37d-422d-4a60-ada3-93f433a9b37d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:37.452582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720d37d-422d-4a60-ada3-93f433a9b37d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:37.453082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720d37d-422d-4a60-ada3-93f433a9b37d None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:37.454310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720d37d-422d-4a60-ada3-93f433a9b37d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:37.454883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720d37d-422d-4a60-ada3-93f433a9b37d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:37.456520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720d37d-422d-4a60-ada3-93f433a9b37d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:37.462223 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f62dcd-8461-4c56-8e07-6dede00edfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:37.462897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f62dcd-8461-4c56-8e07-6dede00edfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:37.463221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f62dcd-8461-4c56-8e07-6dede00edfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:37.463496 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f62dcd-8461-4c56-8e07-6dede00edfd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:37.464224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f62dcd-8461-4c56-8e07-6dede00edfd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:37.464531 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f62dcd-8461-4c56-8e07-6dede00edfd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:37.465907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f62dcd-8461-4c56-8e07-6dede00edfd1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:37.471458 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 341/706] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:37.477925 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720d37d-422d-4a60-ada3-93f433a9b37d None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:37.483897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 366/707] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:37.493973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f62dcd-8461-4c56-8e07-6dede00edfd1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:37.579551 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720d37d-422d-4a60-ada3-93f433a9b37d None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:37.613601 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0975b-24f4-4dfc-adf6-f7a019649ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:37.614659 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0975b-24f4-4dfc-adf6-f7a019649ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:37.615145 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0975b-24f4-4dfc-adf6-f7a019649ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:37.615631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0975b-24f4-4dfc-adf6-f7a019649ba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:37.616663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0975b-24f4-4dfc-adf6-f7a019649ba6 None admin] RBAC: Adding query filter params (role.id=fd14ccb80b45427381dd82c06ef844b4, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=6acfba37d6b84bf3a63d40e6e4096f5d) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:37.617233 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0975b-24f4-4dfc-adf6-f7a019649ba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:37.618872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0975b-24f4-4dfc-adf6-f7a019649ba6 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:37.626136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 342/708] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:37 2022] GET /identity/v3/role_assignments?user.id=6acfba37d6b84bf3a63d40e6e4096f5d&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=fd14ccb80b45427381dd82c06ef844b4 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:37.657586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f62dcd-8461-4c56-8e07-6dede00edfd1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:37.662649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24718e53-0ebf-40e5-b8d0-1ea239443baf None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:37.662946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24718e53-0ebf-40e5-b8d0-1ea239443baf None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:37.663210 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24718e53-0ebf-40e5-b8d0-1ea239443baf None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:37.667858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 343/709] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:37.673115 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cc076-7753-45b2-90b8-78aab745e00b None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:37.673437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cc076-7753-45b2-90b8-78aab745e00b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:37.673668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cc076-7753-45b2-90b8-78aab745e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:37.705383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-a02cc076-7753-45b2-90b8-78aab745e00b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:37.706445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681787d7-2b25-485f-849f-272d61912bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:37.706599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a02cc076-7753-45b2-90b8-78aab745e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:37.707169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681787d7-2b25-485f-849f-272d61912bae None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:37.707447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681787d7-2b25-485f-849f-272d61912bae None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:37.707767 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681787d7-2b25-485f-849f-272d61912bae None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:37.708476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681787d7-2b25-485f-849f-272d61912bae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:37.709948 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681787d7-2b25-485f-849f-272d61912bae None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:37.732237 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 367/710] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:14:37 2022] POST /identity/v3/users => generated 254 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:14:37.831213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 344/711] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:14:37.868499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681787d7-2b25-485f-849f-272d61912bae None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:37.983890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681787d7-2b25-485f-849f-272d61912bae None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:38.021756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c358452-f556-4c68-bea2-45d6c0c90141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:38.022805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c358452-f556-4c68-bea2-45d6c0c90141 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:38.023078 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c358452-f556-4c68-bea2-45d6c0c90141 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:38.023343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c358452-f556-4c68-bea2-45d6c0c90141 None admin] PATH_INFO: `/v3/services/network` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:38.024048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c358452-f556-4c68-bea2-45d6c0c90141 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:38.026106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c358452-f556-4c68-bea2-45d6c0c90141 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-9c358452-f556-4c68-bea2-45d6c0c90141 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:38.039305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:38.040377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:38.041807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:38.041807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:38.041807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:38.041807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:38.041807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:38.041807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:38.041807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:38.041807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:38.041807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:38.041807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:38.041807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:14:38.041807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:38.041807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:14:38.041807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:38.042543 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 368/712] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:37 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:38.047512 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cc076-7753-45b2-90b8-78aab745e00b None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:38.117682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fccca2-3936-49fd-9ba9-7fc7e3404dea None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:38.117970 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fccca2-3936-49fd-9ba9-7fc7e3404dea None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:38.118252 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fccca2-3936-49fd-9ba9-7fc7e3404dea None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:38.119912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 369/713] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:14:38.125178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cfb74-d8d3-442a-9182-35d0aef351b5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:38.125463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cfb74-d8d3-442a-9182-35d0aef351b5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:38.125744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cfb74-d8d3-442a-9182-35d0aef351b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:38.145832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0b8cfb74-d8d3-442a-9182-35d0aef351b5 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:38.147292 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0b8cfb74-d8d3-442a-9182-35d0aef351b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:38.161749 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cc076-7753-45b2-90b8-78aab745e00b None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:38.196688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d986b1-c8d2-4680-845e-4693e389c94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:38.197932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d986b1-c8d2-4680-845e-4693e389c94d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:38.198218 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d986b1-c8d2-4680-845e-4693e389c94d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:38.198495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d986b1-c8d2-4680-845e-4693e389c94d None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:38.199210 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d986b1-c8d2-4680-845e-4693e389c94d None admin] RBAC: Adding query filter params (name=network) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:38.199522 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d986b1-c8d2-4680-845e-4693e389c94d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:38.200890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d986b1-c8d2-4680-845e-4693e389c94d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:38.205687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 345/714] 10.222.0.61 () {56 vars in 1112 bytes} [Tue May 10 20:14:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:38.214445 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d986b1-c8d2-4680-845e-4693e389c94d None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:38.238127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 370/715] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:14:38.342363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d986b1-c8d2-4680-845e-4693e389c94d None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:38.346474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cfb74-d8d3-442a-9182-35d0aef351b5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:38.399085 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ea2fa-26df-4b47-b304-c09d9251751b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:38.399760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ea2fa-26df-4b47-b304-c09d9251751b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:38.400042 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ea2fa-26df-4b47-b304-c09d9251751b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:38.400368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ea2fa-26df-4b47-b304-c09d9251751b None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:38.401720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ea2fa-26df-4b47-b304-c09d9251751b None admin] RBAC: Adding query filter params (type=network) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:38.402031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ea2fa-26df-4b47-b304-c09d9251751b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:38.403422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ea2fa-26df-4b47-b304-c09d9251751b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:38.425016 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 346/716] 10.222.0.61 () {56 vars in 1112 bytes} [Tue May 10 20:14:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:38.473623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cfb74-d8d3-442a-9182-35d0aef351b5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:38.520229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac91716-2e66-4cbe-aae9-9a84ed85e9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:38.521006 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac91716-2e66-4cbe-aae9-9a84ed85e9ff None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:38.521295 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac91716-2e66-4cbe-aae9-9a84ed85e9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:38.521568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac91716-2e66-4cbe-aae9-9a84ed85e9ff None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:38.522500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac91716-2e66-4cbe-aae9-9a84ed85e9ff None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:38.523907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac91716-2e66-4cbe-aae9-9a84ed85e9ff None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-9ac91716-2e66-4cbe-aae9-9a84ed85e9ff None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:38.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:38.538277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:38.539104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 371/717] 10.222.0.61 () {56 vars in 1129 bytes} [Tue May 10 20:14:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:38.544859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ea2fa-26df-4b47-b304-c09d9251751b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:38.656946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ea2fa-26df-4b47-b304-c09d9251751b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:38.692904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cafd54-ceb6-4b44-bcb2-811e0c7c3a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:38.693779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cafd54-ceb6-4b44-bcb2-811e0c7c3a88 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:38.694062 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cafd54-ceb6-4b44-bcb2-811e0c7c3a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:38.694332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cafd54-ceb6-4b44-bcb2-811e0c7c3a88 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:38.695040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cafd54-ceb6-4b44-bcb2-811e0c7c3a88 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:38.695343 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cafd54-ceb6-4b44-bcb2-811e0c7c3a88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:38.696699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cafd54-ceb6-4b44-bcb2-811e0c7c3a88 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:38.701937 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 347/718] 10.222.0.61 () {56 vars in 1124 bytes} [Tue May 10 20:14:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:38.707121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac91716-2e66-4cbe-aae9-9a84ed85e9ff None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:38.814237 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac91716-2e66-4cbe-aae9-9a84ed85e9ff None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:38.862616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8047e8f-112a-4d1e-81aa-422eb13d6469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:38.863290 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8047e8f-112a-4d1e-81aa-422eb13d6469 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:38.863573 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8047e8f-112a-4d1e-81aa-422eb13d6469 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:38.863849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8047e8f-112a-4d1e-81aa-422eb13d6469 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:38.864554 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8047e8f-112a-4d1e-81aa-422eb13d6469 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:38.864859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8047e8f-112a-4d1e-81aa-422eb13d6469 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:38.866249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8047e8f-112a-4d1e-81aa-422eb13d6469 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:38.876766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 372/719] 10.222.0.61 () {56 vars in 1124 bytes} [Tue May 10 20:14:38 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:39.823069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e1bb-ec99-4f4b-aaa6-2729e8a83530 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:39.823591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e1bb-ec99-4f4b-aaa6-2729e8a83530 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:39.823705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30e1bb-ec99-4f4b-aaa6-2729e8a83530 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:39.825261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 348/720] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:39.830381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d16ea8-f9cb-4c3b-98c0-a78f1ce7ea4b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:39.830799 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d16ea8-f9cb-4c3b-98c0-a78f1ce7ea4b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:39.830975 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d16ea8-f9cb-4c3b-98c0-a78f1ce7ea4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:39.852922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a6d16ea8-f9cb-4c3b-98c0-a78f1ce7ea4b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:39.854663 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a6d16ea8-f9cb-4c3b-98c0-a78f1ce7ea4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:39.944045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 373/721] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:39.978513 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e1bb-ec99-4f4b-aaa6-2729e8a83530 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:40.133654 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30e1bb-ec99-4f4b-aaa6-2729e8a83530 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:40.177342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5750cde-fd1e-4a32-9943-4ee35ea7adf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:40.178491 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750cde-fd1e-4a32-9943-4ee35ea7adf7 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:40.178973 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750cde-fd1e-4a32-9943-4ee35ea7adf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:40.179443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750cde-fd1e-4a32-9943-4ee35ea7adf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:40.197841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5750cde-fd1e-4a32-9943-4ee35ea7adf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-a5750cde-fd1e-4a32-9943-4ee35ea7adf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:40.205640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:40.206645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:40.207504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:40.207504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:40.207504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:40.207504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:40.207504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:40.207504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:40.207504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:40.207504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:40.207504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:40.207504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:40.207504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:40.207504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:40.210172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 349/722] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:14:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:40.216183 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d16ea8-f9cb-4c3b-98c0-a78f1ce7ea4b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:40.381778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d16ea8-f9cb-4c3b-98c0-a78f1ce7ea4b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:40.433766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc587b4-06d9-480b-97d3-ae8e16febc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:40.434381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc587b4-06d9-480b-97d3-ae8e16febc80 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:40.434666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc587b4-06d9-480b-97d3-ae8e16febc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:40.434944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc587b4-06d9-480b-97d3-ae8e16febc80 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:40.435703 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc587b4-06d9-480b-97d3-ae8e16febc80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:40.436010 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc587b4-06d9-480b-97d3-ae8e16febc80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:40.437408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc587b4-06d9-480b-97d3-ae8e16febc80 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:40.446091 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 374/723] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:40.451920 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5750cde-fd1e-4a32-9943-4ee35ea7adf7 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:40.556194 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be7c01-a89f-41d9-8ce8-a760d12affaf None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:40.556482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be7c01-a89f-41d9-8ce8-a760d12affaf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:40.556799 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be7c01-a89f-41d9-8ce8-a760d12affaf None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:40.558455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 375/724] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:40.565565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb1fc0-d026-4e97-8e44-f6261c191721 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:40.565852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb1fc0-d026-4e97-8e44-f6261c191721 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:40.566132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eb1fc0-d026-4e97-8e44-f6261c191721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:40.597981 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-86eb1fc0-d026-4e97-8e44-f6261c191721 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:40.599521 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-86eb1fc0-d026-4e97-8e44-f6261c191721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:40.633302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5750cde-fd1e-4a32-9943-4ee35ea7adf7 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:40.675081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcd506-934e-4923-a043-2c2e5b6a7865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:40.676243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcd506-934e-4923-a043-2c2e5b6a7865 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:40.677295 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcd506-934e-4923-a043-2c2e5b6a7865 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:40.678288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcd506-934e-4923-a043-2c2e5b6a7865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:40.699782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcd506-934e-4923-a043-2c2e5b6a7865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:40.701629 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcd506-934e-4923-a043-2c2e5b6a7865 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-25dcd506-934e-4923-a043-2c2e5b6a7865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:40.723834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:40.724750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:40.725677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:40.725677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:40.725677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:40.725677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:40.727825 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 350/726] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:40.727941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 376/726] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:40.732990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33dec0-c90f-4087-b1c3-828d501e1c20 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:40.732990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33dec0-c90f-4087-b1c3-828d501e1c20 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:40.732990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd33dec0-c90f-4087-b1c3-828d501e1c20 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:40.735496 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 377/727] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:40.736562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcd506-934e-4923-a043-2c2e5b6a7865 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:40.736896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0aff5-a564-44d4-b99a-a22b7ae8e3f1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:40.737203 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0aff5-a564-44d4-b99a-a22b7ae8e3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:40.737476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0aff5-a564-44d4-b99a-a22b7ae8e3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:40.757281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-27a0aff5-a564-44d4-b99a-a22b7ae8e3f1 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:40.757281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-27a0aff5-a564-44d4-b99a-a22b7ae8e3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:40.832582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 378/728] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:40.834205 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0aff5-a564-44d4-b99a-a22b7ae8e3f1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:40.882492 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcd506-934e-4923-a043-2c2e5b6a7865 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:40.928664 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7506474-c529-4329-8f6f-ab944a8b700b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:40.929747 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7506474-c529-4329-8f6f-ab944a8b700b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:40.930227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7506474-c529-4329-8f6f-ab944a8b700b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:40.930716 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7506474-c529-4329-8f6f-ab944a8b700b None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:40.932190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7506474-c529-4329-8f6f-ab944a8b700b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:40.932721 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7506474-c529-4329-8f6f-ab944a8b700b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:40.934333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7506474-c529-4329-8f6f-ab944a8b700b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:40.941619 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0aff5-a564-44d4-b99a-a22b7ae8e3f1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:40.946919 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 351/729] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:40.948580 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7506474-c529-4329-8f6f-ab944a8b700b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:40.981050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284474fb-2c01-4c07-92bf-3a31747467be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:40.981952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284474fb-2c01-4c07-92bf-3a31747467be None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:40.982330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284474fb-2c01-4c07-92bf-3a31747467be None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:40.982835 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284474fb-2c01-4c07-92bf-3a31747467be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:40.995256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284474fb-2c01-4c07-92bf-3a31747467be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-284474fb-2c01-4c07-92bf-3a31747467be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:41.003109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:41.004028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:41.004874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:41.004874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:41.004874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:41.004874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:41.004874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:41.004874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:41.004874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:41.004874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:41.004874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:41.004874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:41.004874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:41.004874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:41.007580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 379/730] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:14:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:41.013711 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284474fb-2c01-4c07-92bf-3a31747467be None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:41.048777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7506474-c529-4329-8f6f-ab944a8b700b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:41.086648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5aa50-1630-4484-a603-748c9442d4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:41.087803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5aa50-1630-4484-a603-748c9442d4bf None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:41.088261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5aa50-1630-4484-a603-748c9442d4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:41.088719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5aa50-1630-4484-a603-748c9442d4bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:41.099992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5aa50-1630-4484-a603-748c9442d4bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-23a5aa50-1630-4484-a603-748c9442d4bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:41.108155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:41.109099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:41.109936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:41.109936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:41.109936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:41.109936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:41.109936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:41.109936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:41.109936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:41.109936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:41.109936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:41.109936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:41.109936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:41.109936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:41.116826 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 352/731] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:41.117908 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5aa50-1630-4484-a603-748c9442d4bf None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:41.122088 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284474fb-2c01-4c07-92bf-3a31747467be None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:41.156260 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc878011-3b8b-4c0f-a84a-ca1da10aad1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:41.157459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc878011-3b8b-4c0f-a84a-ca1da10aad1f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:41.157946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc878011-3b8b-4c0f-a84a-ca1da10aad1f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:41.158419 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc878011-3b8b-4c0f-a84a-ca1da10aad1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:41.166868 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc878011-3b8b-4c0f-a84a-ca1da10aad1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:41.168603 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc878011-3b8b-4c0f-a84a-ca1da10aad1f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-fc878011-3b8b-4c0f-a84a-ca1da10aad1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:41.185149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:41.186199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:41.187166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:41.187166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:41.187166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:41.187166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:41.187166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:41.187166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:41.187166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:41.187166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:41.187166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:14:41.187166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:41.194399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 380/732] 10.222.0.61 () {56 vars in 1093 bytes} [Tue May 10 20:14:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:41.195824 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc878011-3b8b-4c0f-a84a-ca1da10aad1f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:41.220608 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5aa50-1630-4484-a603-748c9442d4bf None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:41.254874 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9669c-315e-4c48-ae69-77d2b4ebbf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:41.255463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9669c-315e-4c48-ae69-77d2b4ebbf6b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:41.255742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9669c-315e-4c48-ae69-77d2b4ebbf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:41.256016 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9669c-315e-4c48-ae69-77d2b4ebbf6b None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:41.256746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9669c-315e-4c48-ae69-77d2b4ebbf6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:41.257082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9669c-315e-4c48-ae69-77d2b4ebbf6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:41.258463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9669c-315e-4c48-ae69-77d2b4ebbf6b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:41.266495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 353/733] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:41.269011 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9669c-315e-4c48-ae69-77d2b4ebbf6b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:41.295484 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc878011-3b8b-4c0f-a84a-ca1da10aad1f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:41.328316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c516532-82ea-4f08-9551-93d10a42f4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:41.329301 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c516532-82ea-4f08-9551-93d10a42f4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:41.329801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c516532-82ea-4f08-9551-93d10a42f4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:41.330270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c516532-82ea-4f08-9551-93d10a42f4f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:41.331258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c516532-82ea-4f08-9551-93d10a42f4f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:41.331772 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c516532-82ea-4f08-9551-93d10a42f4f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:41.333217 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c516532-82ea-4f08-9551-93d10a42f4f8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:41.341011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 381/734] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:41.342423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66650fa-c4bf-4b60-b129-2c8134b1a435 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:41.342714 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66650fa-c4bf-4b60-b129-2c8134b1a435 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:41.342993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66650fa-c4bf-4b60-b129-2c8134b1a435 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:41.344379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 382/735] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:41.344878 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66650fa-c4bf-4b60-b129-2c8134b1a435 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:41.373911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9669c-315e-4c48-ae69-77d2b4ebbf6b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:41.410244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680e639-0f9a-45bb-951c-66bfffca58de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:41.410954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680e639-0f9a-45bb-951c-66bfffca58de None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:41.411206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680e639-0f9a-45bb-951c-66bfffca58de None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:41.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680e639-0f9a-45bb-951c-66bfffca58de None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:41.412329 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680e639-0f9a-45bb-951c-66bfffca58de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:41.412643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680e639-0f9a-45bb-951c-66bfffca58de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:41.414138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680e639-0f9a-45bb-951c-66bfffca58de None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:41.433353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 354/736] 10.222.0.61 () {56 vars in 1133 bytes} [Tue May 10 20:14:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:41.434621 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58577690-98d2-4cd9-9c25-ddc4d292a973 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:41.434905 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58577690-98d2-4cd9-9c25-ddc4d292a973 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:41.435180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58577690-98d2-4cd9-9c25-ddc4d292a973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:41.452010 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-58577690-98d2-4cd9-9c25-ddc4d292a973 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:41.453204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-58577690-98d2-4cd9-9c25-ddc4d292a973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:41.459439 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66650fa-c4bf-4b60-b129-2c8134b1a435 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:41.495843 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6102600-5593-45d4-95fa-5e9374d2e0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:41.497023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6102600-5593-45d4-95fa-5e9374d2e0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:41.497540 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6102600-5593-45d4-95fa-5e9374d2e0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:41.497993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6102600-5593-45d4-95fa-5e9374d2e0b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:41.509337 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6102600-5593-45d4-95fa-5e9374d2e0b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:41.511135 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6102600-5593-45d4-95fa-5e9374d2e0b0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d6102600-5593-45d4-95fa-5e9374d2e0b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:41.530847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:41.531806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:41.532687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:41.532687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:41.532687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:41.532687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:41.539622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 383/737] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:41.539622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6102600-5593-45d4-95fa-5e9374d2e0b0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:41.636518 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 355/738] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:41.637381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58577690-98d2-4cd9-9c25-ddc4d292a973 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:41.637647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6102600-5593-45d4-95fa-5e9374d2e0b0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:41.670688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d35b25-84db-480c-a084-74505679df69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:41.671478 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d35b25-84db-480c-a084-74505679df69 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:41.671761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d35b25-84db-480c-a084-74505679df69 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:41.672040 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d35b25-84db-480c-a084-74505679df69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:41.682063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d35b25-84db-480c-a084-74505679df69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:41.683488 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d35b25-84db-480c-a084-74505679df69 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-73d35b25-84db-480c-a084-74505679df69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:41.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:41.700538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:41.702069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:41.702069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:41.702069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:41.702069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:41.702069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 384/739] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:41.702069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d35b25-84db-480c-a084-74505679df69 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:41.733955 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58577690-98d2-4cd9-9c25-ddc4d292a973 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:41.765548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47fe80-21c2-4368-865e-0a472b048f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:41.766270 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47fe80-21c2-4368-865e-0a472b048f8e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:41.766551 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47fe80-21c2-4368-865e-0a472b048f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:41.766827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47fe80-21c2-4368-865e-0a472b048f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:41.776954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47fe80-21c2-4368-865e-0a472b048f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:41.778404 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47fe80-21c2-4368-865e-0a472b048f8e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:41.794141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d35b25-84db-480c-a084-74505679df69 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-5b47fe80-21c2-4368-865e-0a472b048f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:41.794508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:41.795507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:41.796409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:41.796409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:41.796409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:41.796409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:41.796409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 356/740] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:41.796850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f2ef9-913f-4975-a81e-c6929c2290f6 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:41.797162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f2ef9-913f-4975-a81e-c6929c2290f6 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:41.797412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f2ef9-913f-4975-a81e-c6929c2290f6 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:41.798645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 357/741] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:41.799760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f2ef9-913f-4975-a81e-c6929c2290f6 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:41.832774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1dcf0-f377-4be1-8c2c-bd9b737256be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:41.833462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1dcf0-f377-4be1-8c2c-bd9b737256be None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:41.833743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1dcf0-f377-4be1-8c2c-bd9b737256be None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:41.834015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1dcf0-f377-4be1-8c2c-bd9b737256be None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:41.834724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1dcf0-f377-4be1-8c2c-bd9b737256be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:41.835029 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1dcf0-f377-4be1-8c2c-bd9b737256be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:41.836384 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1dcf0-f377-4be1-8c2c-bd9b737256be None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:41.847708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 385/742] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:41.848504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1dcf0-f377-4be1-8c2c-bd9b737256be None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:41.894299 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f2ef9-913f-4975-a81e-c6929c2290f6 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:41.932230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a11694-a44e-4536-8aaf-7a0f7dc0cdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:41.932891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a11694-a44e-4536-8aaf-7a0f7dc0cdd3 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:41.933201 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a11694-a44e-4536-8aaf-7a0f7dc0cdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:41.933477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a11694-a44e-4536-8aaf-7a0f7dc0cdd3 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:41.934191 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a11694-a44e-4536-8aaf-7a0f7dc0cdd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:41.935543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a11694-a44e-4536-8aaf-7a0f7dc0cdd3 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:41.943475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1dcf0-f377-4be1-8c2c-bd9b737256be None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:41.949523 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 358/743] 10.222.0.61 () {60 vars in 1141 bytes} [Tue May 10 20:14:41 2022] POST /identity/v3/services => generated 240 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:14:41.950107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a11694-a44e-4536-8aaf-7a0f7dc0cdd3 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:41.994926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f6c00-901a-44bf-8283-c923a436aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:41.995704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f6c00-901a-44bf-8283-c923a436aba1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:41.996050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f6c00-901a-44bf-8283-c923a436aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:41.996396 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f6c00-901a-44bf-8283-c923a436aba1 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:41.997236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f6c00-901a-44bf-8283-c923a436aba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:41.997731 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f6c00-901a-44bf-8283-c923a436aba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:41.998909 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f6c00-901a-44bf-8283-c923a436aba1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:42.011156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 386/744] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:42.012591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a27c46-e0e6-415f-bf3b-e8dd1b359194 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:42.012882 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a27c46-e0e6-415f-bf3b-e8dd1b359194 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:42.013207 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a27c46-e0e6-415f-bf3b-e8dd1b359194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:42.031161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-72a27c46-e0e6-415f-bf3b-e8dd1b359194 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:42.032282 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-72a27c46-e0e6-415f-bf3b-e8dd1b359194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:42.076842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a11694-a44e-4536-8aaf-7a0f7dc0cdd3 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:42.110576 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 387/745] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:42 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:14:42.111442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a27c46-e0e6-415f-bf3b-e8dd1b359194 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:42.122126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85ef96-c2ca-4374-971f-63f53082b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:42.123057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85ef96-c2ca-4374-971f-63f53082b220 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:42.123481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85ef96-c2ca-4374-971f-63f53082b220 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:42.123915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85ef96-c2ca-4374-971f-63f53082b220 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:42.124854 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85ef96-c2ca-4374-971f-63f53082b220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:42.125323 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85ef96-c2ca-4374-971f-63f53082b220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:42.126913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85ef96-c2ca-4374-971f-63f53082b220 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:42.145744 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 359/746] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:42.146083 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85ef96-c2ca-4374-971f-63f53082b220 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:42.210423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a27c46-e0e6-415f-bf3b-e8dd1b359194 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:42.243343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d1ef1-9e4b-45c2-89d0-b4d282dcff56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:42.244185 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d1ef1-9e4b-45c2-89d0-b4d282dcff56 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:42.244475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d1ef1-9e4b-45c2-89d0-b4d282dcff56 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:42.244749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d1ef1-9e4b-45c2-89d0-b4d282dcff56 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:42.247575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85ef96-c2ca-4374-971f-63f53082b220 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:42.251927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d1ef1-9e4b-45c2-89d0-b4d282dcff56 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:42.253493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d1ef1-9e4b-45c2-89d0-b4d282dcff56 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ab3d1ef1-9e4b-45c2-89d0-b4d282dcff56 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:42.268542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:42.269748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:42.270693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:42.270693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:42.270693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:42.270693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:42.270693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:42.270693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:42.270693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:42.270693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:42.270693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 20:14:42.270693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:42.270693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 388/747] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:14:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:42.270693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d1ef1-9e4b-45c2-89d0-b4d282dcff56 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:42.285723 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65d145-1b6e-4562-8d92-cb558798e8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:42.286500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d145-1b6e-4562-8d92-cb558798e8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:42.286785 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d145-1b6e-4562-8d92-cb558798e8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:42.287057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d145-1b6e-4562-8d92-cb558798e8a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:42.294093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65d145-1b6e-4562-8d92-cb558798e8a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:42.295523 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65d145-1b6e-4562-8d92-cb558798e8a3 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-bd65d145-1b6e-4562-8d92-cb558798e8a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:42.310474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:42.311441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:42.312376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:42.312376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:42.312376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:42.312376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:42.312376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:42.312376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:42.312376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:42.312376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:42.312376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:14:42.312376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:42.316366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 360/748] 10.222.0.61 () {56 vars in 1117 bytes} [Tue May 10 20:14:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:42.317086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65d145-1b6e-4562-8d92-cb558798e8a3 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:42.372176 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d1ef1-9e4b-45c2-89d0-b4d282dcff56 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:42.411617 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6d1b7-0ae0-4c20-9b2d-52f8c0604a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:42.412281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6d1b7-0ae0-4c20-9b2d-52f8c0604a10 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:42.412563 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6d1b7-0ae0-4c20-9b2d-52f8c0604a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:42.412840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6d1b7-0ae0-4c20-9b2d-52f8c0604a10 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:42.413604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6d1b7-0ae0-4c20-9b2d-52f8c0604a10 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:42.415039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6d1b7-0ae0-4c20-9b2d-52f8c0604a10 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:42.415308 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65d145-1b6e-4562-8d92-cb558798e8a3 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:42.429425 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 389/749] 10.222.0.61 () {60 vars in 1141 bytes} [Tue May 10 20:14:42 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:14:42.430650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6d1b7-0ae0-4c20-9b2d-52f8c0604a10 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:42.472537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f49b0-1ff7-4954-87a7-731b6bad6372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:42.473389 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f49b0-1ff7-4954-87a7-731b6bad6372 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:42.473670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f49b0-1ff7-4954-87a7-731b6bad6372 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:42.473944 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f49b0-1ff7-4954-87a7-731b6bad6372 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:42.482715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f49b0-1ff7-4954-87a7-731b6bad6372 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:42.484172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f49b0-1ff7-4954-87a7-731b6bad6372 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-883f49b0-1ff7-4954-87a7-731b6bad6372 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:42.499179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:42.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:42.501182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:42.501182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:42.501182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:42.501182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:42.501182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:42.501182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:42.501182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:42.501182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:42.507328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 361/750] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:42.508331 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f49b0-1ff7-4954-87a7-731b6bad6372 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:42.566820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6d1b7-0ae0-4c20-9b2d-52f8c0604a10 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:42.614261 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b632a76-e367-4e46-88f0-7b2d9bbec6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:42.614961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b632a76-e367-4e46-88f0-7b2d9bbec6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:42.615250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b632a76-e367-4e46-88f0-7b2d9bbec6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:42.615539 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b632a76-e367-4e46-88f0-7b2d9bbec6b5 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:42.616167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f49b0-1ff7-4954-87a7-731b6bad6372 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:42.616403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b632a76-e367-4e46-88f0-7b2d9bbec6b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:42.616720 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b632a76-e367-4e46-88f0-7b2d9bbec6b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:42.619263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b632a76-e367-4e46-88f0-7b2d9bbec6b5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:42.640932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 390/751] 10.222.0.61 () {56 vars in 1135 bytes} [Tue May 10 20:14:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:42.641803 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b632a76-e367-4e46-88f0-7b2d9bbec6b5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:42.655652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34cd2a-1957-42bb-a9b8-eee2968e6041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:42.656328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34cd2a-1957-42bb-a9b8-eee2968e6041 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:42.656636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34cd2a-1957-42bb-a9b8-eee2968e6041 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:42.656914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34cd2a-1957-42bb-a9b8-eee2968e6041 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:42.657783 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34cd2a-1957-42bb-a9b8-eee2968e6041 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:42.658095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34cd2a-1957-42bb-a9b8-eee2968e6041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:42.659589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34cd2a-1957-42bb-a9b8-eee2968e6041 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:42.679088 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 362/752] 10.222.0.61 () {56 vars in 1149 bytes} [Tue May 10 20:14:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:42.680013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34cd2a-1957-42bb-a9b8-eee2968e6041 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:42.762816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b632a76-e367-4e46-88f0-7b2d9bbec6b5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:42.792796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34cd2a-1957-42bb-a9b8-eee2968e6041 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:42.797011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b918ba-b086-48d9-b75b-f11c6e719dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:42.797773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b918ba-b086-48d9-b75b-f11c6e719dbc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:42.798184 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b918ba-b086-48d9-b75b-f11c6e719dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:42.798532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b918ba-b086-48d9-b75b-f11c6e719dbc None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:42.799392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b918ba-b086-48d9-b75b-f11c6e719dbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:42.799773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b918ba-b086-48d9-b75b-f11c6e719dbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:42.801302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b918ba-b086-48d9-b75b-f11c6e719dbc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:42.817805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 391/753] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:42.818855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b918ba-b086-48d9-b75b-f11c6e719dbc None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:42.834489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1bb5b-3afa-4ab5-9522-9fd2d1b90052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:42.835783 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1bb5b-3afa-4ab5-9522-9fd2d1b90052 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:42.836517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1bb5b-3afa-4ab5-9522-9fd2d1b90052 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:42.837011 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1bb5b-3afa-4ab5-9522-9fd2d1b90052 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:42.920455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b918ba-b086-48d9-b75b-f11c6e719dbc None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:42.923809 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1bb5b-3afa-4ab5-9522-9fd2d1b90052 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:42.925746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1bb5b-3afa-4ab5-9522-9fd2d1b90052 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:42.957706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393316c-00f3-4d4e-baf8-7b391d505187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:42.958702 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393316c-00f3-4d4e-baf8-7b391d505187 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:42.959067 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393316c-00f3-4d4e-baf8-7b391d505187 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:42.959439 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393316c-00f3-4d4e-baf8-7b391d505187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:43.034510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393316c-00f3-4d4e-baf8-7b391d505187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:43.036046 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393316c-00f3-4d4e-baf8-7b391d505187 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:43.047891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 363/754] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:14:43.047891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1bb5b-3afa-4ab5-9522-9fd2d1b90052 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:43.147376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 392/755] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:14:43.148556 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393316c-00f3-4d4e-baf8-7b391d505187 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:43.152256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1bb5b-3afa-4ab5-9522-9fd2d1b90052 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:43.188508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4f318-52b9-4803-949a-0dbdd8478918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:43.189550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f318-52b9-4803-949a-0dbdd8478918 None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:43.189897 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f318-52b9-4803-949a-0dbdd8478918 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:43.190242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4f318-52b9-4803-949a-0dbdd8478918 None admin] PATH_INFO: `/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/8c3c6fe7e21c4c1ebc01cf91c3c05c4f/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:43.192288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4f318-52b9-4803-949a-0dbdd8478918 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b37547e1bf4906b65ac39aad3a608c, user_id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:43.193828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4f318-52b9-4803-949a-0dbdd8478918 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:43.217003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 364/756] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:14:43 2022] PUT /identity/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/8c3c6fe7e21c4c1ebc01cf91c3c05c4f/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:14:43.217003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4f318-52b9-4803-949a-0dbdd8478918 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:43.291066 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393316c-00f3-4d4e-baf8-7b391d505187 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:43.328057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b03b0-1e69-4464-8014-b184e58ba22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:43.328858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b03b0-1e69-4464-8014-b184e58ba22e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:43.329171 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b03b0-1e69-4464-8014-b184e58ba22e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:43.329444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b03b0-1e69-4464-8014-b184e58ba22e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:43.340251 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4f318-52b9-4803-949a-0dbdd8478918 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:43.340447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b03b0-1e69-4464-8014-b184e58ba22e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:43.341929 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b03b0-1e69-4464-8014-b184e58ba22e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-317b03b0-1e69-4464-8014-b184e58ba22e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:43.360420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:43.361450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:43.362590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:43.362590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:43.362590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:43.362590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:43.362590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 393/757] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:43.370595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b03b0-1e69-4464-8014-b184e58ba22e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:43.384353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f202288-d734-4a80-b412-5e555f2f6b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:43.385778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202288-d734-4a80-b412-5e555f2f6b9b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:43.386221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202288-d734-4a80-b412-5e555f2f6b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:43.386502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f202288-d734-4a80-b412-5e555f2f6b9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:43.399338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f202288-d734-4a80-b412-5e555f2f6b9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:43.400773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f202288-d734-4a80-b412-5e555f2f6b9b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-9f202288-d734-4a80-b412-5e555f2f6b9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:43.422127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:43.424422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:43.426612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:43.426612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:43.426612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:43.426612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:43.426612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 365/758] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:43.433001 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f202288-d734-4a80-b412-5e555f2f6b9b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:43.526291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b03b0-1e69-4464-8014-b184e58ba22e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:43.562834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22e58-2696-40b0-a36c-958a4d5468ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:43.563507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22e58-2696-40b0-a36c-958a4d5468ea None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:43.563852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22e58-2696-40b0-a36c-958a4d5468ea None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:43.564132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22e58-2696-40b0-a36c-958a4d5468ea None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:43.564901 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e22e58-2696-40b0-a36c-958a4d5468ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:43.565293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e22e58-2696-40b0-a36c-958a4d5468ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:43.566663 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e22e58-2696-40b0-a36c-958a4d5468ea None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:43.578834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 394/759] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:43.579068 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f202288-d734-4a80-b412-5e555f2f6b9b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:43.584433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22e58-2696-40b0-a36c-958a4d5468ea None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:43.679935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6c2c0-ce02-49e1-9ff5-ba7d3f0823d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:43.680517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6c2c0-ce02-49e1-9ff5-ba7d3f0823d2 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:43.680797 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6c2c0-ce02-49e1-9ff5-ba7d3f0823d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:43.681098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6c2c0-ce02-49e1-9ff5-ba7d3f0823d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:43.682551 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6c2c0-ce02-49e1-9ff5-ba7d3f0823d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:43.682858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6c2c0-ce02-49e1-9ff5-ba7d3f0823d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:43.684217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6c2c0-ce02-49e1-9ff5-ba7d3f0823d2 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:43.684440 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22e58-2696-40b0-a36c-958a4d5468ea None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:43.704477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 366/760] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:43.709397 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6c2c0-ce02-49e1-9ff5-ba7d3f0823d2 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:43.719192 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18487fae-7dfa-4e7f-83d3-59c70930f087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:43.720015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18487fae-7dfa-4e7f-83d3-59c70930f087 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:43.720297 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18487fae-7dfa-4e7f-83d3-59c70930f087 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:43.720570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18487fae-7dfa-4e7f-83d3-59c70930f087 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:43.729156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18487fae-7dfa-4e7f-83d3-59c70930f087 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:43.730651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18487fae-7dfa-4e7f-83d3-59c70930f087 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-18487fae-7dfa-4e7f-83d3-59c70930f087 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:43.745913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:43.748076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:43.750285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:43.750285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:43.750285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:43.750285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:43.750285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:43.750285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:43.750285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:43.750285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:43.750285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 395/761] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:43.757023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18487fae-7dfa-4e7f-83d3-59c70930f087 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:43.836878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6c2c0-ce02-49e1-9ff5-ba7d3f0823d2 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:43.854898 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18487fae-7dfa-4e7f-83d3-59c70930f087 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:43.878931 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4d289-82a6-4621-9733-81aeb653795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:43.879734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4d289-82a6-4621-9733-81aeb653795e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:43.880015 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4d289-82a6-4621-9733-81aeb653795e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:43.880287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4d289-82a6-4621-9733-81aeb653795e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:43.887242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4d289-82a6-4621-9733-81aeb653795e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:43.888682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4d289-82a6-4621-9733-81aeb653795e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:43.889357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7365d17-e5bf-4373-81fa-faaee4b1860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:43.890072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7365d17-e5bf-4373-81fa-faaee4b1860b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:43.890356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7365d17-e5bf-4373-81fa-faaee4b1860b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:43.890631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7365d17-e5bf-4373-81fa-faaee4b1860b None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:43.891414 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7365d17-e5bf-4373-81fa-faaee4b1860b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:43.891722 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7365d17-e5bf-4373-81fa-faaee4b1860b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:43.893163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7365d17-e5bf-4373-81fa-faaee4b1860b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-00b4d289-82a6-4621-9733-81aeb653795e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:43.903640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:43.905550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:43.906829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:43.906829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:43.906829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:43.906829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:43.906829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:43.906829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:43.906829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:43.906829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:43.906829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 367/762] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:43.907424 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 396/763] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:43.911531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4d289-82a6-4621-9733-81aeb653795e None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:43.916998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7365d17-e5bf-4373-81fa-faaee4b1860b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:44.012255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4d289-82a6-4621-9733-81aeb653795e None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:44.012850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7365d17-e5bf-4373-81fa-faaee4b1860b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:44.047823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61194d60-0e84-4b0c-8204-1f91ffa1ba8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:44.048483 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61194d60-0e84-4b0c-8204-1f91ffa1ba8a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:44.048766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61194d60-0e84-4b0c-8204-1f91ffa1ba8a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:44.049079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61194d60-0e84-4b0c-8204-1f91ffa1ba8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:44.050053 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61194d60-0e84-4b0c-8204-1f91ffa1ba8a None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=6acfba37d6b84bf3a63d40e6e4096f5d) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:44.050370 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61194d60-0e84-4b0c-8204-1f91ffa1ba8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:44.051810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61194d60-0e84-4b0c-8204-1f91ffa1ba8a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:44.057668 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 397/764] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:43 2022] GET /identity/v3/role_assignments?user.id=6acfba37d6b84bf3a63d40e6e4096f5d&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:44.074976 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5a00d-97ac-4170-8bd1-06d1a08a7708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:44.075674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a00d-97ac-4170-8bd1-06d1a08a7708 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:44.075954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a00d-97ac-4170-8bd1-06d1a08a7708 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:44.076230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5a00d-97ac-4170-8bd1-06d1a08a7708 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:44.077082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5a00d-97ac-4170-8bd1-06d1a08a7708 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:44.077398 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5a00d-97ac-4170-8bd1-06d1a08a7708 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:44.078879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5a00d-97ac-4170-8bd1-06d1a08a7708 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:44.107543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 368/765] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:44.113567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61194d60-0e84-4b0c-8204-1f91ffa1ba8a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:44.250144 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61194d60-0e84-4b0c-8204-1f91ffa1ba8a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:44.302212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327397aa-060b-42a0-814b-aba897559afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:44.302873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327397aa-060b-42a0-814b-aba897559afe None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:44.303153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327397aa-060b-42a0-814b-aba897559afe None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:44.303425 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327397aa-060b-42a0-814b-aba897559afe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:44.304257 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327397aa-060b-42a0-814b-aba897559afe None admin] RBAC: Adding query filter params (role.id=fd14ccb80b45427381dd82c06ef844b4, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=7cb2f98e2f844526b48475c783703d17) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:44.304666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327397aa-060b-42a0-814b-aba897559afe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:44.306149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327397aa-060b-42a0-814b-aba897559afe None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:44.317475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 398/766] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:44 2022] GET /identity/v3/role_assignments?user.id=7cb2f98e2f844526b48475c783703d17&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=fd14ccb80b45427381dd82c06ef844b4 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:44.489241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccfb8b-2475-42f4-a006-96f153be92d0 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:44.489576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccfb8b-2475-42f4-a006-96f153be92d0 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:44.489780 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccfb8b-2475-42f4-a006-96f153be92d0 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:44.491384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 369/767] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:44.503572 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38638705-cdb4-432b-9668-ad65da96c5fe None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:44.503868 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38638705-cdb4-432b-9668-ad65da96c5fe None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:44.504029 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38638705-cdb4-432b-9668-ad65da96c5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:44.525931 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-38638705-cdb4-432b-9668-ad65da96c5fe None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:44.527115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-38638705-cdb4-432b-9668-ad65da96c5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:44.602274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 399/768] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:14:44.636298 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccfb8b-2475-42f4-a006-96f153be92d0 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:44.766336 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccfb8b-2475-42f4-a006-96f153be92d0 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:44.813798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8433b-8981-464e-87cf-9099f609f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:44.814622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8433b-8981-464e-87cf-9099f609f60e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:44.814951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8433b-8981-464e-87cf-9099f609f60e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:44.815229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8433b-8981-464e-87cf-9099f609f60e None admin] PATH_INFO: `/v3/services/network` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:44.815902 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8433b-8981-464e-87cf-9099f609f60e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:44.817321 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8433b-8981-464e-87cf-9099f609f60e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-4ca8433b-8981-464e-87cf-9099f609f60e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:44.832135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:44.834663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:44.836685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 370/769] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:44 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:44.841848 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38638705-cdb4-432b-9668-ad65da96c5fe None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:44.999124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38638705-cdb4-432b-9668-ad65da96c5fe None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:45.036069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fd6c8-55ce-4cf3-9802-5a300b5f020a None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:45.036069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fd6c8-55ce-4cf3-9802-5a300b5f020a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:45.036069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fd6c8-55ce-4cf3-9802-5a300b5f020a None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:45.038334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 371/770] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:45.043127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929367c-1fd9-4d81-af3b-d539471bcb56 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:45.043636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929367c-1fd9-4d81-af3b-d539471bcb56 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:45.043864 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712696b-c218-4632-9d2c-4f7cef97d01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:45.044530 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712696b-c218-4632-9d2c-4f7cef97d01a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:45.044811 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712696b-c218-4632-9d2c-4f7cef97d01a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:45.045117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712696b-c218-4632-9d2c-4f7cef97d01a None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:45.045310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929367c-1fd9-4d81-af3b-d539471bcb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:45.045827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712696b-c218-4632-9d2c-4f7cef97d01a None admin] RBAC: Adding query filter params (name=network) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:45.046131 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712696b-c218-4632-9d2c-4f7cef97d01a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:45.047492 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712696b-c218-4632-9d2c-4f7cef97d01a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:45.057819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 400/771] 10.222.0.61 () {56 vars in 1112 bytes} [Tue May 10 20:14:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:45.062787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712696b-c218-4632-9d2c-4f7cef97d01a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:45.075809 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-0929367c-1fd9-4d81-af3b-d539471bcb56 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:45.079156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0929367c-1fd9-4d81-af3b-d539471bcb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:45.195352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712696b-c218-4632-9d2c-4f7cef97d01a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:45.223537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 372/772] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:14:45.237236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47d9a-4c8f-41d4-ac1d-e67085787f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:45.237987 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47d9a-4c8f-41d4-ac1d-e67085787f07 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:45.238342 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47d9a-4c8f-41d4-ac1d-e67085787f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:45.238688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47d9a-4c8f-41d4-ac1d-e67085787f07 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:45.239460 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf47d9a-4c8f-41d4-ac1d-e67085787f07 None admin] RBAC: Adding query filter params (type=network) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:45.239835 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf47d9a-4c8f-41d4-ac1d-e67085787f07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:45.241405 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf47d9a-4c8f-41d4-ac1d-e67085787f07 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:45.251216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 401/773] 10.222.0.61 () {56 vars in 1112 bytes} [Tue May 10 20:14:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:45.252439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929367c-1fd9-4d81-af3b-d539471bcb56 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:45.265735 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47d9a-4c8f-41d4-ac1d-e67085787f07 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:45.369947 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47d9a-4c8f-41d4-ac1d-e67085787f07 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:45.405743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929367c-1fd9-4d81-af3b-d539471bcb56 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:45.411771 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ed27d-5024-492a-b708-53fafe104464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:45.413201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ed27d-5024-492a-b708-53fafe104464 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:45.413707 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ed27d-5024-492a-b708-53fafe104464 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:45.414075 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ed27d-5024-492a-b708-53fafe104464 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:45.414763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ed27d-5024-492a-b708-53fafe104464 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:45.416912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ed27d-5024-492a-b708-53fafe104464 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-414ed27d-5024-492a-b708-53fafe104464 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:45.429827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:45.430792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:14:45.431684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:45.436113 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 402/774] 10.222.0.61 () {56 vars in 1129 bytes} [Tue May 10 20:14:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:45.437353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ed27d-5024-492a-b708-53fafe104464 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:45.440801 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77814409-9d70-4f1b-94e6-a08593b93fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:45.441503 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814409-9d70-4f1b-94e6-a08593b93fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:45.441784 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814409-9d70-4f1b-94e6-a08593b93fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:45.442056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814409-9d70-4f1b-94e6-a08593b93fc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:45.442852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77814409-9d70-4f1b-94e6-a08593b93fc7 None admin] RBAC: Adding query filter params (interface=public, service_id=a76d3a330f75484187791d9e8c5755cc, region_id=RegionOne) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:45.443162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77814409-9d70-4f1b-94e6-a08593b93fc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:45.444522 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77814409-9d70-4f1b-94e6-a08593b93fc7 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:45.460676 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 373/775] 10.222.0.61 () {56 vars in 1251 bytes} [Tue May 10 20:14:45 2022] GET /identity/v3/endpoints?service_id=a76d3a330f75484187791d9e8c5755cc&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:45.466472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77814409-9d70-4f1b-94e6-a08593b93fc7 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:45.538748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ed27d-5024-492a-b708-53fafe104464 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:45.574994 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50beb0-e214-485e-b5a8-c381c30e99a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:45.575663 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50beb0-e214-485e-b5a8-c381c30e99a4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:45.575990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50beb0-e214-485e-b5a8-c381c30e99a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:45.576269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50beb0-e214-485e-b5a8-c381c30e99a4 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:45.576989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50beb0-e214-485e-b5a8-c381c30e99a4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:45.577306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50beb0-e214-485e-b5a8-c381c30e99a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:45.578674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50beb0-e214-485e-b5a8-c381c30e99a4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:45.588414 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 403/776] 10.222.0.61 () {56 vars in 1124 bytes} [Tue May 10 20:14:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:45.589673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50beb0-e214-485e-b5a8-c381c30e99a4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:45.689348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50beb0-e214-485e-b5a8-c381c30e99a4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:45.704563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77814409-9d70-4f1b-94e6-a08593b93fc7 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:45.728471 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10359e-e3a2-49b6-bf40-45d59b4d4390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:45.729160 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10359e-e3a2-49b6-bf40-45d59b4d4390 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:45.729446 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10359e-e3a2-49b6-bf40-45d59b4d4390 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:45.729721 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10359e-e3a2-49b6-bf40-45d59b4d4390 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:45.730430 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10359e-e3a2-49b6-bf40-45d59b4d4390 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:45.730739 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10359e-e3a2-49b6-bf40-45d59b4d4390 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:45.732110 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10359e-e3a2-49b6-bf40-45d59b4d4390 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:45.741104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 404/777] 10.222.0.61 () {56 vars in 1124 bytes} [Tue May 10 20:14:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:45.754145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10359e-e3a2-49b6-bf40-45d59b4d4390 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:45.784394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ea92c-35d1-444c-b00a-21738414bb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:45.785117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ea92c-35d1-444c-b00a-21738414bb1a None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:45.785403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ea92c-35d1-444c-b00a-21738414bb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:45.785680 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ea92c-35d1-444c-b00a-21738414bb1a None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:45.786376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ea92c-35d1-444c-b00a-21738414bb1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:45.787740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ea92c-35d1-444c-b00a-21738414bb1a None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:45.807942 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 374/778] 10.222.0.61 () {56 vars in 1087 bytes} [Tue May 10 20:14:45 2022] GET /identity/v3/services => generated 772 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:45.862019 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10359e-e3a2-49b6-bf40-45d59b4d4390 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:45.897688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d6c47-ce6d-42ef-89d5-83a4b1040213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:45.898523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d6c47-ce6d-42ef-89d5-83a4b1040213 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:45.898812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d6c47-ce6d-42ef-89d5-83a4b1040213 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:45.899090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d6c47-ce6d-42ef-89d5-83a4b1040213 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:45.899892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d6c47-ce6d-42ef-89d5-83a4b1040213 None admin] RBAC: Adding query filter params (interface=public, service_id=d1b6daae103c45f2993a887923af3a55, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:45.900265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d6c47-ce6d-42ef-89d5-83a4b1040213 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:45.902386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d6c47-ce6d-42ef-89d5-83a4b1040213 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:45.912083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 405/779] 10.222.0.61 () {56 vars in 1251 bytes} [Tue May 10 20:14:45 2022] GET /identity/v3/endpoints?service_id=d1b6daae103c45f2993a887923af3a55&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:45.917539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ea92c-35d1-444c-b00a-21738414bb1a None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:46.073392 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ea92c-35d1-444c-b00a-21738414bb1a None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:46.106828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3fb04-56fb-4de8-a282-d9226928a553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:46.107500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3fb04-56fb-4de8-a282-d9226928a553 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:46.107782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3fb04-56fb-4de8-a282-d9226928a553 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:46.108055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3fb04-56fb-4de8-a282-d9226928a553 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:46.108803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3fb04-56fb-4de8-a282-d9226928a553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:46.110569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3fb04-56fb-4de8-a282-d9226928a553 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:46.116778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 375/780] 10.222.0.61 () {56 vars in 1087 bytes} [Tue May 10 20:14:45 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:46.214875 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0b232-b4cb-4bc5-b64c-03795abdf9a9 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:46.215539 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0b232-b4cb-4bc5-b64c-03795abdf9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:46.215539 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0b232-b4cb-4bc5-b64c-03795abdf9a9 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:46.216804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 406/781] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:46.222895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf51a75-d333-4947-8fc7-da64eb629b72 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:46.223170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf51a75-d333-4947-8fc7-da64eb629b72 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:46.223447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf51a75-d333-4947-8fc7-da64eb629b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:46.246049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-bbf51a75-d333-4947-8fc7-da64eb629b72 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:46.247160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-bbf51a75-d333-4947-8fc7-da64eb629b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:46.328519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 376/782] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:14:46.370042 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0b232-b4cb-4bc5-b64c-03795abdf9a9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:46.487451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0b232-b4cb-4bc5-b64c-03795abdf9a9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:46.520900 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d057178-ab5f-4267-977d-7d52d9ac3fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:46.522335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057178-ab5f-4267-977d-7d52d9ac3fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:46.522815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057178-ab5f-4267-977d-7d52d9ac3fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:46.523283 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057178-ab5f-4267-977d-7d52d9ac3fb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:46.537793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d057178-ab5f-4267-977d-7d52d9ac3fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-8d057178-ab5f-4267-977d-7d52d9ac3fb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:46.545927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:46.546861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:46.547689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:46.547689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:46.547689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:46.547689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:46.547689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:46.547689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:46.547689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:46.547689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:46.547689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:46.547689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:46.547689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:46.547689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:46.550470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 407/783] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:14:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:46.556084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf51a75-d333-4947-8fc7-da64eb629b72 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:46.694022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf51a75-d333-4947-8fc7-da64eb629b72 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:46.738792 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d18e4-d418-4d42-958f-b46ef3cb73b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:46.739478 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d18e4-d418-4d42-958f-b46ef3cb73b1 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:46.739761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d18e4-d418-4d42-958f-b46ef3cb73b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:46.740034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d18e4-d418-4d42-958f-b46ef3cb73b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:46.740791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d18e4-d418-4d42-958f-b46ef3cb73b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:46.741124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d18e4-d418-4d42-958f-b46ef3cb73b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:46.742483 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d18e4-d418-4d42-958f-b46ef3cb73b1 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:46.755164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 377/784] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:46.761407 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d057178-ab5f-4267-977d-7d52d9ac3fb7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:46.841923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38509c26-6cd3-47db-8331-4398c3eee82c None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:46.842220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38509c26-6cd3-47db-8331-4398c3eee82c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:46.842404 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38509c26-6cd3-47db-8331-4398c3eee82c None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:46.844070 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 378/785] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:14:46.850401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74f04f-9ed1-4e10-935a-5eef538c1fea None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:46.850682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74f04f-9ed1-4e10-935a-5eef538c1fea None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:46.850956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74f04f-9ed1-4e10-935a-5eef538c1fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:46.877498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d057178-ab5f-4267-977d-7d52d9ac3fb7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:46.898017 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-9b74f04f-9ed1-4e10-935a-5eef538c1fea None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:46.899202 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9b74f04f-9ed1-4e10-935a-5eef538c1fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:46.920718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c4ec0-5120-40d5-b2a5-3b056c8b6eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:46.921602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4ec0-5120-40d5-b2a5-3b056c8b6eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:46.921889 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4ec0-5120-40d5-b2a5-3b056c8b6eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:46.922165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4ec0-5120-40d5-b2a5-3b056c8b6eb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:46.939569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c4ec0-5120-40d5-b2a5-3b056c8b6eb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:46.941060 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c4ec0-5120-40d5-b2a5-3b056c8b6eb9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-a56c4ec0-5120-40d5-b2a5-3b056c8b6eb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:46.976141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:46.978294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:46.980427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:46.980427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:46.980427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:46.980427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:46.980427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 408/786] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:46.987896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c4ec0-5120-40d5-b2a5-3b056c8b6eb9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:47.017021 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 379/787] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:14:47.057858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74f04f-9ed1-4e10-935a-5eef538c1fea None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:47.144464 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c4ec0-5120-40d5-b2a5-3b056c8b6eb9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:47.189225 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b00d7e-4cd3-4f65-95e4-b42d13a59f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:47.190058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b00d7e-4cd3-4f65-95e4-b42d13a59f85 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:47.190349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b00d7e-4cd3-4f65-95e4-b42d13a59f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:47.190630 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b00d7e-4cd3-4f65-95e4-b42d13a59f85 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:47.191642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b00d7e-4cd3-4f65-95e4-b42d13a59f85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:47.191956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b00d7e-4cd3-4f65-95e4-b42d13a59f85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:47.193461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b00d7e-4cd3-4f65-95e4-b42d13a59f85 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:47.205944 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74f04f-9ed1-4e10-935a-5eef538c1fea None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:47.214688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 409/788] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:47.216313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b336e1-4f6a-4ae1-9147-fcaf21230535 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:47.217356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b336e1-4f6a-4ae1-9147-fcaf21230535 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:47.217640 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b336e1-4f6a-4ae1-9147-fcaf21230535 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:47.219081 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 410/789] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:47.221080 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b336e1-4f6a-4ae1-9147-fcaf21230535 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:47.249612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af467f6-0bd1-43c9-9a95-ed4139281063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:47.250759 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af467f6-0bd1-43c9-9a95-ed4139281063 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:47.251154 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af467f6-0bd1-43c9-9a95-ed4139281063 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:47.251453 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af467f6-0bd1-43c9-9a95-ed4139281063 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:47.264311 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af467f6-0bd1-43c9-9a95-ed4139281063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-2af467f6-0bd1-43c9-9a95-ed4139281063 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:47.273517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:47.274530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:47.275441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:47.275441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:47.275441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:47.275441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:47.275441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:47.275441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:47.275441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:47.275441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:47.275441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:47.275441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:47.275441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:47.275441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:47.275441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 380/790] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:14:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:47.276678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d493a9c-3606-4134-ba15-1e200646d922 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:47.276678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d493a9c-3606-4134-ba15-1e200646d922 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:47.276846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d493a9c-3606-4134-ba15-1e200646d922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:47.300530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6d493a9c-3606-4134-ba15-1e200646d922 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:47.301767 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6d493a9c-3606-4134-ba15-1e200646d922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:47.337812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b336e1-4f6a-4ae1-9147-fcaf21230535 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:47.376212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51851d8c-c57c-4f90-aa60-41762fd2fe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:47.377358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51851d8c-c57c-4f90-aa60-41762fd2fe02 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:47.377844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51851d8c-c57c-4f90-aa60-41762fd2fe02 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:47.378317 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51851d8c-c57c-4f90-aa60-41762fd2fe02 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:47.385591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51851d8c-c57c-4f90-aa60-41762fd2fe02 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:47.392994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 381/791] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:14:47.392994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d493a9c-3606-4134-ba15-1e200646d922 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:47.394693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51851d8c-c57c-4f90-aa60-41762fd2fe02 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-51851d8c-c57c-4f90-aa60-41762fd2fe02 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:47.423306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:47.424314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:47.425296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:47.425296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:47.425296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:47.425296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:47.425296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:47.425296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:47.425296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:47.425296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:47.425296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:14:47.425296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:47.427910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 411/792] 10.222.0.61 () {56 vars in 1093 bytes} [Tue May 10 20:14:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:47.434014 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51851d8c-c57c-4f90-aa60-41762fd2fe02 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:47.506990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d493a9c-3606-4134-ba15-1e200646d922 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:47.541866 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34d90e-99e9-48e8-91b0-38e459924687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:47.542451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34d90e-99e9-48e8-91b0-38e459924687 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:47.542733 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34d90e-99e9-48e8-91b0-38e459924687 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:47.543005 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34d90e-99e9-48e8-91b0-38e459924687 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:47.543750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34d90e-99e9-48e8-91b0-38e459924687 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:47.544057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34d90e-99e9-48e8-91b0-38e459924687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:47.545453 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34d90e-99e9-48e8-91b0-38e459924687 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:47.546219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51851d8c-c57c-4f90-aa60-41762fd2fe02 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:47.554179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 382/793] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:47.555072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34d90e-99e9-48e8-91b0-38e459924687 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:47.582068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5930c6-5161-4c7c-a801-b7079c649e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:47.583171 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5930c6-5161-4c7c-a801-b7079c649e27 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:47.583836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5930c6-5161-4c7c-a801-b7079c649e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:47.584327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5930c6-5161-4c7c-a801-b7079c649e27 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:47.585461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5930c6-5161-4c7c-a801-b7079c649e27 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:47.586090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5930c6-5161-4c7c-a801-b7079c649e27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:47.587869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5930c6-5161-4c7c-a801-b7079c649e27 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:47.612018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 412/794] 10.222.0.61 () {56 vars in 1133 bytes} [Tue May 10 20:14:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:47.613236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5930c6-5161-4c7c-a801-b7079c649e27 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:47.657833 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34d90e-99e9-48e8-91b0-38e459924687 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:47.691936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e53ec-b08b-4fb4-9a24-d807fc3461fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:47.692735 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e53ec-b08b-4fb4-9a24-d807fc3461fb None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:47.693039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e53ec-b08b-4fb4-9a24-d807fc3461fb None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:47.693316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e53ec-b08b-4fb4-9a24-d807fc3461fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:47.704505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e53ec-b08b-4fb4-9a24-d807fc3461fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-661e53ec-b08b-4fb4-9a24-d807fc3461fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:47.712543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:47.713530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:47.714370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:47.714370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:47.714370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:47.714370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:47.714370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:47.714370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:47.714370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:47.714370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:47.714370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:47.714370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:47.714370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:47.714370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:47.714370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 383/795] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:47.715065 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e53ec-b08b-4fb4-9a24-d807fc3461fb None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:47.716956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5930c6-5161-4c7c-a801-b7079c649e27 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:47.752569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c67dd-658f-4c11-a218-833c9813fef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:47.753759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c67dd-658f-4c11-a218-833c9813fef2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:47.754244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c67dd-658f-4c11-a218-833c9813fef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:47.754733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c67dd-658f-4c11-a218-833c9813fef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:47.765733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c67dd-658f-4c11-a218-833c9813fef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:47.767410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c67dd-658f-4c11-a218-833c9813fef2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-cf3c67dd-658f-4c11-a218-833c9813fef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:47.785459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:47.786345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:47.787251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:47.787251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:47.787251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:47.787251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:47.789392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 413/796] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:47.790452 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c67dd-658f-4c11-a218-833c9813fef2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:47.816203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e53ec-b08b-4fb4-9a24-d807fc3461fb None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:47.850082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7be42-52d0-4ac3-b67a-560c75ae043c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:47.850736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7be42-52d0-4ac3-b67a-560c75ae043c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:47.851017 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7be42-52d0-4ac3-b67a-560c75ae043c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:47.851290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7be42-52d0-4ac3-b67a-560c75ae043c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:47.889749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c67dd-658f-4c11-a218-833c9813fef2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:47.919464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7be42-52d0-4ac3-b67a-560c75ae043c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:47.920698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7be42-52d0-4ac3-b67a-560c75ae043c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:47.924815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf3e31-82e6-4a47-ab32-58c8332d44c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:47.925764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf3e31-82e6-4a47-ab32-58c8332d44c6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:47.926262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf3e31-82e6-4a47-ab32-58c8332d44c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:47.926738 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf3e31-82e6-4a47-ab32-58c8332d44c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:47.927683 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf3e31-82e6-4a47-ab32-58c8332d44c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:47.928194 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf3e31-82e6-4a47-ab32-58c8332d44c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:47.929773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf3e31-82e6-4a47-ab32-58c8332d44c6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:47.939252 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 414/797] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:47.940362 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf3e31-82e6-4a47-ab32-58c8332d44c6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:48.022158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 384/798] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:14:48.023078 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7be42-52d0-4ac3-b67a-560c75ae043c None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:48.043960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf3e31-82e6-4a47-ab32-58c8332d44c6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:48.078356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad2d6c-7538-4694-a92c-47d29bfce903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:48.079025 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad2d6c-7538-4694-a92c-47d29bfce903 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:48.079308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad2d6c-7538-4694-a92c-47d29bfce903 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:48.079587 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad2d6c-7538-4694-a92c-47d29bfce903 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:48.080308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad2d6c-7538-4694-a92c-47d29bfce903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:48.080616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad2d6c-7538-4694-a92c-47d29bfce903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:48.082021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad2d6c-7538-4694-a92c-47d29bfce903 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:48.094434 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 415/799] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:48.095344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad2d6c-7538-4694-a92c-47d29bfce903 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:48.123000 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7be42-52d0-4ac3-b67a-560c75ae043c None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:48.157053 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba83c56-be5a-4571-9716-a2cdc11511c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:48.157903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba83c56-be5a-4571-9716-a2cdc11511c3 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:48.158189 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba83c56-be5a-4571-9716-a2cdc11511c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:48.158463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba83c56-be5a-4571-9716-a2cdc11511c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:48.169243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba83c56-be5a-4571-9716-a2cdc11511c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:48.170750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba83c56-be5a-4571-9716-a2cdc11511c3 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-cba83c56-be5a-4571-9716-a2cdc11511c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:48.189219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:48.190160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:48.191034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:48.191034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:48.191034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:48.191034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:48.191034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 385/800] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:48.191746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba83c56-be5a-4571-9716-a2cdc11511c3 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:48.195269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad2d6c-7538-4694-a92c-47d29bfce903 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:48.230589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1155c-3422-4f6d-9692-6a51a4fe5184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:48.231379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1155c-3422-4f6d-9692-6a51a4fe5184 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:48.231661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1155c-3422-4f6d-9692-6a51a4fe5184 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:48.231936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1155c-3422-4f6d-9692-6a51a4fe5184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:48.242567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1155c-3422-4f6d-9692-6a51a4fe5184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:48.244586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1155c-3422-4f6d-9692-6a51a4fe5184 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-afc1155c-3422-4f6d-9692-6a51a4fe5184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:48.262241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:48.264366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:48.266615 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:48.266615 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:48.266615 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:48.266615 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:48.273028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 416/801] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:48.273028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1155c-3422-4f6d-9692-6a51a4fe5184 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:48.294422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba83c56-be5a-4571-9716-a2cdc11511c3 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:48.328303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37287d-c7dd-4534-9323-f671a85b5d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:48.329197 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37287d-c7dd-4534-9323-f671a85b5d2e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:48.329481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37287d-c7dd-4534-9323-f671a85b5d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:48.329797 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37287d-c7dd-4534-9323-f671a85b5d2e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:48.337228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37287d-c7dd-4534-9323-f671a85b5d2e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:48.339271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37287d-c7dd-4534-9323-f671a85b5d2e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-8c37287d-c7dd-4534-9323-f671a85b5d2e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:48.355244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:48.357652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:48.360054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:48.360054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:48.360054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:48.360054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:48.360054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:48.360054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:48.360054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:48.360054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:48.360054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 20:14:48.360054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:48.360054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 386/802] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:14:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:48.360054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37287d-c7dd-4534-9323-f671a85b5d2e None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:48.371062 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1155c-3422-4f6d-9692-6a51a4fe5184 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:48.407496 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350f6b3-d431-4cf3-ad28-18e56e23438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:48.408221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350f6b3-d431-4cf3-ad28-18e56e23438e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:48.408508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350f6b3-d431-4cf3-ad28-18e56e23438e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:48.408785 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350f6b3-d431-4cf3-ad28-18e56e23438e None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:48.409542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350f6b3-d431-4cf3-ad28-18e56e23438e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:48.409850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350f6b3-d431-4cf3-ad28-18e56e23438e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:48.411220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350f6b3-d431-4cf3-ad28-18e56e23438e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:48.424206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 417/803] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:48.424966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350f6b3-d431-4cf3-ad28-18e56e23438e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:48.461999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37287d-c7dd-4534-9323-f671a85b5d2e None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:48.496782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18520e1e-708c-42ca-a380-57a4bf4002cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:48.497530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18520e1e-708c-42ca-a380-57a4bf4002cc None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:48.497815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18520e1e-708c-42ca-a380-57a4bf4002cc None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:48.498092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18520e1e-708c-42ca-a380-57a4bf4002cc None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:48.498864 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18520e1e-708c-42ca-a380-57a4bf4002cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:48.499174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18520e1e-708c-42ca-a380-57a4bf4002cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:48.500536 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18520e1e-708c-42ca-a380-57a4bf4002cc None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:48.512726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 387/804] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:48.513677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18520e1e-708c-42ca-a380-57a4bf4002cc None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:48.528487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350f6b3-d431-4cf3-ad28-18e56e23438e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:48.564472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14dcb-e61a-41a0-aec8-d23405964b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:48.565187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14dcb-e61a-41a0-aec8-d23405964b25 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:48.565472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14dcb-e61a-41a0-aec8-d23405964b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:48.565749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af14dcb-e61a-41a0-aec8-d23405964b25 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:48.566601 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af14dcb-e61a-41a0-aec8-d23405964b25 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:48.566910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af14dcb-e61a-41a0-aec8-d23405964b25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:48.568385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af14dcb-e61a-41a0-aec8-d23405964b25 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:48.587165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 418/805] 10.222.0.61 () {56 vars in 1135 bytes} [Tue May 10 20:14:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:48.588572 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14dcb-e61a-41a0-aec8-d23405964b25 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:48.622305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18520e1e-708c-42ca-a380-57a4bf4002cc None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:48.654930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d08823-f558-43c2-88ff-0a76a788e84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:48.655734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08823-f558-43c2-88ff-0a76a788e84d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:48.656010 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08823-f558-43c2-88ff-0a76a788e84d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:48.656282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d08823-f558-43c2-88ff-0a76a788e84d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:48.663594 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d08823-f558-43c2-88ff-0a76a788e84d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:48.665045 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d08823-f558-43c2-88ff-0a76a788e84d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-84d08823-f558-43c2-88ff-0a76a788e84d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:48.679439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:48.680385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:48.681431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:48.681431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:48.681431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:48.681431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:48.681431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:48.681431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:48.681431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:48.681431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:48.681431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:14:48.681431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:48.681431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 388/806] 10.222.0.61 () {56 vars in 1117 bytes} [Tue May 10 20:14:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:48.682529 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d24c3-24a6-4038-b35c-ea319e6ad389 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:48.683092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d24c3-24a6-4038-b35c-ea319e6ad389 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:48.683092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d24c3-24a6-4038-b35c-ea319e6ad389 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:48.684305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 389/807] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:48.684837 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d24c3-24a6-4038-b35c-ea319e6ad389 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:48.692914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af14dcb-e61a-41a0-aec8-d23405964b25 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:48.726390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a444d7-9187-4e7b-9f1e-d78b9a06c242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:48.727308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a444d7-9187-4e7b-9f1e-d78b9a06c242 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:48.727589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a444d7-9187-4e7b-9f1e-d78b9a06c242 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:48.727864 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a444d7-9187-4e7b-9f1e-d78b9a06c242 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:48.735069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a444d7-9187-4e7b-9f1e-d78b9a06c242 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:48.736492 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a444d7-9187-4e7b-9f1e-d78b9a06c242 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-f3a444d7-9187-4e7b-9f1e-d78b9a06c242 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:48.751196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:48.752097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:48.753041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:48.753041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:48.753041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:48.753041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:48.753041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:48.753041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:48.753041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:48.753041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:48.753041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 419/808] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:48.753527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a444d7-9187-4e7b-9f1e-d78b9a06c242 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:48.788340 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d24c3-24a6-4038-b35c-ea319e6ad389 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:48.820140 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88771c-c2f9-4ff1-9bce-a25a6b73a7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:48.820936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88771c-c2f9-4ff1-9bce-a25a6b73a7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:48.821247 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88771c-c2f9-4ff1-9bce-a25a6b73a7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:48.821520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88771c-c2f9-4ff1-9bce-a25a6b73a7c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:48.831429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88771c-c2f9-4ff1-9bce-a25a6b73a7c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:48.832852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88771c-c2f9-4ff1-9bce-a25a6b73a7c7 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:48.845835 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a444d7-9187-4e7b-9f1e-d78b9a06c242 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-ec88771c-c2f9-4ff1-9bce-a25a6b73a7c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:48.849044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:48.850037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:48.850915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:48.850915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:48.850915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:48.850915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:48.850915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 390/809] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:48.851489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65f641-ca69-4375-aabc-a49229ad3d6c None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:48.851606 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65f641-ca69-4375-aabc-a49229ad3d6c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:48.851885 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65f641-ca69-4375-aabc-a49229ad3d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:48.867726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-fc65f641-ca69-4375-aabc-a49229ad3d6c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:48.868938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fc65f641-ca69-4375-aabc-a49229ad3d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:48.880612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba9c341-c450-4a32-986c-c315a5587d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:48.881308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9c341-c450-4a32-986c-c315a5587d21 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:48.881597 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9c341-c450-4a32-986c-c315a5587d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:48.881877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba9c341-c450-4a32-986c-c315a5587d21 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:48.882705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9c341-c450-4a32-986c-c315a5587d21 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:48.883025 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9c341-c450-4a32-986c-c315a5587d21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:48.884460 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba9c341-c450-4a32-986c-c315a5587d21 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:48.901053 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 420/810] 10.222.0.61 () {56 vars in 1149 bytes} [Tue May 10 20:14:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:48.902100 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12582b-56fd-4a12-ad29-0fb54db0703a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:48.902392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12582b-56fd-4a12-ad29-0fb54db0703a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:48.902674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12582b-56fd-4a12-ad29-0fb54db0703a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:48.905016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 421/811] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:48.905016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12582b-56fd-4a12-ad29-0fb54db0703a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:48.933837 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 391/812] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:14:48.934598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65f641-ca69-4375-aabc-a49229ad3d6c None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:49.018703 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12582b-56fd-4a12-ad29-0fb54db0703a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:49.027972 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65f641-ca69-4375-aabc-a49229ad3d6c None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:49.055694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77683c-477b-4d0d-9417-e6ae38d72d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:49.056874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77683c-477b-4d0d-9417-e6ae38d72d37 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:49.057190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77683c-477b-4d0d-9417-e6ae38d72d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:49.057458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77683c-477b-4d0d-9417-e6ae38d72d37 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:49.058228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77683c-477b-4d0d-9417-e6ae38d72d37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:49.058533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77683c-477b-4d0d-9417-e6ae38d72d37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:49.059959 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77683c-477b-4d0d-9417-e6ae38d72d37 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:49.069823 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb0200-9576-42f7-8552-4c2ab14698e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:49.070476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb0200-9576-42f7-8552-4c2ab14698e3 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:49.070760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb0200-9576-42f7-8552-4c2ab14698e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:49.071034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb0200-9576-42f7-8552-4c2ab14698e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:49.071422 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 422/813] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:49.071752 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb0200-9576-42f7-8552-4c2ab14698e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:49.072644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb0200-9576-42f7-8552-4c2ab14698e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:49.072740 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77683c-477b-4d0d-9417-e6ae38d72d37 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:49.074032 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb0200-9576-42f7-8552-4c2ab14698e3 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:49.089995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 392/814] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:49.089995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4475a7-38bc-4d4d-bd9b-4ba405fb6cb5 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:49.089995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4475a7-38bc-4d4d-bd9b-4ba405fb6cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:49.089995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4475a7-38bc-4d4d-bd9b-4ba405fb6cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:49.102911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-2e4475a7-38bc-4d4d-bd9b-4ba405fb6cb5 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:49.104099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2e4475a7-38bc-4d4d-bd9b-4ba405fb6cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:49.165595 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 393/815] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:14:49.166406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4475a7-38bc-4d4d-bd9b-4ba405fb6cb5 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:49.177410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77683c-477b-4d0d-9417-e6ae38d72d37 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:49.209417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c98432-b350-4365-b21c-13c0b64a79c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:49.210130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c98432-b350-4365-b21c-13c0b64a79c8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:49.210408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c98432-b350-4365-b21c-13c0b64a79c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:49.210676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c98432-b350-4365-b21c-13c0b64a79c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:49.221844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c98432-b350-4365-b21c-13c0b64a79c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:49.223288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c98432-b350-4365-b21c-13c0b64a79c8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-92c98432-b350-4365-b21c-13c0b64a79c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:49.240005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:49.241402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:49.242300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:49.242300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:49.242300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:49.242300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:49.242300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 423/816] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:49.242300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c98432-b350-4365-b21c-13c0b64a79c8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:49.264892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4475a7-38bc-4d4d-bd9b-4ba405fb6cb5 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:49.297589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377439a2-e382-4b19-9bb2-d55a51ae29b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:49.298309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377439a2-e382-4b19-9bb2-d55a51ae29b3 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:49.298597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377439a2-e382-4b19-9bb2-d55a51ae29b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:49.298871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377439a2-e382-4b19-9bb2-d55a51ae29b3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:49.299520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377439a2-e382-4b19-9bb2-d55a51ae29b3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:49.300870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377439a2-e382-4b19-9bb2-d55a51ae29b3 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-377439a2-e382-4b19-9bb2-d55a51ae29b3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:49.312186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:49.313219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:49.314037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 394/817] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:49 2022] GET /identity/v3/services/network => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:49.314969 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377439a2-e382-4b19-9bb2-d55a51ae29b3 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:49.338560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c98432-b350-4365-b21c-13c0b64a79c8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:49.369705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24dcf9-0921-4cc8-8376-bf9ce36eb831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:49.370351 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24dcf9-0921-4cc8-8376-bf9ce36eb831 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:49.370631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24dcf9-0921-4cc8-8376-bf9ce36eb831 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:49.370906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24dcf9-0921-4cc8-8376-bf9ce36eb831 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:49.371724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24dcf9-0921-4cc8-8376-bf9ce36eb831 None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:49.372031 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24dcf9-0921-4cc8-8376-bf9ce36eb831 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:49.373485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24dcf9-0921-4cc8-8376-bf9ce36eb831 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:49.379124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 424/818] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:49 2022] GET /identity/v3/role_assignments?user.id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:49.379986 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24dcf9-0921-4cc8-8376-bf9ce36eb831 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:49.410318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377439a2-e382-4b19-9bb2-d55a51ae29b3 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:49.446338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec8014-b09e-45da-a26e-b414c2f80919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:49.447699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8014-b09e-45da-a26e-b414c2f80919 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:49.447985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8014-b09e-45da-a26e-b414c2f80919 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:49.448269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8014-b09e-45da-a26e-b414c2f80919 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:49.455625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec8014-b09e-45da-a26e-b414c2f80919 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:49.457462 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec8014-b09e-45da-a26e-b414c2f80919 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-80ec8014-b09e-45da-a26e-b414c2f80919 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:49.472913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:49.474052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:49.474958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:49.474958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:49.474958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:49.474958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:49.474958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:49.474958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:49.474958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:49.474958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:49.474958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 395/819] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:49.475438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec8014-b09e-45da-a26e-b414c2f80919 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:49.495161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24dcf9-0921-4cc8-8376-bf9ce36eb831 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:49.535207 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee779f0-46db-4b9b-b00b-e068f9a7ba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:49.536519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee779f0-46db-4b9b-b00b-e068f9a7ba4f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:49.536811 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee779f0-46db-4b9b-b00b-e068f9a7ba4f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:49.537386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee779f0-46db-4b9b-b00b-e068f9a7ba4f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:49.538067 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee779f0-46db-4b9b-b00b-e068f9a7ba4f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:49.540269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee779f0-46db-4b9b-b00b-e068f9a7ba4f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-1ee779f0-46db-4b9b-b00b-e068f9a7ba4f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:49.552961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:49.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:14:49.555224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:49.556024 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 425/820] 10.222.0.61 () {56 vars in 1129 bytes} [Tue May 10 20:14:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:49.556591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee779f0-46db-4b9b-b00b-e068f9a7ba4f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:49.582034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec8014-b09e-45da-a26e-b414c2f80919 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:49.618839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439369f-46a9-4c1b-8e2f-16edf3c3aed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:49.619666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439369f-46a9-4c1b-8e2f-16edf3c3aed2 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:49.620047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439369f-46a9-4c1b-8e2f-16edf3c3aed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:49.620382 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439369f-46a9-4c1b-8e2f-16edf3c3aed2 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:49.621236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439369f-46a9-4c1b-8e2f-16edf3c3aed2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:49.621611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439369f-46a9-4c1b-8e2f-16edf3c3aed2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:49.623038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439369f-46a9-4c1b-8e2f-16edf3c3aed2 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:49.635804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 396/821] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:49.636690 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439369f-46a9-4c1b-8e2f-16edf3c3aed2 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:49.665468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee779f0-46db-4b9b-b00b-e068f9a7ba4f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:49.702039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d990e7-c2ef-4160-9dce-643b1a1265ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:49.702846 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d990e7-c2ef-4160-9dce-643b1a1265ab None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:49.703241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d990e7-c2ef-4160-9dce-643b1a1265ab None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:49.703613 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d990e7-c2ef-4160-9dce-643b1a1265ab None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:49.704418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d990e7-c2ef-4160-9dce-643b1a1265ab None admin] RBAC: Adding query filter params (name=network) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:49.704795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d990e7-c2ef-4160-9dce-643b1a1265ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:49.706262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d990e7-c2ef-4160-9dce-643b1a1265ab None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:49.715591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 426/822] 10.222.0.61 () {56 vars in 1112 bytes} [Tue May 10 20:14:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:49.715591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d990e7-c2ef-4160-9dce-643b1a1265ab None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:49.739670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439369f-46a9-4c1b-8e2f-16edf3c3aed2 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:49.772589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05c5fe-23f1-44de-8ac2-104c156900d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:49.773281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05c5fe-23f1-44de-8ac2-104c156900d2 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:49.773565 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05c5fe-23f1-44de-8ac2-104c156900d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:49.773841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05c5fe-23f1-44de-8ac2-104c156900d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:49.774623 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05c5fe-23f1-44de-8ac2-104c156900d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:49.774935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05c5fe-23f1-44de-8ac2-104c156900d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:49.776930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05c5fe-23f1-44de-8ac2-104c156900d2 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:49.793668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 397/823] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:49.793668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05c5fe-23f1-44de-8ac2-104c156900d2 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:49.814700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d990e7-c2ef-4160-9dce-643b1a1265ab None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:49.847604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccdc82-b4e0-4afb-b964-0e3170122fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:49.848439 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccdc82-b4e0-4afb-b964-0e3170122fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:49.848816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccdc82-b4e0-4afb-b964-0e3170122fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:49.849192 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccdc82-b4e0-4afb-b964-0e3170122fc2 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:49.849965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccdc82-b4e0-4afb-b964-0e3170122fc2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:49.850336 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccdc82-b4e0-4afb-b964-0e3170122fc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:49.851755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccdc82-b4e0-4afb-b964-0e3170122fc2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:49.856228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 427/824] 10.222.0.61 () {56 vars in 1124 bytes} [Tue May 10 20:14:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:49.857082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccdc82-b4e0-4afb-b964-0e3170122fc2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:49.889149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05c5fe-23f1-44de-8ac2-104c156900d2 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:49.923542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572be0bf-7621-42e8-a625-65351a1a3e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:49.924451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572be0bf-7621-42e8-a625-65351a1a3e71 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:49.924796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572be0bf-7621-42e8-a625-65351a1a3e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:49.925178 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572be0bf-7621-42e8-a625-65351a1a3e71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:49.932474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572be0bf-7621-42e8-a625-65351a1a3e71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:49.934019 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572be0bf-7621-42e8-a625-65351a1a3e71 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-572be0bf-7621-42e8-a625-65351a1a3e71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:49.948052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:49.949093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:49.950220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:49.950220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:49.950220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:49.950220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:49.950220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:49.950220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:49.950220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:49.950220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:49.955860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 398/825] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:49.955860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572be0bf-7621-42e8-a625-65351a1a3e71 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:49.956100 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccdc82-b4e0-4afb-b964-0e3170122fc2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:49.992619 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06e7de-cd1c-49d4-8c1f-ed3d4e945808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:49.993452 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06e7de-cd1c-49d4-8c1f-ed3d4e945808 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:49.993592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06e7de-cd1c-49d4-8c1f-ed3d4e945808 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:49.994331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06e7de-cd1c-49d4-8c1f-ed3d4e945808 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:49.995039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06e7de-cd1c-49d4-8c1f-ed3d4e945808 None admin] RBAC: Adding query filter params (type=network) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:49.995345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06e7de-cd1c-49d4-8c1f-ed3d4e945808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:49.996703 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06e7de-cd1c-49d4-8c1f-ed3d4e945808 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:50.001792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 428/826] 10.222.0.61 () {56 vars in 1112 bytes} [Tue May 10 20:14:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:50.002352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06e7de-cd1c-49d4-8c1f-ed3d4e945808 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:50.057212 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572be0bf-7621-42e8-a625-65351a1a3e71 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:50.089800 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3330c8-86d5-4d69-bc25-aef8fa03ef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:50.090688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3330c8-86d5-4d69-bc25-aef8fa03ef11 None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:50.090966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3330c8-86d5-4d69-bc25-aef8fa03ef11 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:50.091241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3330c8-86d5-4d69-bc25-aef8fa03ef11 None admin] PATH_INFO: `/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/6acfba37d6b84bf3a63d40e6e4096f5d/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:50.093221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3330c8-86d5-4d69-bc25-aef8fa03ef11 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b37547e1bf4906b65ac39aad3a608c, user_id=6acfba37d6b84bf3a63d40e6e4096f5d, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:50.094658 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3330c8-86d5-4d69-bc25-aef8fa03ef11 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:50.099607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06e7de-cd1c-49d4-8c1f-ed3d4e945808 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:50.108702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 399/827] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:14:49 2022] PUT /identity/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/6acfba37d6b84bf3a63d40e6e4096f5d/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:14:50.109832 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3330c8-86d5-4d69-bc25-aef8fa03ef11 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:50.136007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17b96e-7c25-43db-b085-9fa4f91efce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:50.136734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17b96e-7c25-43db-b085-9fa4f91efce9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:50.137045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17b96e-7c25-43db-b085-9fa4f91efce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:50.137366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17b96e-7c25-43db-b085-9fa4f91efce9 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:50.138190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17b96e-7c25-43db-b085-9fa4f91efce9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:50.138498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17b96e-7c25-43db-b085-9fa4f91efce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:50.140002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17b96e-7c25-43db-b085-9fa4f91efce9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:50.146118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 429/828] 10.222.0.61 () {56 vars in 1124 bytes} [Tue May 10 20:14:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:50.147339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17b96e-7c25-43db-b085-9fa4f91efce9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:50.233212 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3330c8-86d5-4d69-bc25-aef8fa03ef11 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:50.253734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17b96e-7c25-43db-b085-9fa4f91efce9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:50.276139 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f6273-dd04-4252-8f1e-621a41246267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:50.276819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6273-dd04-4252-8f1e-621a41246267 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:50.277134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6273-dd04-4252-8f1e-621a41246267 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:50.277406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f6273-dd04-4252-8f1e-621a41246267 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:50.278201 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6273-dd04-4252-8f1e-621a41246267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:50.278909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6273-dd04-4252-8f1e-621a41246267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:50.279967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f6273-dd04-4252-8f1e-621a41246267 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:50.298320 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 400/829] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:50.299270 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f6273-dd04-4252-8f1e-621a41246267 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:50.299816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497d179-c4bb-4716-bf39-57f11bf9a5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:50.300701 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497d179-c4bb-4716-bf39-57f11bf9a5c0 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:50.301170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497d179-c4bb-4716-bf39-57f11bf9a5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:50.301627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497d179-c4bb-4716-bf39-57f11bf9a5c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:50.302788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497d179-c4bb-4716-bf39-57f11bf9a5c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:50.305357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497d179-c4bb-4716-bf39-57f11bf9a5c0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:50.333866 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 430/830] 10.222.0.61 () {60 vars in 1144 bytes} [Tue May 10 20:14:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:14:50.334960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497d179-c4bb-4716-bf39-57f11bf9a5c0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:50.411459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f6273-dd04-4252-8f1e-621a41246267 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:50.460517 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497d179-c4bb-4716-bf39-57f11bf9a5c0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:50.485655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bca3a-469f-481d-aa8c-caffab6c27d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:50.486341 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bca3a-469f-481d-aa8c-caffab6c27d2 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:50.486630 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bca3a-469f-481d-aa8c-caffab6c27d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:50.486911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bca3a-469f-481d-aa8c-caffab6c27d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:50.487668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bca3a-469f-481d-aa8c-caffab6c27d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:50.489075 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bca3a-469f-481d-aa8c-caffab6c27d2 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:50.507849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e86913-73ce-48d2-aaf8-da1d219be57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:50.508841 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86913-73ce-48d2-aaf8-da1d219be57d None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:50.509152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86913-73ce-48d2-aaf8-da1d219be57d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:50.510011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e86913-73ce-48d2-aaf8-da1d219be57d None admin] PATH_INFO: `/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/7cb2f98e2f844526b48475c783703d17/roles/fd14ccb80b45427381dd82c06ef844b4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:50.531234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e86913-73ce-48d2-aaf8-da1d219be57d None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b37547e1bf4906b65ac39aad3a608c, user_id=7cb2f98e2f844526b48475c783703d17, role_id=fd14ccb80b45427381dd82c06ef844b4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:50.532825 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e86913-73ce-48d2-aaf8-da1d219be57d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:50.541084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 401/831] 10.222.0.61 () {60 vars in 1144 bytes} [Tue May 10 20:14:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:14:50.553221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 431/832] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:14:50 2022] PUT /identity/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/7cb2f98e2f844526b48475c783703d17/roles/fd14ccb80b45427381dd82c06ef844b4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:14:51.700003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a77317-34c5-4dfb-9129-811bf4b78a3c None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:51.700571 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a77317-34c5-4dfb-9129-811bf4b78a3c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:51.700571 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a77317-34c5-4dfb-9129-811bf4b78a3c None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:51.702234 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 402/833] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:51.707482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885d65-2a7d-4911-be8a-22921e8d0ed6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:51.707866 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885d65-2a7d-4911-be8a-22921e8d0ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:51.708048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885d65-2a7d-4911-be8a-22921e8d0ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:51.724948 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1c885d65-2a7d-4911-be8a-22921e8d0ed6 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:51.726146 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1c885d65-2a7d-4911-be8a-22921e8d0ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:51.799494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 432/834] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:14:51.821179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a77317-34c5-4dfb-9129-811bf4b78a3c None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:51.926338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a77317-34c5-4dfb-9129-811bf4b78a3c None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:51.960380 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9f656-0097-43df-a60f-7fb745073ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:51.961135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9f656-0097-43df-a60f-7fb745073ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:51.961420 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9f656-0097-43df-a60f-7fb745073ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:51.961695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9f656-0097-43df-a60f-7fb745073ee7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:51.962342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9f656-0097-43df-a60f-7fb745073ee7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:51.964286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9f656-0097-43df-a60f-7fb745073ee7 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-a1f9f656-0097-43df-a60f-7fb745073ee7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:51.976348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:51.977335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:51.978236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 403/835] 10.222.0.61 () {56 vars in 1132 bytes} [Tue May 10 20:14:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:51.983788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c885d65-2a7d-4911-be8a-22921e8d0ed6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:52.082787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c885d65-2a7d-4911-be8a-22921e8d0ed6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:52.115469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad7108-7d4c-440e-96a0-9c4d512de303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:52.116135 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad7108-7d4c-440e-96a0-9c4d512de303 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:52.116417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad7108-7d4c-440e-96a0-9c4d512de303 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:52.116694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad7108-7d4c-440e-96a0-9c4d512de303 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:52.117425 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad7108-7d4c-440e-96a0-9c4d512de303 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:52.117736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad7108-7d4c-440e-96a0-9c4d512de303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:52.119653 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad7108-7d4c-440e-96a0-9c4d512de303 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:52.124367 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 433/836] 10.222.0.61 () {56 vars in 1126 bytes} [Tue May 10 20:14:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:52.129864 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9f656-0097-43df-a60f-7fb745073ee7 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:52.228949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9f656-0097-43df-a60f-7fb745073ee7 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:52.262816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da3cc9-26c3-4973-a813-dc45dc9faf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:52.263488 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da3cc9-26c3-4973-a813-dc45dc9faf91 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:52.263774 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da3cc9-26c3-4973-a813-dc45dc9faf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:52.264055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da3cc9-26c3-4973-a813-dc45dc9faf91 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:52.264765 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da3cc9-26c3-4973-a813-dc45dc9faf91 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:52.265099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da3cc9-26c3-4973-a813-dc45dc9faf91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:52.266462 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da3cc9-26c3-4973-a813-dc45dc9faf91 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:52.271257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 404/837] 10.222.0.61 () {56 vars in 1126 bytes} [Tue May 10 20:14:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:52.500112 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eb888-7ce0-4fc8-9023-4d64574e33cc None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:52.500487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eb888-7ce0-4fc8-9023-4d64574e33cc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:52.500658 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eb888-7ce0-4fc8-9023-4d64574e33cc None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:52.502224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 434/838] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:52.507483 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce92bbf-5ea5-4809-b656-f4c10db9e740 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:52.507776 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce92bbf-5ea5-4809-b656-f4c10db9e740 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:52.508063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce92bbf-5ea5-4809-b656-f4c10db9e740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:52.526780 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-4ce92bbf-5ea5-4809-b656-f4c10db9e740 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:52.528261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-4ce92bbf-5ea5-4809-b656-f4c10db9e740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:52.601054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 405/839] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:14:52.620583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eb888-7ce0-4fc8-9023-4d64574e33cc None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:52.728698 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eb888-7ce0-4fc8-9023-4d64574e33cc None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:52.767799 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9683fcb-fe12-404b-98ef-947758b6a582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:52.768518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9683fcb-fe12-404b-98ef-947758b6a582 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:52.768797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9683fcb-fe12-404b-98ef-947758b6a582 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:52.769109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9683fcb-fe12-404b-98ef-947758b6a582 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:52.780462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9683fcb-fe12-404b-98ef-947758b6a582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-e9683fcb-fe12-404b-98ef-947758b6a582 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:52.788209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:52.789179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:52.790232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:52.790232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:52.790232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:52.790232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:52.790232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:52.790232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:52.790232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:52.790232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:52.790232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:52.790232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:52.790232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:14:52.790232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:52.790232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 435/840] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:14:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:52.798325 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce92bbf-5ea5-4809-b656-f4c10db9e740 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:52.900684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eca84-a3ac-4521-a6c6-5934ccd31fbd None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:52.901017 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eca84-a3ac-4521-a6c6-5934ccd31fbd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:52.901385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eca84-a3ac-4521-a6c6-5934ccd31fbd None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:52.902965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 436/841] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:52.903362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce92bbf-5ea5-4809-b656-f4c10db9e740 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:52.908079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f4d1-1e73-407e-aaeb-e1941459cf6e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:52.908603 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f4d1-1e73-407e-aaeb-e1941459cf6e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:52.909105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f4d1-1e73-407e-aaeb-e1941459cf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:52.928089 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f593f4d1-1e73-407e-aaeb-e1941459cf6e None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:52.929288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f593f4d1-1e73-407e-aaeb-e1941459cf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:52.937775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfe382-1099-4766-8b83-ccfa0270ecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:52.938443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfe382-1099-4766-8b83-ccfa0270ecad None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:52.938722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfe382-1099-4766-8b83-ccfa0270ecad None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:52.938990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfe382-1099-4766-8b83-ccfa0270ecad None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:52.939733 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfe382-1099-4766-8b83-ccfa0270ecad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:52.940031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfe382-1099-4766-8b83-ccfa0270ecad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:52.941420 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfe382-1099-4766-8b83-ccfa0270ecad None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:52.954013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 406/842] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:14:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:52.954013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4a702-214f-4be8-84fd-0bdff044a7df None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:52.954013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4a702-214f-4be8-84fd-0bdff044a7df None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:52.954013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4a702-214f-4be8-84fd-0bdff044a7df None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:52.954013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 407/843] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:52.957249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4a702-214f-4be8-84fd-0bdff044a7df None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:53.002668 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 437/844] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:14:53.003755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187d151-d784-4911-9fc5-4b62e9545f28 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:53.004046 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187d151-d784-4911-9fc5-4b62e9545f28 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:53.004323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187d151-d784-4911-9fc5-4b62e9545f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:53.026721 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4187d151-d784-4911-9fc5-4b62e9545f28 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:53.028757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4187d151-d784-4911-9fc5-4b62e9545f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:53.072486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4a702-214f-4be8-84fd-0bdff044a7df None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:53.101009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 438/845] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:14:53.101009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187d151-d784-4911-9fc5-4b62e9545f28 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:53.112876 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f576fd-c7be-4316-ba58-6aa4690d43b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:53.114602 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f576fd-c7be-4316-ba58-6aa4690d43b1 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:53.115089 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f576fd-c7be-4316-ba58-6aa4690d43b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:53.115965 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f576fd-c7be-4316-ba58-6aa4690d43b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:53.128455 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f576fd-c7be-4316-ba58-6aa4690d43b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:53.129990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f576fd-c7be-4316-ba58-6aa4690d43b1 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-94f576fd-c7be-4316-ba58-6aa4690d43b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:53.147369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:53.148463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:53.149613 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:53.149613 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:53.149613 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:53.149613 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:53.150647 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 408/846] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:53.151349 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f576fd-c7be-4316-ba58-6aa4690d43b1 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:53.211046 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187d151-d784-4911-9fc5-4b62e9545f28 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:53.244537 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd85467-d2bc-4901-885a-f8d7dcc2996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:53.245922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85467-d2bc-4901-885a-f8d7dcc2996f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:53.246209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85467-d2bc-4901-885a-f8d7dcc2996f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:53.246483 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd85467-d2bc-4901-885a-f8d7dcc2996f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:53.252901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f576fd-c7be-4316-ba58-6aa4690d43b1 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:53.257746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd85467-d2bc-4901-885a-f8d7dcc2996f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-bbd85467-d2bc-4901-885a-f8d7dcc2996f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:53.265921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:53.266855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:53.267685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:53.267685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:53.267685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:53.267685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:53.267685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:53.267685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:53.267685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:53.267685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:53.267685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:53.267685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:53.267685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:14:53.267685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:53.267685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 439/847] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:14:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:53.268380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd85467-d2bc-4901-885a-f8d7dcc2996f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:53.289151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d409c2-b22c-48b1-847d-5785b50759e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:53.289881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d409c2-b22c-48b1-847d-5785b50759e5 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:53.290168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d409c2-b22c-48b1-847d-5785b50759e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:53.290636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d409c2-b22c-48b1-847d-5785b50759e5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:53.291116 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d409c2-b22c-48b1-847d-5785b50759e5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:53.292483 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d409c2-b22c-48b1-847d-5785b50759e5 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-57d409c2-b22c-48b1-847d-5785b50759e5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:53.303907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:53.304895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:53.305746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 409/848] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:14:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:53.307118 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d409c2-b22c-48b1-847d-5785b50759e5 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:53.375286 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd85467-d2bc-4901-885a-f8d7dcc2996f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:53.408586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c1bdc-6709-4bce-91af-118d8b378700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:53.409279 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c1bdc-6709-4bce-91af-118d8b378700 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:53.409564 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c1bdc-6709-4bce-91af-118d8b378700 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:53.409846 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c1bdc-6709-4bce-91af-118d8b378700 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:53.410101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d409c2-b22c-48b1-847d-5785b50759e5 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:53.410562 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c1bdc-6709-4bce-91af-118d8b378700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:53.410870 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c1bdc-6709-4bce-91af-118d8b378700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:53.412237 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c1bdc-6709-4bce-91af-118d8b378700 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:53.431653 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 440/849] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:53.431653 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c1bdc-6709-4bce-91af-118d8b378700 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:53.447311 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f584a5-7d91-46a0-b99e-7817f50a24e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:53.448018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f584a5-7d91-46a0-b99e-7817f50a24e0 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:53.448307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f584a5-7d91-46a0-b99e-7817f50a24e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:53.448586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f584a5-7d91-46a0-b99e-7817f50a24e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:53.449403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f584a5-7d91-46a0-b99e-7817f50a24e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:53.449718 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f584a5-7d91-46a0-b99e-7817f50a24e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:53.451162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f584a5-7d91-46a0-b99e-7817f50a24e0 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:53.460594 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 410/850] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:14:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:53.461481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f584a5-7d91-46a0-b99e-7817f50a24e0 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:53.535486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c1bdc-6709-4bce-91af-118d8b378700 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:53.558464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f584a5-7d91-46a0-b99e-7817f50a24e0 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:53.569280 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89223c0b-489f-4675-9d77-de4fc24e3fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:53.569948 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89223c0b-489f-4675-9d77-de4fc24e3fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:53.570230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89223c0b-489f-4675-9d77-de4fc24e3fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:53.570506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89223c0b-489f-4675-9d77-de4fc24e3fc6 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:53.571208 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89223c0b-489f-4675-9d77-de4fc24e3fc6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:53.571515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89223c0b-489f-4675-9d77-de4fc24e3fc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:53.572923 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89223c0b-489f-4675-9d77-de4fc24e3fc6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:53.581553 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 441/851] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:14:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:53.581553 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89223c0b-489f-4675-9d77-de4fc24e3fc6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:53.596472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c74d7a-3378-4434-8660-d14a0094d01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:53.597305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c74d7a-3378-4434-8660-d14a0094d01e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:53.597592 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c74d7a-3378-4434-8660-d14a0094d01e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:53.597859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c74d7a-3378-4434-8660-d14a0094d01e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:53.606657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c74d7a-3378-4434-8660-d14a0094d01e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:53.608094 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c74d7a-3378-4434-8660-d14a0094d01e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-a4c74d7a-3378-4434-8660-d14a0094d01e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:53.623442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:53.624429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:53.625500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:53.625500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:53.625500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:53.625500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:53.625500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:53.625500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:53.625500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:53.625500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:53.625500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 20:14:53.625500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:53.629397 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 411/852] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:14:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:53.630154 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c74d7a-3378-4434-8660-d14a0094d01e None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:53.682356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89223c0b-489f-4675-9d77-de4fc24e3fc6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:53.714505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff97f9c-79a8-4d2d-9f8e-f29178be46f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:53.715302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff97f9c-79a8-4d2d-9f8e-f29178be46f3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:53.715590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff97f9c-79a8-4d2d-9f8e-f29178be46f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:53.715869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff97f9c-79a8-4d2d-9f8e-f29178be46f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:53.725546 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c74d7a-3378-4434-8660-d14a0094d01e None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:53.726021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff97f9c-79a8-4d2d-9f8e-f29178be46f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:53.727465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff97f9c-79a8-4d2d-9f8e-f29178be46f3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-cff97f9c-79a8-4d2d-9f8e-f29178be46f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:53.744435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:53.745904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:53.746784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:53.746784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:53.746784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:53.746784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:53.749277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 442/853] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:53.750498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff97f9c-79a8-4d2d-9f8e-f29178be46f3 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:53.760934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e02c2-ae86-4917-b138-5bf377a55293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:53.761649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e02c2-ae86-4917-b138-5bf377a55293 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:53.762287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e02c2-ae86-4917-b138-5bf377a55293 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:53.762601 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e02c2-ae86-4917-b138-5bf377a55293 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:53.763317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e02c2-ae86-4917-b138-5bf377a55293 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:53.763624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e02c2-ae86-4917-b138-5bf377a55293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:53.765092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e02c2-ae86-4917-b138-5bf377a55293 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:53.769432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 412/854] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:14:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:53.770490 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e02c2-ae86-4917-b138-5bf377a55293 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:53.874656 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff97f9c-79a8-4d2d-9f8e-f29178be46f3 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:53.881368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e02c2-ae86-4917-b138-5bf377a55293 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:53.911929 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f80c9-3034-4482-9b17-15d7a130495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:53.912612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f80c9-3034-4482-9b17-15d7a130495d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:53.912898 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f80c9-3034-4482-9b17-15d7a130495d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:53.913229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f80c9-3034-4482-9b17-15d7a130495d None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:53.914101 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f80c9-3034-4482-9b17-15d7a130495d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:53.914417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f80c9-3034-4482-9b17-15d7a130495d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:53.916094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f80c9-3034-4482-9b17-15d7a130495d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:53.921509 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ba63e-82a8-464b-bb5c-707e03654c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:53.922505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ba63e-82a8-464b-bb5c-707e03654c81 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:53.922996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ba63e-82a8-464b-bb5c-707e03654c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:53.923535 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ba63e-82a8-464b-bb5c-707e03654c81 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:53.924511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ba63e-82a8-464b-bb5c-707e03654c81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:53.925080 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ba63e-82a8-464b-bb5c-707e03654c81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:53.926699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ba63e-82a8-464b-bb5c-707e03654c81 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:53.940199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 443/855] 10.222.0.61 () {56 vars in 1135 bytes} [Tue May 10 20:14:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:53.941903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f80c9-3034-4482-9b17-15d7a130495d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:53.943115 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 413/856] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:53.951168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ba63e-82a8-464b-bb5c-707e03654c81 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:54.061579 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f80c9-3034-4482-9b17-15d7a130495d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:54.077359 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ba63e-82a8-464b-bb5c-707e03654c81 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:54.105239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174ecbe-224f-4482-8cb7-6a771f85ad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:54.106344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174ecbe-224f-4482-8cb7-6a771f85ad3d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:54.106731 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174ecbe-224f-4482-8cb7-6a771f85ad3d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:54.107110 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174ecbe-224f-4482-8cb7-6a771f85ad3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:54.113455 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5fb99-0ffc-46f0-b40e-3b9ada73f537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:54.114470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5fb99-0ffc-46f0-b40e-3b9ada73f537 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:54.114903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5fb99-0ffc-46f0-b40e-3b9ada73f537 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:54.115324 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5fb99-0ffc-46f0-b40e-3b9ada73f537 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:54.122888 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5fb99-0ffc-46f0-b40e-3b9ada73f537 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:54.124544 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5fb99-0ffc-46f0-b40e-3b9ada73f537 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-66d5fb99-0ffc-46f0-b40e-3b9ada73f537 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:54.140882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:54.141894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:54.142856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:54.142856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:54.142856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:54.142856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:54.142856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:54.142856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:54.142856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:54.142856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:54.142856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:14:54.142856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:54.145562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 414/857] 10.222.0.61 () {56 vars in 1117 bytes} [Tue May 10 20:14:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:54.160994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5fb99-0ffc-46f0-b40e-3b9ada73f537 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:54.190267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174ecbe-224f-4482-8cb7-6a771f85ad3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:54.192105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174ecbe-224f-4482-8cb7-6a771f85ad3d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:54.251932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5fb99-0ffc-46f0-b40e-3b9ada73f537 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:54.297421 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c185b82-d6e3-4322-b23a-5e48c4ed122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:54.298376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c185b82-d6e3-4322-b23a-5e48c4ed122d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:54.298668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c185b82-d6e3-4322-b23a-5e48c4ed122d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:54.298944 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c185b82-d6e3-4322-b23a-5e48c4ed122d None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:54.299789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c185b82-d6e3-4322-b23a-5e48c4ed122d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:54.300100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c185b82-d6e3-4322-b23a-5e48c4ed122d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:54.301617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c185b82-d6e3-4322-b23a-5e48c4ed122d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:54.302070 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 444/858] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:53 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 20:14:54.309830 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174ecbe-224f-4482-8cb7-6a771f85ad3d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:54.321460 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 415/859] 10.222.0.61 () {56 vars in 1149 bytes} [Tue May 10 20:14:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:54.329988 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c185b82-d6e3-4322-b23a-5e48c4ed122d None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:54.407519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174ecbe-224f-4482-8cb7-6a771f85ad3d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:54.445400 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296baf4-8eef-425b-8c58-cef4f344c913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:54.446199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296baf4-8eef-425b-8c58-cef4f344c913 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:54.446483 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296baf4-8eef-425b-8c58-cef4f344c913 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:54.447443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296baf4-8eef-425b-8c58-cef4f344c913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:54.457627 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c185b82-d6e3-4322-b23a-5e48c4ed122d None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:54.458793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296baf4-8eef-425b-8c58-cef4f344c913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:54.460340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296baf4-8eef-425b-8c58-cef4f344c913 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-7296baf4-8eef-425b-8c58-cef4f344c913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:54.477813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:54.478992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:54.480022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:54.480022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:54.480022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:54.480022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:54.481415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 445/860] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:54.486047 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296baf4-8eef-425b-8c58-cef4f344c913 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:54.499286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b15170-9bfe-42b3-b93a-4e391f25b5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:54.500240 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b15170-9bfe-42b3-b93a-4e391f25b5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:54.500707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b15170-9bfe-42b3-b93a-4e391f25b5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:54.501209 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b15170-9bfe-42b3-b93a-4e391f25b5c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:54.582458 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b15170-9bfe-42b3-b93a-4e391f25b5c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:54.584310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b15170-9bfe-42b3-b93a-4e391f25b5c8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:54.608211 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296baf4-8eef-425b-8c58-cef4f344c913 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:54.646055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3942d-c946-4168-a1e7-9e675fa21318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:54.646980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3942d-c946-4168-a1e7-9e675fa21318 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:54.647262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3942d-c946-4168-a1e7-9e675fa21318 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:54.647544 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3942d-c946-4168-a1e7-9e675fa21318 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:54.648271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3942d-c946-4168-a1e7-9e675fa21318 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:54.648627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3942d-c946-4168-a1e7-9e675fa21318 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:54.650062 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3942d-c946-4168-a1e7-9e675fa21318 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:54.661515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 446/861] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:54.662517 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf7cda-ec4a-46a6-922c-046734219004 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:54.662803 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf7cda-ec4a-46a6-922c-046734219004 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:54.663082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf7cda-ec4a-46a6-922c-046734219004 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:54.665003 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 447/862] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:54.667437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf7cda-ec4a-46a6-922c-046734219004 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:54.694021 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 416/863] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:14:54.695305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6339b1d-01eb-4050-8045-f4f0333b36a8 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:54.695598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6339b1d-01eb-4050-8045-f4f0333b36a8 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:54.695878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6339b1d-01eb-4050-8045-f4f0333b36a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:54.711397 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b6339b1d-01eb-4050-8045-f4f0333b36a8 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:54.712591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b6339b1d-01eb-4050-8045-f4f0333b36a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:54.772806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf7cda-ec4a-46a6-922c-046734219004 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:54.781164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 417/864] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:14:54.781164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6339b1d-01eb-4050-8045-f4f0333b36a8 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:54.813307 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d246f-1f95-4d04-9a2b-0461dae5dea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:54.814106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d246f-1f95-4d04-9a2b-0461dae5dea0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:54.814392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d246f-1f95-4d04-9a2b-0461dae5dea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:54.814672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d246f-1f95-4d04-9a2b-0461dae5dea0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:54.821675 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d246f-1f95-4d04-9a2b-0461dae5dea0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:54.823150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d246f-1f95-4d04-9a2b-0461dae5dea0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-384d246f-1f95-4d04-9a2b-0461dae5dea0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:54.836503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:54.837568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:54.838461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:54.838461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:54.838461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:54.838461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:54.838461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:54.838461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:54.838461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:54.838461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:54.838461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 448/865] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:54.838461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d246f-1f95-4d04-9a2b-0461dae5dea0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:54.879800 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6339b1d-01eb-4050-8045-f4f0333b36a8 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:54.920028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ac926-e140-4fbb-8db1-63acef4f6a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:54.921671 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ac926-e140-4fbb-8db1-63acef4f6a88 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:54.922052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ac926-e140-4fbb-8db1-63acef4f6a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:54.922343 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ac926-e140-4fbb-8db1-63acef4f6a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:54.933284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ac926-e140-4fbb-8db1-63acef4f6a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:54.934726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ac926-e140-4fbb-8db1-63acef4f6a88 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:54.939867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d246f-1f95-4d04-9a2b-0461dae5dea0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-2c1ac926-e140-4fbb-8db1-63acef4f6a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:54.951587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:54.952471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:54.953456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:54.953456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:54.953456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:54.953456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:54.953456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 418/866] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:54.954154 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ac926-e140-4fbb-8db1-63acef4f6a88 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:54.983642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb7ab1-3151-4a32-b1b2-9c65d391b05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:54.984320 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb7ab1-3151-4a32-b1b2-9c65d391b05d None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:54.984888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb7ab1-3151-4a32-b1b2-9c65d391b05d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:54.984888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb7ab1-3151-4a32-b1b2-9c65d391b05d None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:54.985700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb7ab1-3151-4a32-b1b2-9c65d391b05d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:54.987015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb7ab1-3151-4a32-b1b2-9c65d391b05d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:55.002193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 449/867] 10.222.0.61 () {60 vars in 1141 bytes} [Tue May 10 20:14:54 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:14:55.002813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb7ab1-3151-4a32-b1b2-9c65d391b05d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:55.090514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ac926-e140-4fbb-8db1-63acef4f6a88 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:55.126228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb7ab1-3151-4a32-b1b2-9c65d391b05d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:55.140423 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024eb55c-28a2-4720-a552-5d7ab285d23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:55.141707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024eb55c-28a2-4720-a552-5d7ab285d23d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:55.142546 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024eb55c-28a2-4720-a552-5d7ab285d23d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:55.143652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024eb55c-28a2-4720-a552-5d7ab285d23d None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:55.145487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024eb55c-28a2-4720-a552-5d7ab285d23d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:55.145808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024eb55c-28a2-4720-a552-5d7ab285d23d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:55.147617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024eb55c-28a2-4720-a552-5d7ab285d23d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:55.161031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 419/868] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:55.167841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024eb55c-28a2-4720-a552-5d7ab285d23d None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:55.171803 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001025b-fdb6-4616-bc35-e95245d19b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:55.172466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001025b-fdb6-4616-bc35-e95245d19b5e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:55.172747 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001025b-fdb6-4616-bc35-e95245d19b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:55.173130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001025b-fdb6-4616-bc35-e95245d19b5e None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:55.173850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001025b-fdb6-4616-bc35-e95245d19b5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:55.174158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001025b-fdb6-4616-bc35-e95245d19b5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:55.175625 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001025b-fdb6-4616-bc35-e95245d19b5e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:55.193253 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 450/869] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:55.194220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001025b-fdb6-4616-bc35-e95245d19b5e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:55.283036 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024eb55c-28a2-4720-a552-5d7ab285d23d None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:55.309096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001025b-fdb6-4616-bc35-e95245d19b5e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:55.324434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9071f3-f414-41f1-8f7b-acd305b02d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:55.325114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9071f3-f414-41f1-8f7b-acd305b02d23 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:55.325398 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9071f3-f414-41f1-8f7b-acd305b02d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:55.325671 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9071f3-f414-41f1-8f7b-acd305b02d23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:55.326669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9071f3-f414-41f1-8f7b-acd305b02d23 None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=6acfba37d6b84bf3a63d40e6e4096f5d) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:55.327260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9071f3-f414-41f1-8f7b-acd305b02d23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:55.328688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9071f3-f414-41f1-8f7b-acd305b02d23 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:55.341002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 420/870] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:55 2022] GET /identity/v3/role_assignments?user.id=6acfba37d6b84bf3a63d40e6e4096f5d&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:55.345204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc672952-a90f-460b-92f2-faf6b12a0051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:55.346015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc672952-a90f-460b-92f2-faf6b12a0051 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:55.346295 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc672952-a90f-460b-92f2-faf6b12a0051 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:55.346567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc672952-a90f-460b-92f2-faf6b12a0051 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:55.354990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc672952-a90f-460b-92f2-faf6b12a0051 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:55.356506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc672952-a90f-460b-92f2-faf6b12a0051 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-fc672952-a90f-460b-92f2-faf6b12a0051 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:14:55.372335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:55.373339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:55.374742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:14:55.374742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:14:55.374742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:14:55.374742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:14:55.374742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:14:55.374742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:14:55.374742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:14:55.374742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:55.374742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 451/871] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:14:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:55.382160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9071f3-f414-41f1-8f7b-acd305b02d23 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:55.499525 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9071f3-f414-41f1-8f7b-acd305b02d23 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:55.534235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3085fec-b67b-4d41-8713-0123a40bfbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:55.534911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3085fec-b67b-4d41-8713-0123a40bfbac None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:55.535190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3085fec-b67b-4d41-8713-0123a40bfbac None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:55.535462 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3085fec-b67b-4d41-8713-0123a40bfbac None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:55.536249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3085fec-b67b-4d41-8713-0123a40bfbac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:55.536556 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3085fec-b67b-4d41-8713-0123a40bfbac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:55.538013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3085fec-b67b-4d41-8713-0123a40bfbac None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:55.551066 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 421/872] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:14:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:55.557883 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc672952-a90f-460b-92f2-faf6b12a0051 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:55.658627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc672952-a90f-460b-92f2-faf6b12a0051 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:55.695744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c7585-d0a3-4a32-8fac-8ac97c0bcad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:55.696412 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c7585-d0a3-4a32-8fac-8ac97c0bcad3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:55.696762 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c7585-d0a3-4a32-8fac-8ac97c0bcad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:55.697073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c7585-d0a3-4a32-8fac-8ac97c0bcad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:55.697912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c7585-d0a3-4a32-8fac-8ac97c0bcad3 None admin] RBAC: Adding query filter params (role.id=fd14ccb80b45427381dd82c06ef844b4, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=7cb2f98e2f844526b48475c783703d17) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:55.698228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c7585-d0a3-4a32-8fac-8ac97c0bcad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:55.699677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c7585-d0a3-4a32-8fac-8ac97c0bcad3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:55.706282 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 452/873] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:14:55 2022] GET /identity/v3/role_assignments?user.id=7cb2f98e2f844526b48475c783703d17&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=fd14ccb80b45427381dd82c06ef844b4 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:56.069548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b26cb-ec2b-427e-a87f-aec2e97a2af5 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:56.070564 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b26cb-ec2b-427e-a87f-aec2e97a2af5 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:56.071065 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b26cb-ec2b-427e-a87f-aec2e97a2af5 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:56.072925 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 422/874] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:56.078547 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28bf53-60ea-446d-8b71-83b9093bac65 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:56.079339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28bf53-60ea-446d-8b71-83b9093bac65 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:56.079825 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28bf53-60ea-446d-8b71-83b9093bac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:56.097130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2d28bf53-60ea-446d-8b71-83b9093bac65 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:56.098599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2d28bf53-60ea-446d-8b71-83b9093bac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:56.167740 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 453/875] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:56 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:14:56.190336 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b26cb-ec2b-427e-a87f-aec2e97a2af5 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:56.297928 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b26cb-ec2b-427e-a87f-aec2e97a2af5 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:56.332944 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d743c-0d90-4b9f-b289-57d46e6ecc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:56.333974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d743c-0d90-4b9f-b289-57d46e6ecc78 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:56.334485 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d743c-0d90-4b9f-b289-57d46e6ecc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:56.334962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d743c-0d90-4b9f-b289-57d46e6ecc78 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:56.335903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d743c-0d90-4b9f-b289-57d46e6ecc78 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:56.338051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d743c-0d90-4b9f-b289-57d46e6ecc78 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:56.357211 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 423/876] 10.222.0.61 () {60 vars in 1141 bytes} [Tue May 10 20:14:56 2022] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:14:57.311748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c0612-fe7e-4845-96ae-5e94c8621260 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:57.312245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c0612-fe7e-4845-96ae-5e94c8621260 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:57.312245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c0612-fe7e-4845-96ae-5e94c8621260 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:57.313821 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 454/877] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:57.319162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838f006-911a-48c6-80b0-009d77eb1910 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:57.319554 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838f006-911a-48c6-80b0-009d77eb1910 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:57.319734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838f006-911a-48c6-80b0-009d77eb1910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:57.336202 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-d838f006-911a-48c6-80b0-009d77eb1910 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:57.337927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d838f006-911a-48c6-80b0-009d77eb1910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:57.411060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 424/878] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:14:57.433108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c0612-fe7e-4845-96ae-5e94c8621260 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:57.540119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c0612-fe7e-4845-96ae-5e94c8621260 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:57.573942 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98279d0-8207-4623-8a70-d59d31b6950f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:57.574668 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98279d0-8207-4623-8a70-d59d31b6950f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:57.574945 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98279d0-8207-4623-8a70-d59d31b6950f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:57.575215 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98279d0-8207-4623-8a70-d59d31b6950f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:57.575866 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98279d0-8207-4623-8a70-d59d31b6950f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:57.577254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98279d0-8207-4623-8a70-d59d31b6950f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-b98279d0-8207-4623-8a70-d59d31b6950f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:57.589834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:57.590810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:57.592083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 455/879] 10.222.0.61 () {56 vars in 1132 bytes} [Tue May 10 20:14:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:57.597219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838f006-911a-48c6-80b0-009d77eb1910 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:57.696036 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838f006-911a-48c6-80b0-009d77eb1910 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:57.701303 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918075e8-ddbf-40fb-97e2-d34272a8f0da None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:57.701596 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918075e8-ddbf-40fb-97e2-d34272a8f0da None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:57.701880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918075e8-ddbf-40fb-97e2-d34272a8f0da None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:57.703470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 456/880] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:14:57.708533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26109aa7-7978-4f65-9fd5-23b02e557e37 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:57.708850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26109aa7-7978-4f65-9fd5-23b02e557e37 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:57.709159 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26109aa7-7978-4f65-9fd5-23b02e557e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:57.726219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-26109aa7-7978-4f65-9fd5-23b02e557e37 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:57.727393 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-26109aa7-7978-4f65-9fd5-23b02e557e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:57.730733 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c4cc7-0d23-4152-88fd-e9c161069fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:57.731396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c4cc7-0d23-4152-88fd-e9c161069fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:57.731676 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c4cc7-0d23-4152-88fd-e9c161069fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:57.731946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c4cc7-0d23-4152-88fd-e9c161069fb9 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:57.732648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c4cc7-0d23-4152-88fd-e9c161069fb9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:57.732952 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c4cc7-0d23-4152-88fd-e9c161069fb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:57.734336 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c4cc7-0d23-4152-88fd-e9c161069fb9 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:57.739270 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 425/881] 10.222.0.61 () {56 vars in 1126 bytes} [Tue May 10 20:14:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:57.744680 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c4cc7-0d23-4152-88fd-e9c161069fb9 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:57.805055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 457/882] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:14:57.824087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26109aa7-7978-4f65-9fd5-23b02e557e37 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:57.870264 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c4cc7-0d23-4152-88fd-e9c161069fb9 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:57.915393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4448387-5e26-49fc-9f63-9e93c1a95728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:57.916118 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4448387-5e26-49fc-9f63-9e93c1a95728 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:57.916407 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4448387-5e26-49fc-9f63-9e93c1a95728 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:57.916683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4448387-5e26-49fc-9f63-9e93c1a95728 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:57.917472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4448387-5e26-49fc-9f63-9e93c1a95728 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:57.917794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4448387-5e26-49fc-9f63-9e93c1a95728 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:57.919145 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4448387-5e26-49fc-9f63-9e93c1a95728 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:57.924329 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 426/883] 10.222.0.61 () {56 vars in 1126 bytes} [Tue May 10 20:14:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:57.929928 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4448387-5e26-49fc-9f63-9e93c1a95728 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:57.938416 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26109aa7-7978-4f65-9fd5-23b02e557e37 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:57.983455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05520496-7ab3-4fa2-a89b-0c55805f733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:57.984445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520496-7ab3-4fa2-a89b-0c55805f733a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:57.984729 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520496-7ab3-4fa2-a89b-0c55805f733a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:57.985094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520496-7ab3-4fa2-a89b-0c55805f733a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:57.985713 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05520496-7ab3-4fa2-a89b-0c55805f733a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:57.987146 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05520496-7ab3-4fa2-a89b-0c55805f733a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-05520496-7ab3-4fa2-a89b-0c55805f733a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:57.999642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:58.000632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:58.001520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:58.001520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:58.001520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:58.001520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:58.001520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:58.001520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:58.001520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:58.001520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:58.001520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:58.001520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:58.001520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:14:58.001520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:58.001520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:14:58.001520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:58.005069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 458/884] 10.222.0.61 () {56 vars in 1126 bytes} [Tue May 10 20:14:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:58.007216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05520496-7ab3-4fa2-a89b-0c55805f733a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:58.048378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4448387-5e26-49fc-9f63-9e93c1a95728 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:58.082506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cab151-fe29-4810-ac6a-04c007466c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:58.083091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cab151-fe29-4810-ac6a-04c007466c1b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:58.083369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cab151-fe29-4810-ac6a-04c007466c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:58.083644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cab151-fe29-4810-ac6a-04c007466c1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:58.084425 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cab151-fe29-4810-ac6a-04c007466c1b None admin] RBAC: Adding query filter params (interface=public, service_id=9034033145fc429484bbfb08c8353660, region_id=RegionOne) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:58.084734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cab151-fe29-4810-ac6a-04c007466c1b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:58.086120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cab151-fe29-4810-ac6a-04c007466c1b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:58.091242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 427/885] 10.222.0.61 () {56 vars in 1251 bytes} [Tue May 10 20:14:57 2022] GET /identity/v3/endpoints?service_id=9034033145fc429484bbfb08c8353660&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:58.096811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5281c8-84a3-452d-b71c-17f89a5812e5 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:58.097130 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5281c8-84a3-452d-b71c-17f89a5812e5 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:58.097400 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5281c8-84a3-452d-b71c-17f89a5812e5 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:58.098637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 428/886] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:14:58.099311 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5281c8-84a3-452d-b71c-17f89a5812e5 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:58.112440 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05520496-7ab3-4fa2-a89b-0c55805f733a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:58.145105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8d75f-3444-47df-8c5b-ccacdbd088af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:58.145767 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8d75f-3444-47df-8c5b-ccacdbd088af None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:58.146044 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8d75f-3444-47df-8c5b-ccacdbd088af None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:58.146316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8d75f-3444-47df-8c5b-ccacdbd088af None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:58.147273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8d75f-3444-47df-8c5b-ccacdbd088af None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:58.147578 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8d75f-3444-47df-8c5b-ccacdbd088af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:58.148943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8d75f-3444-47df-8c5b-ccacdbd088af None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:58.154029 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 459/887] 10.222.0.61 () {56 vars in 1122 bytes} [Tue May 10 20:14:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:58.155085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c3beb-35bd-4b97-ba44-df92e8051e6d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:58.155366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c3beb-35bd-4b97-ba44-df92e8051e6d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:58.155636 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c3beb-35bd-4b97-ba44-df92e8051e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:58.171159 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-197c3beb-35bd-4b97-ba44-df92e8051e6d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:58.172304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-197c3beb-35bd-4b97-ba44-df92e8051e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:58.203365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5281c8-84a3-452d-b71c-17f89a5812e5 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:58.241008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 460/888] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:14:58.241208 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd7bf1-f8dd-4f20-a47f-9309e0117c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:58.241319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c3beb-35bd-4b97-ba44-df92e8051e6d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:58.241406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd7bf1-f8dd-4f20-a47f-9309e0117c83 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:58.241406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd7bf1-f8dd-4f20-a47f-9309e0117c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:58.241406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd7bf1-f8dd-4f20-a47f-9309e0117c83 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:58.241406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd7bf1-f8dd-4f20-a47f-9309e0117c83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:58.241406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd7bf1-f8dd-4f20-a47f-9309e0117c83 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:58.246564 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 429/889] 10.222.0.61 () {56 vars in 1087 bytes} [Tue May 10 20:14:58 2022] GET /identity/v3/services => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:14:58.263986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd7bf1-f8dd-4f20-a47f-9309e0117c83 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:58.358532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c3beb-35bd-4b97-ba44-df92e8051e6d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:58.387579 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd7bf1-f8dd-4f20-a47f-9309e0117c83 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:58.398387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15e0aa-8d9c-4526-97e5-31dd3e63bd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:58.399080 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15e0aa-8d9c-4526-97e5-31dd3e63bd91 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:58.399886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15e0aa-8d9c-4526-97e5-31dd3e63bd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:58.400180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15e0aa-8d9c-4526-97e5-31dd3e63bd91 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:58.400914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15e0aa-8d9c-4526-97e5-31dd3e63bd91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:58.401257 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15e0aa-8d9c-4526-97e5-31dd3e63bd91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:58.403363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15e0aa-8d9c-4526-97e5-31dd3e63bd91 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:58.414370 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 461/890] 10.222.0.61 () {56 vars in 1122 bytes} [Tue May 10 20:14:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:58.434334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6eb7-6192-4045-83a1-f9d3c5b67ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:58.435223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6eb7-6192-4045-83a1-f9d3c5b67ecc None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:58.435511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6eb7-6192-4045-83a1-f9d3c5b67ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:58.435782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed6eb7-6192-4045-83a1-f9d3c5b67ecc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:58.448727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed6eb7-6192-4045-83a1-f9d3c5b67ecc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-06ed6eb7-6192-4045-83a1-f9d3c5b67ecc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:14:58.457399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:58.458427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:58.459314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:58.459314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:58.459314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:58.459314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:58.459314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:14:58.459314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:14:58.459314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:14:58.459314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:14:58.459314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:14:58.459314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:14:58.459314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:14:58.459314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:58.459314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 430/891] 10.222.0.61 () {56 vars in 1120 bytes} [Tue May 10 20:14:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:14:58.466648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15e0aa-8d9c-4526-97e5-31dd3e63bd91 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:58.592951 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15e0aa-8d9c-4526-97e5-31dd3e63bd91 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:58.642616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5f3b8-9edd-4069-938f-35132b1f0ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:58.643503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5f3b8-9edd-4069-938f-35132b1f0ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:58.643878 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5f3b8-9edd-4069-938f-35132b1f0ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:58.644380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5f3b8-9edd-4069-938f-35132b1f0ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:58.645376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5f3b8-9edd-4069-938f-35132b1f0ea1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:58.645947 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5f3b8-9edd-4069-938f-35132b1f0ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:58.647900 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5f3b8-9edd-4069-938f-35132b1f0ea1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:58.660692 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 462/892] 10.222.0.61 () {56 vars in 1115 bytes} [Tue May 10 20:14:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:58.667036 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6eb7-6192-4045-83a1-f9d3c5b67ecc None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:58.711909 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba26d2-0f19-4f4c-a42c-3663ec9c6c90 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:58.712235 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba26d2-0f19-4f4c-a42c-3663ec9c6c90 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:58.712516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba26d2-0f19-4f4c-a42c-3663ec9c6c90 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:58.715203 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 463/893] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:14:58.719088 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29aeeb1-b8a4-404a-a940-93fead78fb25 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:58.719565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29aeeb1-b8a4-404a-a940-93fead78fb25 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:58.720039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29aeeb1-b8a4-404a-a940-93fead78fb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:58.737289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d29aeeb1-b8a4-404a-a940-93fead78fb25 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:14:58.738772 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d29aeeb1-b8a4-404a-a940-93fead78fb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:14:58.773022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed6eb7-6192-4045-83a1-f9d3c5b67ecc None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:58.807438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ef2ea-356a-44c6-ad58-24695d5d0ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:58.808334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ef2ea-356a-44c6-ad58-24695d5d0ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:58.808694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ef2ea-356a-44c6-ad58-24695d5d0ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:58.809258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 464/894] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:14:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:14:58.817105 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ef2ea-356a-44c6-ad58-24695d5d0ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:58.828641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ef2ea-356a-44c6-ad58-24695d5d0ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:58.830498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ef2ea-356a-44c6-ad58-24695d5d0ea5 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:58.831667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29aeeb1-b8a4-404a-a940-93fead78fb25 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-ad0ef2ea-356a-44c6-ad58-24695d5d0ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:58.851057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:58.852040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:58.853540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:58.853540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:58.853540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:58.853540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:58.857090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 431/895] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:58.858854 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ef2ea-356a-44c6-ad58-24695d5d0ea5 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:58.938231 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29aeeb1-b8a4-404a-a940-93fead78fb25 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:58.975305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ef2ea-356a-44c6-ad58-24695d5d0ea5 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:58.982899 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88c1bc-82c1-4850-bb4e-29ce4ce46fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:58.984070 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88c1bc-82c1-4850-bb4e-29ce4ce46fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:58.984550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88c1bc-82c1-4850-bb4e-29ce4ce46fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:58.985126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88c1bc-82c1-4850-bb4e-29ce4ce46fe3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:58.985979 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88c1bc-82c1-4850-bb4e-29ce4ce46fe3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:58.987570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88c1bc-82c1-4850-bb4e-29ce4ce46fe3 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-2e88c1bc-82c1-4850-bb4e-29ce4ce46fe3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:59.000837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:59.001999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:59.002844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:59.002844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:59.002844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:59.002844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:59.002844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:59.002844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:59.002844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:59.002844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:59.002844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:59.002844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:59.002844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:14:59.002844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:14:59.002844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:14:59.002844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:59.005664 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 465/896] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:14:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:59.011823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88c1bc-82c1-4850-bb4e-29ce4ce46fe3 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:59.020525 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a40938-7429-44aa-af3c-f6ecad1eb18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:59.022321 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a40938-7429-44aa-af3c-f6ecad1eb18f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:59.022814 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a40938-7429-44aa-af3c-f6ecad1eb18f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:59.023669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a40938-7429-44aa-af3c-f6ecad1eb18f None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:59.025472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a40938-7429-44aa-af3c-f6ecad1eb18f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:59.026299 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a40938-7429-44aa-af3c-f6ecad1eb18f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:59.028055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a40938-7429-44aa-af3c-f6ecad1eb18f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:59.046227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 432/897] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:59.051704 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a40938-7429-44aa-af3c-f6ecad1eb18f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:59.119671 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88c1bc-82c1-4850-bb4e-29ce4ce46fe3 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:59.153100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a40938-7429-44aa-af3c-f6ecad1eb18f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:59.155211 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd978161-da44-4111-a1d6-ea7c18cb94ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:59.156101 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978161-da44-4111-a1d6-ea7c18cb94ac None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:59.156614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978161-da44-4111-a1d6-ea7c18cb94ac None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:59.157144 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978161-da44-4111-a1d6-ea7c18cb94ac None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:59.158065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd978161-da44-4111-a1d6-ea7c18cb94ac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:59.158576 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd978161-da44-4111-a1d6-ea7c18cb94ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:59.160194 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd978161-da44-4111-a1d6-ea7c18cb94ac None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:59.171675 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 466/898] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:14:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:59.174336 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd978161-da44-4111-a1d6-ea7c18cb94ac None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:59.192426 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9c44c-e1cc-4745-aba7-4292adf3491e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:59.193449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9c44c-e1cc-4745-aba7-4292adf3491e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:59.193603 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9c44c-e1cc-4745-aba7-4292adf3491e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:59.193817 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9c44c-e1cc-4745-aba7-4292adf3491e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:59.201245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9c44c-e1cc-4745-aba7-4292adf3491e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:59.202686 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9c44c-e1cc-4745-aba7-4292adf3491e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-0ce9c44c-e1cc-4745-aba7-4292adf3491e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:14:59.217706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:59.218775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:59.220386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:59.220386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:59.220386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:14:59.220386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:14:59.220386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:14:59.220386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:14:59.220386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:14:59.220386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:14:59.220386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:14:59.220386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:14:59.223754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 433/899] 10.222.0.61 () {56 vars in 1117 bytes} [Tue May 10 20:14:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:59.224616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9c44c-e1cc-4745-aba7-4292adf3491e None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:59.283556 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd978161-da44-4111-a1d6-ea7c18cb94ac None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:59.318230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc598cf5-5d27-4c87-8d21-6486fe214a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:59.319313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc598cf5-5d27-4c87-8d21-6486fe214a97 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:59.319840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc598cf5-5d27-4c87-8d21-6486fe214a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:59.320319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc598cf5-5d27-4c87-8d21-6486fe214a97 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:59.321259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc598cf5-5d27-4c87-8d21-6486fe214a97 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:59.321805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc598cf5-5d27-4c87-8d21-6486fe214a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:59.323447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc598cf5-5d27-4c87-8d21-6486fe214a97 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:59.323952 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9c44c-e1cc-4745-aba7-4292adf3491e None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:59.333143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 467/900] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:14:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:14:59.335447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc598cf5-5d27-4c87-8d21-6486fe214a97 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:59.358578 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3606ae0-e913-4c90-bf50-9ced6484954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:59.359178 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3606ae0-e913-4c90-bf50-9ced6484954d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:59.359642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3606ae0-e913-4c90-bf50-9ced6484954d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:59.359924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3606ae0-e913-4c90-bf50-9ced6484954d None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:59.360765 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3606ae0-e913-4c90-bf50-9ced6484954d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:59.361117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3606ae0-e913-4c90-bf50-9ced6484954d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:59.362592 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3606ae0-e913-4c90-bf50-9ced6484954d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:59.385258 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 434/901] 10.222.0.61 () {56 vars in 1149 bytes} [Tue May 10 20:14:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:59.387248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3606ae0-e913-4c90-bf50-9ced6484954d None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:59.443012 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc598cf5-5d27-4c87-8d21-6486fe214a97 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:59.479344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def42fee-f955-4008-a0a5-4bcbe36eebf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:59.480004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def42fee-f955-4008-a0a5-4bcbe36eebf9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:59.480289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def42fee-f955-4008-a0a5-4bcbe36eebf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:59.480565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def42fee-f955-4008-a0a5-4bcbe36eebf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:59.481398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def42fee-f955-4008-a0a5-4bcbe36eebf9 None admin] RBAC: Adding query filter params (interface=public, service_id=23bc2ce1304f4c5b8cdba0e968f12df5, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:14:59.481714 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def42fee-f955-4008-a0a5-4bcbe36eebf9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:59.483085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def42fee-f955-4008-a0a5-4bcbe36eebf9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:59.492180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3606ae0-e913-4c90-bf50-9ced6484954d None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:59.492766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 468/902] 10.222.0.61 () {56 vars in 1251 bytes} [Tue May 10 20:14:59 2022] GET /identity/v3/endpoints?service_id=23bc2ce1304f4c5b8cdba0e968f12df5&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:14:59.494150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def42fee-f955-4008-a0a5-4bcbe36eebf9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:59.528498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae92a4-08bd-4487-92ac-b1bea2949a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:59.529526 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae92a4-08bd-4487-92ac-b1bea2949a2b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:59.530036 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae92a4-08bd-4487-92ac-b1bea2949a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:59.530507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae92a4-08bd-4487-92ac-b1bea2949a2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:59.595488 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def42fee-f955-4008-a0a5-4bcbe36eebf9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:59.597783 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae92a4-08bd-4487-92ac-b1bea2949a2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:59.599450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae92a4-08bd-4487-92ac-b1bea2949a2b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:59.629163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af174c-70d7-4242-afcd-678aed0ac2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:59.629880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af174c-70d7-4242-afcd-678aed0ac2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:59.630366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af174c-70d7-4242-afcd-678aed0ac2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:59.630475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af174c-70d7-4242-afcd-678aed0ac2a6 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:59.631186 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af174c-70d7-4242-afcd-678aed0ac2a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:59.632625 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af174c-70d7-4242-afcd-678aed0ac2a6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:59.645158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 469/903] 10.222.0.61 () {56 vars in 1087 bytes} [Tue May 10 20:14:59 2022] GET /identity/v3/services => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:14:59.710347 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 435/904] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:14:59 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 20:14:59.716347 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af174c-70d7-4242-afcd-678aed0ac2a6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:14:59.829442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af174c-70d7-4242-afcd-678aed0ac2a6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:14:59.870168 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b322f03-4b35-49c9-919e-c21ee8b55a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:14:59.870961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b322f03-4b35-49c9-919e-c21ee8b55a31 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:14:59.871245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b322f03-4b35-49c9-919e-c21ee8b55a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:14:59.871521 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b322f03-4b35-49c9-919e-c21ee8b55a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:14:59.882007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b322f03-4b35-49c9-919e-c21ee8b55a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:14:59.883453 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b322f03-4b35-49c9-919e-c21ee8b55a31 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-5b322f03-4b35-49c9-919e-c21ee8b55a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:14:59.901233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:14:59.902170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:14:59.903087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:14:59.903087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:14:59.903087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:14:59.903087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:14:59.903087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 470/905] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:14:59.909614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae92a4-08bd-4487-92ac-b1bea2949a2b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:00.014632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae92a4-08bd-4487-92ac-b1bea2949a2b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:00.048871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99e4d4-063f-4776-a54a-59e8b11fe822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:00.049577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99e4d4-063f-4776-a54a-59e8b11fe822 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:00.049951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99e4d4-063f-4776-a54a-59e8b11fe822 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:00.050232 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99e4d4-063f-4776-a54a-59e8b11fe822 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:00.050953 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99e4d4-063f-4776-a54a-59e8b11fe822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:00.051263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99e4d4-063f-4776-a54a-59e8b11fe822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:00.052625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99e4d4-063f-4776-a54a-59e8b11fe822 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:00.065132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 436/906] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:00.070786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b322f03-4b35-49c9-919e-c21ee8b55a31 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:00.171961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b322f03-4b35-49c9-919e-c21ee8b55a31 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:00.205778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304a3b-3c24-4884-9842-f1b3d865de3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:00.206578 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304a3b-3c24-4884-9842-f1b3d865de3d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:00.206864 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304a3b-3c24-4884-9842-f1b3d865de3d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:00.207145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304a3b-3c24-4884-9842-f1b3d865de3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:00.215407 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a304a3b-3c24-4884-9842-f1b3d865de3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:00.216851 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a304a3b-3c24-4884-9842-f1b3d865de3d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-5a304a3b-3c24-4884-9842-f1b3d865de3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:15:00.231793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:00.232801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:00.233778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:15:00.233778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:15:00.233778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:15:00.233778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:15:00.233778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:15:00.233778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:15:00.233778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:15:00.233778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:00.233778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 471/907] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:15:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:00.240472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99e4d4-063f-4776-a54a-59e8b11fe822 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:00.350415 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99e4d4-063f-4776-a54a-59e8b11fe822 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:00.386084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a68de-1faa-4af2-8e20-346de465badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:00.387126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a68de-1faa-4af2-8e20-346de465badb None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:00.387639 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a68de-1faa-4af2-8e20-346de465badb None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:00.388127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a68de-1faa-4af2-8e20-346de465badb None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:00.389142 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a68de-1faa-4af2-8e20-346de465badb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:00.389653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a68de-1faa-4af2-8e20-346de465badb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:00.391283 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a68de-1faa-4af2-8e20-346de465badb None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:00.404835 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 437/908] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:15:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:00.411059 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304a3b-3c24-4884-9842-f1b3d865de3d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:00.515775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36960f8-2600-45f7-b0dc-fc4fcc1df033 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:00.516262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304a3b-3c24-4884-9842-f1b3d865de3d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:00.516598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36960f8-2600-45f7-b0dc-fc4fcc1df033 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:00.516598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36960f8-2600-45f7-b0dc-fc4fcc1df033 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:00.517958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 438/909] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:00.523350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4d558-748b-4e6a-af45-35b78bc915fe None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:00.523879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4d558-748b-4e6a-af45-35b78bc915fe None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:00.524347 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4d558-748b-4e6a-af45-35b78bc915fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:00.541930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b2a4d558-748b-4e6a-af45-35b78bc915fe None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:00.543449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b2a4d558-748b-4e6a-af45-35b78bc915fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:00.553904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b196be-4d7f-470e-a1cb-c1c9bb7aabb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:00.554568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b196be-4d7f-470e-a1cb-c1c9bb7aabb6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:00.555149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b196be-4d7f-470e-a1cb-c1c9bb7aabb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:00.555443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b196be-4d7f-470e-a1cb-c1c9bb7aabb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:00.556606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b196be-4d7f-470e-a1cb-c1c9bb7aabb6 None admin] RBAC: Adding query filter params (role.id=18652702703b4785bda52db801961cbb, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=7cb2f98e2f844526b48475c783703d17) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:00.556950 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b196be-4d7f-470e-a1cb-c1c9bb7aabb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:00.558638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b196be-4d7f-470e-a1cb-c1c9bb7aabb6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:00.565719 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 472/910] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:15:00 2022] GET /identity/v3/role_assignments?user.id=7cb2f98e2f844526b48475c783703d17&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=18652702703b4785bda52db801961cbb => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:00.623938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 439/911] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:15:00.648656 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b196be-4d7f-470e-a1cb-c1c9bb7aabb6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:00.755838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b196be-4d7f-470e-a1cb-c1c9bb7aabb6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:00.790776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d12cf-b0d3-4610-b8c7-41b533ceeb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:00.791985 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d12cf-b0d3-4610-b8c7-41b533ceeb62 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:00.792529 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d12cf-b0d3-4610-b8c7-41b533ceeb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:00.793032 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d12cf-b0d3-4610-b8c7-41b533ceeb62 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:00.793933 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d12cf-b0d3-4610-b8c7-41b533ceeb62 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:00.795516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d12cf-b0d3-4610-b8c7-41b533ceeb62 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-e05d12cf-b0d3-4610-b8c7-41b533ceeb62 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:00.807734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:00.808717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:15:00.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:00.812437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 473/912] 10.222.0.61 () {56 vars in 1132 bytes} [Tue May 10 20:15:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:00.816184 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8ad0-3984-47f1-b91c-37add8f194d5 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:00.816474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8ad0-3984-47f1-b91c-37add8f194d5 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:00.816751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8ad0-3984-47f1-b91c-37add8f194d5 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:00.818435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 440/913] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:00.819241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d12cf-b0d3-4610-b8c7-41b533ceeb62 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:00.824291 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4cc11-d096-4239-bf4e-c8bfb01fa1a5 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:00.824291 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4cc11-d096-4239-bf4e-c8bfb01fa1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:00.824503 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4cc11-d096-4239-bf4e-c8bfb01fa1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:00.842682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-29e4cc11-d096-4239-bf4e-c8bfb01fa1a5 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:00.843897 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-29e4cc11-d096-4239-bf4e-c8bfb01fa1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:00.921290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 441/914] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:15:00.940332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d12cf-b0d3-4610-b8c7-41b533ceeb62 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:00.950815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4cc11-d096-4239-bf4e-c8bfb01fa1a5 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:00.986280 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0eba70-cd40-4270-a858-ac915f461075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:00.987465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eba70-cd40-4270-a858-ac915f461075 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:00.987932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eba70-cd40-4270-a858-ac915f461075 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:00.988531 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0eba70-cd40-4270-a858-ac915f461075 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:00.989878 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0eba70-cd40-4270-a858-ac915f461075 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:00.990436 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0eba70-cd40-4270-a858-ac915f461075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:00.992468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0eba70-cd40-4270-a858-ac915f461075 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:01.007457 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 474/915] 10.222.0.61 () {56 vars in 1126 bytes} [Tue May 10 20:15:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:01.009442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0eba70-cd40-4270-a858-ac915f461075 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:01.084680 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4cc11-d096-4239-bf4e-c8bfb01fa1a5 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:01.125554 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f2673-2c49-4c42-af85-0d0412a4ce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:01.125789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0eba70-cd40-4270-a858-ac915f461075 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:01.126222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f2673-2c49-4c42-af85-0d0412a4ce08 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:01.126504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f2673-2c49-4c42-af85-0d0412a4ce08 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:01.126777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f2673-2c49-4c42-af85-0d0412a4ce08 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:01.127676 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f2673-2c49-4c42-af85-0d0412a4ce08 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:01.129866 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f2673-2c49-4c42-af85-0d0412a4ce08 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:01.147505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 442/916] 10.222.0.61 () {60 vars in 1141 bytes} [Tue May 10 20:15:00 2022] POST /identity/v3/services => generated 241 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:15:01.175273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf284e5-d7df-4ac3-9a53-8b50c99c3d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:01.176023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf284e5-d7df-4ac3-9a53-8b50c99c3d0b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:01.176314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf284e5-d7df-4ac3-9a53-8b50c99c3d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:01.176637 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf284e5-d7df-4ac3-9a53-8b50c99c3d0b None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:01.177453 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf284e5-d7df-4ac3-9a53-8b50c99c3d0b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:01.177771 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf284e5-d7df-4ac3-9a53-8b50c99c3d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:01.179409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf284e5-d7df-4ac3-9a53-8b50c99c3d0b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:01.186487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 475/917] 10.222.0.61 () {56 vars in 1126 bytes} [Tue May 10 20:15:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:01.192097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f2673-2c49-4c42-af85-0d0412a4ce08 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:01.314548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f2673-2c49-4c42-af85-0d0412a4ce08 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:01.352248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4609d7-e06b-4f4e-9e5f-33ab8217176c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:01.352997 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4609d7-e06b-4f4e-9e5f-33ab8217176c None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:01.353286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4609d7-e06b-4f4e-9e5f-33ab8217176c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:01.353560 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4609d7-e06b-4f4e-9e5f-33ab8217176c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:01.354316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4609d7-e06b-4f4e-9e5f-33ab8217176c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:01.355682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4609d7-e06b-4f4e-9e5f-33ab8217176c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:01.375727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 443/918] 10.222.0.61 () {60 vars in 1144 bytes} [Tue May 10 20:15:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:15:01.962761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaa3ad-186c-47eb-a589-536418ea355a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:01.963304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaa3ad-186c-47eb-a589-536418ea355a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:01.963304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaa3ad-186c-47eb-a589-536418ea355a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:01.964885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 476/919] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:01.975925 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2961f-5dae-4574-a2e8-e6abed6db76d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:01.976403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2961f-5dae-4574-a2e8-e6abed6db76d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:01.976490 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2961f-5dae-4574-a2e8-e6abed6db76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:01.995770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b4e2961f-5dae-4574-a2e8-e6abed6db76d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:01.997306 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b4e2961f-5dae-4574-a2e8-e6abed6db76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:02.070317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 444/920] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:15:02.092451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aaa3ad-186c-47eb-a589-536418ea355a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:02.193573 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aaa3ad-186c-47eb-a589-536418ea355a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:02.228617 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d7227-3a21-4936-892e-b8c41ec22e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:02.229786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d7227-3a21-4936-892e-b8c41ec22e22 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:02.230315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d7227-3a21-4936-892e-b8c41ec22e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:02.230808 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d7227-3a21-4936-892e-b8c41ec22e22 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:02.231674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d7227-3a21-4936-892e-b8c41ec22e22 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:02.233307 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d7227-3a21-4936-892e-b8c41ec22e22 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-4f9d7227-3a21-4936-892e-b8c41ec22e22 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:02.245505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:02.246607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:02.247538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:02.247538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:02.247538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:02.247538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:02.247538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:02.247538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:02.247538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:02.247538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:02.247538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:02.247538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:02.247538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:15:02.247538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:02.247538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:15:02.247538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:02.250479 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 477/921] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:15:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:02.258104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2961f-5dae-4574-a2e8-e6abed6db76d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:02.357072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2961f-5dae-4574-a2e8-e6abed6db76d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:02.392470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cd10e-3df9-41b1-b819-da0ecf42f9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:02.393171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cd10e-3df9-41b1-b819-da0ecf42f9ce None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:02.393450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cd10e-3df9-41b1-b819-da0ecf42f9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:02.393722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0cd10e-3df9-41b1-b819-da0ecf42f9ce None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:02.394426 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0cd10e-3df9-41b1-b819-da0ecf42f9ce None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:02.394730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0cd10e-3df9-41b1-b819-da0ecf42f9ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:02.396084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0cd10e-3df9-41b1-b819-da0ecf42f9ce None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:02.401940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 445/922] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:15:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:02.407284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d7227-3a21-4936-892e-b8c41ec22e22 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:02.511010 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d7227-3a21-4936-892e-b8c41ec22e22 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:02.547407 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875da76-d5f8-4890-82e7-fc8b7fee9dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:02.548445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875da76-d5f8-4890-82e7-fc8b7fee9dbc None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:02.548957 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875da76-d5f8-4890-82e7-fc8b7fee9dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:02.549479 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875da76-d5f8-4890-82e7-fc8b7fee9dbc None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:02.550443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875da76-d5f8-4890-82e7-fc8b7fee9dbc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:02.551011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875da76-d5f8-4890-82e7-fc8b7fee9dbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:02.552578 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875da76-d5f8-4890-82e7-fc8b7fee9dbc None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:02.558585 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 478/923] 10.222.0.61 () {56 vars in 1114 bytes} [Tue May 10 20:15:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:02.566729 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cd10e-3df9-41b1-b819-da0ecf42f9ce None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:02.664220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0cd10e-3df9-41b1-b819-da0ecf42f9ce None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:02.699846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1545b0-a5ac-44d1-b3e3-3d18e5cb2927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:02.700876 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1545b0-a5ac-44d1-b3e3-3d18e5cb2927 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:02.701421 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1545b0-a5ac-44d1-b3e3-3d18e5cb2927 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:02.701912 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1545b0-a5ac-44d1-b3e3-3d18e5cb2927 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:02.702857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1545b0-a5ac-44d1-b3e3-3d18e5cb2927 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:02.704419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1545b0-a5ac-44d1-b3e3-3d18e5cb2927 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:02.725191 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 446/924] 10.222.0.61 () {60 vars in 1144 bytes} [Tue May 10 20:15:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:15:02.961857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8aa1-0dc9-4d54-9470-8435202d1879 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:02.962193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8aa1-0dc9-4d54-9470-8435202d1879 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:02.962535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8aa1-0dc9-4d54-9470-8435202d1879 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:02.964027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 479/925] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:02.971829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39984a5-a671-4101-ad41-13d16ad6a1fc None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:02.971829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39984a5-a671-4101-ad41-13d16ad6a1fc None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:02.971829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39984a5-a671-4101-ad41-13d16ad6a1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:02.993050 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e39984a5-a671-4101-ad41-13d16ad6a1fc None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:02.995556 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e39984a5-a671-4101-ad41-13d16ad6a1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:03.073782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 447/926] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:03.095719 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8aa1-0dc9-4d54-9470-8435202d1879 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:03.199444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8aa1-0dc9-4d54-9470-8435202d1879 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:03.236379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ae003-a1b9-4cb5-a87c-4986a46fd847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:03.237447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae003-a1b9-4cb5-a87c-4986a46fd847 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:03.237945 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae003-a1b9-4cb5-a87c-4986a46fd847 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:03.238440 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae003-a1b9-4cb5-a87c-4986a46fd847 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:03.259148 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ae003-a1b9-4cb5-a87c-4986a46fd847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-920ae003-a1b9-4cb5-a87c-4986a46fd847 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:15:03.267804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:03.268859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:03.269759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:03.269759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:03.269759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:03.269759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:03.269759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:15:03.269759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:15:03.269759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:15:03.269759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:15:03.269759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:15:03.269759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:15:03.269759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:15:03.269759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:03.269759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 480/927] 10.222.0.61 () {56 vars in 1120 bytes} [Tue May 10 20:15:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:03.277911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39984a5-a671-4101-ad41-13d16ad6a1fc None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:03.377585 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39984a5-a671-4101-ad41-13d16ad6a1fc None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:03.412297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600bffe-1cf5-4dab-ac83-0c1acf0ae895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:03.413338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600bffe-1cf5-4dab-ac83-0c1acf0ae895 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:03.413844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600bffe-1cf5-4dab-ac83-0c1acf0ae895 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:03.414334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600bffe-1cf5-4dab-ac83-0c1acf0ae895 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:03.415819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600bffe-1cf5-4dab-ac83-0c1acf0ae895 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:03.416347 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600bffe-1cf5-4dab-ac83-0c1acf0ae895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:03.417943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600bffe-1cf5-4dab-ac83-0c1acf0ae895 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:03.427655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 448/928] 10.222.0.61 () {56 vars in 1115 bytes} [Tue May 10 20:15:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:03.433617 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b67e9-dee6-4681-be0e-99aa879c86fb None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:03.433904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b67e9-dee6-4681-be0e-99aa879c86fb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:03.434184 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b67e9-dee6-4681-be0e-99aa879c86fb None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:03.434376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600bffe-1cf5-4dab-ac83-0c1acf0ae895 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:03.435755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 481/929] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:03.440838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66503198-2b02-48af-a2f0-90e3db5564fb None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:03.441163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66503198-2b02-48af-a2f0-90e3db5564fb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:03.441439 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66503198-2b02-48af-a2f0-90e3db5564fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:03.458127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-66503198-2b02-48af-a2f0-90e3db5564fb None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:03.459377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-66503198-2b02-48af-a2f0-90e3db5564fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:03.539482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600bffe-1cf5-4dab-ac83-0c1acf0ae895 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:03.553018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 482/930] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:15:03.568718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66503198-2b02-48af-a2f0-90e3db5564fb None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:03.586194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfedb0-e83a-4ed4-9ba1-fb9e93a1268b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:03.587541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfedb0-e83a-4ed4-9ba1-fb9e93a1268b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:03.587831 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfedb0-e83a-4ed4-9ba1-fb9e93a1268b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:03.588106 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfedb0-e83a-4ed4-9ba1-fb9e93a1268b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:03.599901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfedb0-e83a-4ed4-9ba1-fb9e93a1268b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:03.601329 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dfedb0-e83a-4ed4-9ba1-fb9e93a1268b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-38dfedb0-e83a-4ed4-9ba1-fb9e93a1268b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:15:03.619031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:03.620018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:03.620898 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:15:03.620898 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:15:03.620898 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:03.620898 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:03.620898 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 449/931] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:03.628664 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfedb0-e83a-4ed4-9ba1-fb9e93a1268b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:03.675234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66503198-2b02-48af-a2f0-90e3db5564fb None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:03.708827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252530c-9a7f-4b4c-8eb0-a7a20a5a6721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:03.710037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252530c-9a7f-4b4c-8eb0-a7a20a5a6721 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:03.710515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252530c-9a7f-4b4c-8eb0-a7a20a5a6721 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:03.710991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252530c-9a7f-4b4c-8eb0-a7a20a5a6721 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:03.711839 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252530c-9a7f-4b4c-8eb0-a7a20a5a6721 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:03.713512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252530c-9a7f-4b4c-8eb0-a7a20a5a6721 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-2252530c-9a7f-4b4c-8eb0-a7a20a5a6721 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:03.725965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:03.726952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:03.727850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:03.727850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:03.727850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:03.727850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:03.727850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:03.727850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:03.727850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:03.727850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:03.727850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:03.727850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:03.727850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:15:03.727850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:03.727850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:15:03.727850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:03.735282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dfedb0-e83a-4ed4-9ba1-fb9e93a1268b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:03.735571 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 483/932] 10.222.0.61 () {56 vars in 1126 bytes} [Tue May 10 20:15:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:03.736576 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252530c-9a7f-4b4c-8eb0-a7a20a5a6721 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:03.770097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc83575-ff94-4c86-b4a2-f5f49b60016c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:03.770760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc83575-ff94-4c86-b4a2-f5f49b60016c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:03.771039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc83575-ff94-4c86-b4a2-f5f49b60016c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:03.771314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc83575-ff94-4c86-b4a2-f5f49b60016c None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:03.772288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc83575-ff94-4c86-b4a2-f5f49b60016c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:03.772592 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc83575-ff94-4c86-b4a2-f5f49b60016c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:03.773987 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc83575-ff94-4c86-b4a2-f5f49b60016c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:03.785844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 450/933] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:03.787056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e7642-1df3-4bfc-8f07-94b96f5639e1 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:03.787336 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e7642-1df3-4bfc-8f07-94b96f5639e1 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:03.787608 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e7642-1df3-4bfc-8f07-94b96f5639e1 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:03.788963 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 451/934] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:03.793591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e7642-1df3-4bfc-8f07-94b96f5639e1 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:03.848536 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252530c-9a7f-4b4c-8eb0-a7a20a5a6721 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:03.882386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c7912-e255-4d66-8995-0746a9ff935c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:03.883049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7912-e255-4d66-8995-0746a9ff935c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:03.883333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7912-e255-4d66-8995-0746a9ff935c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:03.883666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7912-e255-4d66-8995-0746a9ff935c None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:03.884962 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c7912-e255-4d66-8995-0746a9ff935c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:03.885302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c7912-e255-4d66-8995-0746a9ff935c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:03.886721 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c7912-e255-4d66-8995-0746a9ff935c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:03.890818 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e7642-1df3-4bfc-8f07-94b96f5639e1 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:03.896429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 484/935] 10.222.0.61 () {56 vars in 1122 bytes} [Tue May 10 20:15:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:03.896429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c4b7-7026-4973-8401-807ef255ae80 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:03.896429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c4b7-7026-4973-8401-807ef255ae80 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:03.896429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c4b7-7026-4973-8401-807ef255ae80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:03.910884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e034c4b7-7026-4973-8401-807ef255ae80 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:03.912288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e034c4b7-7026-4973-8401-807ef255ae80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:03.932568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85048b39-f54a-4b58-ab26-af58ea3a6b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:03.933419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85048b39-f54a-4b58-ab26-af58ea3a6b75 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:03.933709 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85048b39-f54a-4b58-ab26-af58ea3a6b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:03.933991 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85048b39-f54a-4b58-ab26-af58ea3a6b75 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:03.940991 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85048b39-f54a-4b58-ab26-af58ea3a6b75 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:03.942451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85048b39-f54a-4b58-ab26-af58ea3a6b75 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-85048b39-f54a-4b58-ab26-af58ea3a6b75 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:15:03.957860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:03.958914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:03.959893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:03.959893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:03.959893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:15:03.959893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:15:03.959893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:15:03.959893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:15:03.959893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:15:03.959893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:15:03.959893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:15:03.959893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:03.964871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 452/936] 10.222.0.61 () {56 vars in 1117 bytes} [Tue May 10 20:15:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:03.965663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85048b39-f54a-4b58-ab26-af58ea3a6b75 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:03.989134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 485/937] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:03.989134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034c4b7-7026-4973-8401-807ef255ae80 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:04.075731 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85048b39-f54a-4b58-ab26-af58ea3a6b75 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:04.088309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034c4b7-7026-4973-8401-807ef255ae80 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:04.108291 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ff043-8dc3-4e62-ade6-e909c988dca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:04.109188 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ff043-8dc3-4e62-ade6-e909c988dca4 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:04.109472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ff043-8dc3-4e62-ade6-e909c988dca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:04.109751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ff043-8dc3-4e62-ade6-e909c988dca4 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:04.110457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ff043-8dc3-4e62-ade6-e909c988dca4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:04.110763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ff043-8dc3-4e62-ade6-e909c988dca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:04.112120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ff043-8dc3-4e62-ade6-e909c988dca4 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:04.116714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 453/938] 10.222.0.61 () {56 vars in 1122 bytes} [Tue May 10 20:15:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:04.117513 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ff043-8dc3-4e62-ade6-e909c988dca4 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:04.125859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba7050-9187-4e41-8f3c-06e8f9dd86a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:04.126534 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba7050-9187-4e41-8f3c-06e8f9dd86a0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:04.126822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba7050-9187-4e41-8f3c-06e8f9dd86a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:04.127103 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba7050-9187-4e41-8f3c-06e8f9dd86a0 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:04.127942 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba7050-9187-4e41-8f3c-06e8f9dd86a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:04.128259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba7050-9187-4e41-8f3c-06e8f9dd86a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:04.129723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba7050-9187-4e41-8f3c-06e8f9dd86a0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:04.146724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 486/939] 10.222.0.61 () {56 vars in 1149 bytes} [Tue May 10 20:15:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:04.147601 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba7050-9187-4e41-8f3c-06e8f9dd86a0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:04.219151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ff043-8dc3-4e62-ade6-e909c988dca4 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:04.252643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc067-2a74-43c0-ad56-58dd6a87391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:04.253405 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba7050-9187-4e41-8f3c-06e8f9dd86a0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:04.253920 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc067-2a74-43c0-ad56-58dd6a87391e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:04.254412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc067-2a74-43c0-ad56-58dd6a87391e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:04.254870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcc067-2a74-43c0-ad56-58dd6a87391e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:04.255718 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc067-2a74-43c0-ad56-58dd6a87391e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:04.257180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcc067-2a74-43c0-ad56-58dd6a87391e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-d5dcc067-2a74-43c0-ad56-58dd6a87391e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:04.269402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:04.270390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:04.271256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 454/940] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:15:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:04.272331 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc067-2a74-43c0-ad56-58dd6a87391e None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:04.292386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49491ec6-6842-405a-b08a-a6b49a4baabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:04.293075 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49491ec6-6842-405a-b08a-a6b49a4baabb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:04.293361 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49491ec6-6842-405a-b08a-a6b49a4baabb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:04.293640 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49491ec6-6842-405a-b08a-a6b49a4baabb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:04.294426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49491ec6-6842-405a-b08a-a6b49a4baabb None admin] RBAC: Adding query filter params (interface=public, service_id=9d7c0fead7974d2391efbb8b17bc4199, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:04.294743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49491ec6-6842-405a-b08a-a6b49a4baabb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:04.296108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49491ec6-6842-405a-b08a-a6b49a4baabb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:04.305508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 487/941] 10.222.0.61 () {56 vars in 1251 bytes} [Tue May 10 20:15:04 2022] GET /identity/v3/endpoints?service_id=9d7c0fead7974d2391efbb8b17bc4199&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:04.305508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49491ec6-6842-405a-b08a-a6b49a4baabb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:04.375030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcc067-2a74-43c0-ad56-58dd6a87391e None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:04.401861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49491ec6-6842-405a-b08a-a6b49a4baabb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:04.407522 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ddb05-0dad-4caf-804d-84dc365c78ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:04.408308 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ddb05-0dad-4caf-804d-84dc365c78ac None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:04.408593 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ddb05-0dad-4caf-804d-84dc365c78ac None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:04.408863 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ddb05-0dad-4caf-804d-84dc365c78ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:04.420008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ddb05-0dad-4caf-804d-84dc365c78ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:04.421579 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ddb05-0dad-4caf-804d-84dc365c78ac None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:04.436073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a84caf-ec23-4763-bdfb-38ff4cb1ea06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:04.436729 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a84caf-ec23-4763-bdfb-38ff4cb1ea06 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:04.437037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a84caf-ec23-4763-bdfb-38ff4cb1ea06 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:04.437313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a84caf-ec23-4763-bdfb-38ff4cb1ea06 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:04.438008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a84caf-ec23-4763-bdfb-38ff4cb1ea06 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:04.438312 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a84caf-ec23-4763-bdfb-38ff4cb1ea06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-505ddb05-0dad-4caf-804d-84dc365c78ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:15:04.438722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:04.439590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:04.445472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:15:04.445472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:15:04.445472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:04.445472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:04.445731 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a84caf-ec23-4763-bdfb-38ff4cb1ea06 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:04.445806 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 455/942] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:04.445806 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ddb05-0dad-4caf-804d-84dc365c78ac None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:04.454702 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 488/943] 10.222.0.61 () {56 vars in 1112 bytes} [Tue May 10 20:15:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:04.454702 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a84caf-ec23-4763-bdfb-38ff4cb1ea06 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:04.535511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ddb05-0dad-4caf-804d-84dc365c78ac None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:04.550415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a84caf-ec23-4763-bdfb-38ff4cb1ea06 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:04.568280 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d5352-9674-4720-93a8-0ad7fa871d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:04.568947 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d5352-9674-4720-93a8-0ad7fa871d41 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:04.569255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d5352-9674-4720-93a8-0ad7fa871d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:04.569530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d5352-9674-4720-93a8-0ad7fa871d41 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:04.570209 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d5352-9674-4720-93a8-0ad7fa871d41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:04.571590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d5352-9674-4720-93a8-0ad7fa871d41 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:04.577532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 456/944] 10.222.0.61 () {56 vars in 1087 bytes} [Tue May 10 20:15:04 2022] GET /identity/v3/services => generated 1497 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:15:04.578638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d5352-9674-4720-93a8-0ad7fa871d41 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:04.592944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5814d-f343-4709-99ac-7ffda5e750bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:04.593985 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5814d-f343-4709-99ac-7ffda5e750bf None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:04.594279 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5814d-f343-4709-99ac-7ffda5e750bf None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:04.594560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5814d-f343-4709-99ac-7ffda5e750bf None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:04.595324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5814d-f343-4709-99ac-7ffda5e750bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:04.595640 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5814d-f343-4709-99ac-7ffda5e750bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:04.597344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5814d-f343-4709-99ac-7ffda5e750bf None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:04.620797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 489/945] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:04.623147 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5814d-f343-4709-99ac-7ffda5e750bf None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:04.696228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d5352-9674-4720-93a8-0ad7fa871d41 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:04.732472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e4b1-a976-4d6b-9c51-b48e73278308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:04.733186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e4b1-a976-4d6b-9c51-b48e73278308 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:04.733472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e4b1-a976-4d6b-9c51-b48e73278308 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:04.733749 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85e4b1-a976-4d6b-9c51-b48e73278308 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:04.734478 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e4b1-a976-4d6b-9c51-b48e73278308 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:04.734786 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e4b1-a976-4d6b-9c51-b48e73278308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:04.736168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85e4b1-a976-4d6b-9c51-b48e73278308 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:04.741649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 457/946] 10.222.0.61 () {56 vars in 1112 bytes} [Tue May 10 20:15:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:04.747365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5814d-f343-4709-99ac-7ffda5e750bf None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:04.788079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e94fd7-4a0e-4793-a401-1bf391c3d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:04.788894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94fd7-4a0e-4793-a401-1bf391c3d81e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:04.789207 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94fd7-4a0e-4793-a401-1bf391c3d81e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:04.789483 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e94fd7-4a0e-4793-a401-1bf391c3d81e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:04.798415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e94fd7-4a0e-4793-a401-1bf391c3d81e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:04.799904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e94fd7-4a0e-4793-a401-1bf391c3d81e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-36e94fd7-4a0e-4793-a401-1bf391c3d81e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:15:04.815115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:04.816083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:04.817039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:15:04.817039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:15:04.817039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:15:04.817039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:15:04.817039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:15:04.817039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:15:04.817039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:15:04.817039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:04.817039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 490/947] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:04.825075 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e4b1-a976-4d6b-9c51-b48e73278308 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:04.939149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85e4b1-a976-4d6b-9c51-b48e73278308 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:04.984036 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652615e-4b35-45ca-8f08-4626cfb8315c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:04.984871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652615e-4b35-45ca-8f08-4626cfb8315c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:04.985318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652615e-4b35-45ca-8f08-4626cfb8315c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:04.985723 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652615e-4b35-45ca-8f08-4626cfb8315c None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:04.986651 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652615e-4b35-45ca-8f08-4626cfb8315c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:04.987095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652615e-4b35-45ca-8f08-4626cfb8315c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:04.988647 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652615e-4b35-45ca-8f08-4626cfb8315c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:05.001598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 458/948] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:05.013024 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e94fd7-4a0e-4793-a401-1bf391c3d81e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:05.019052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad7e00-4922-45de-93a7-9b8749c1e49f None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:05.019396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad7e00-4922-45de-93a7-9b8749c1e49f None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:05.019671 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad7e00-4922-45de-93a7-9b8749c1e49f None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:05.023234 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 459/949] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:15:05.028469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f467e6-a086-4f3e-bb4e-b906bd81ba33 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:05.028757 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f467e6-a086-4f3e-bb4e-b906bd81ba33 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:05.029057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f467e6-a086-4f3e-bb4e-b906bd81ba33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:05.045655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b5f467e6-a086-4f3e-bb4e-b906bd81ba33 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:05.046912 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b5f467e6-a086-4f3e-bb4e-b906bd81ba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:05.112614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 460/950] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:05.117146 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e94fd7-4a0e-4793-a401-1bf391c3d81e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:05.137310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f467e6-a086-4f3e-bb4e-b906bd81ba33 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:05.147199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70895a77-72bf-4c49-a17b-52697ea52cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:05.148086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70895a77-72bf-4c49-a17b-52697ea52cb2 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:05.148363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70895a77-72bf-4c49-a17b-52697ea52cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:05.148633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70895a77-72bf-4c49-a17b-52697ea52cb2 None admin] PATH_INFO: `/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/7cb2f98e2f844526b48475c783703d17/roles/18652702703b4785bda52db801961cbb` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:05.151459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70895a77-72bf-4c49-a17b-52697ea52cb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b37547e1bf4906b65ac39aad3a608c, user_id=7cb2f98e2f844526b48475c783703d17, role_id=18652702703b4785bda52db801961cbb)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:05.152897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70895a77-72bf-4c49-a17b-52697ea52cb2 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:05.169823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 491/951] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:15:05 2022] PUT /identity/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/7cb2f98e2f844526b48475c783703d17/roles/18652702703b4785bda52db801961cbb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:15:05.264680 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f467e6-a086-4f3e-bb4e-b906bd81ba33 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:05.308587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76fdf2-15d0-49f9-a997-3fc8f55d5c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:05.309312 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76fdf2-15d0-49f9-a997-3fc8f55d5c29 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:05.309597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76fdf2-15d0-49f9-a997-3fc8f55d5c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:05.309876 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b76fdf2-15d0-49f9-a997-3fc8f55d5c29 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:05.310599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76fdf2-15d0-49f9-a997-3fc8f55d5c29 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:05.312173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b76fdf2-15d0-49f9-a997-3fc8f55d5c29 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:05.313601 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: WARNING keystone.server.flask.common [None req-9b76fdf2-15d0-49f9-a997-3fc8f55d5c29 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 20:15:05.335881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.sql.core [None req-9b76fdf2-15d0-49f9-a997-3fc8f55d5c29 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 20:15:05.335881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 20:15:05.335881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [parameters: {'id': 'a26475903ee5467e93c5f3fcecadeb05', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 20:15:05.335881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80020) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 20:15:05.345160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-9b76fdf2-15d0-49f9-a997-3fc8f55d5c29 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a26475903ee5467e93c5f3fcecadeb05.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a26475903ee5467e93c5f3fcecadeb05. May 10 20:15:05.345160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:05.345160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 20:15:05.345160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 20:15:05.345160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 20:15:05.345160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 20:15:05.345160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 20:15:05.345160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application result = self._query(query) May 10 20:15:05.345160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 20:15:05.345160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application conn.query(q) May 10 20:15:05.345160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 20:15:05.345160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 20:15:05.345160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application result.read() May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 10 20:15:05.346051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return project_ref.to_dict() May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application next(self.gen) May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application yield resource May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application next(self.gen) May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self.session.rollback() May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self.force_reraise() May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise self.value May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application session.commit() May 10 20:15:05.347023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._prepare_impl() May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self.session.flush() May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._flush(objects) May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application compat.raise_( May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application flush_context.execute() May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 20:15:05.347924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rec.execute(self) May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 20:15:05.348867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application result = self._query(query) May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application conn.query(q) May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application result.read() May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 20:15:05.351437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [parameters: {'id': 'a26475903ee5467e93c5f3fcecadeb05', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:05.353622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:05.355473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:05.361598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:05.361598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 10 20:15:05.361598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 10 20:15:05.361598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:05.361598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:05.361598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 10 20:15:05.361598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.Conflict( May 10 20:15:05.361598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a26475903ee5467e93c5f3fcecadeb05. May 10 20:15:05.361598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:05.361598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 461/952] 10.222.0.61 () {60 vars in 1140 bytes} [Tue May 10 20:15:05 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:05.366257 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70895a77-72bf-4c49-a17b-52697ea52cb2 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:05.475300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70895a77-72bf-4c49-a17b-52697ea52cb2 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:05.507905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd90691-9e16-49ba-994a-05e75a0c4e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:05.508709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd90691-9e16-49ba-994a-05e75a0c4e7f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:05.509547 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd90691-9e16-49ba-994a-05e75a0c4e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:05.509824 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd90691-9e16-49ba-994a-05e75a0c4e7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:05.516960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd90691-9e16-49ba-994a-05e75a0c4e7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:05.518437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd90691-9e16-49ba-994a-05e75a0c4e7f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-fbd90691-9e16-49ba-994a-05e75a0c4e7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:15:05.533736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:05.534682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:05.535639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:15:05.535639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:15:05.535639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:15:05.535639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:15:05.535639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:15:05.535639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:15:05.535639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:15:05.535639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:05.535639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 492/953] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:15:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:05.542274 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76fdf2-15d0-49f9-a997-3fc8f55d5c29 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:05.642498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b76fdf2-15d0-49f9-a997-3fc8f55d5c29 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:05.675766 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5fc8a-8bd5-4216-bd6f-19c7dd0890b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:05.676430 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5fc8a-8bd5-4216-bd6f-19c7dd0890b7 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:05.676717 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5fc8a-8bd5-4216-bd6f-19c7dd0890b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:05.677011 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5fc8a-8bd5-4216-bd6f-19c7dd0890b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:05.677770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5fc8a-8bd5-4216-bd6f-19c7dd0890b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:05.678083 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5fc8a-8bd5-4216-bd6f-19c7dd0890b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:05.679715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5fc8a-8bd5-4216-bd6f-19c7dd0890b7 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:05.700963 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 462/954] 10.222.0.61 () {56 vars in 1112 bytes} [Tue May 10 20:15:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:06.918411 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b59cf5-908d-48ca-a7c3-e95cc0e9732c None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:06.919091 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b59cf5-908d-48ca-a7c3-e95cc0e9732c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:06.919091 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b59cf5-908d-48ca-a7c3-e95cc0e9732c None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:06.920594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 493/955] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:06.926311 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d0b2d-0a67-42dd-adc2-3abbcd62b657 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:06.926858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d0b2d-0a67-42dd-adc2-3abbcd62b657 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:06.926858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d0b2d-0a67-42dd-adc2-3abbcd62b657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:06.944527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-5e1d0b2d-0a67-42dd-adc2-3abbcd62b657 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:06.946060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5e1d0b2d-0a67-42dd-adc2-3abbcd62b657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:07.015790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 463/956] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:07.039303 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b59cf5-908d-48ca-a7c3-e95cc0e9732c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:07.094231 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c4a8f-384a-4982-84c5-cd73581d0858 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:07.094231 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c4a8f-384a-4982-84c5-cd73581d0858 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:07.094231 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c4a8f-384a-4982-84c5-cd73581d0858 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:07.095095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 464/957] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:15:07.100151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965815b1-160e-478c-a611-41ba49092049 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:07.100649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965815b1-160e-478c-a611-41ba49092049 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:07.101175 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965815b1-160e-478c-a611-41ba49092049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:07.118120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-965815b1-160e-478c-a611-41ba49092049 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:07.119608 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-965815b1-160e-478c-a611-41ba49092049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:07.147813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b59cf5-908d-48ca-a7c3-e95cc0e9732c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:07.187715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 465/958] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:07.203467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92a039-1518-469d-b312-c841b55fd61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:07.204518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92a039-1518-469d-b312-c841b55fd61e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:07.204999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92a039-1518-469d-b312-c841b55fd61e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:07.205462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92a039-1518-469d-b312-c841b55fd61e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:07.206374 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92a039-1518-469d-b312-c841b55fd61e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:07.207909 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92a039-1518-469d-b312-c841b55fd61e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:07.211515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965815b1-160e-478c-a611-41ba49092049 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-8d92a039-1518-469d-b312-c841b55fd61e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:07.224316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:07.225749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:07.226584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:07.226584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:07.226584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:07.226584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:07.226584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:07.226584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:07.226584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:07.226584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:07.226584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:07.226584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:07.226584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:15:07.226584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:07.226584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:15:07.226584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:07.235562 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 494/959] 10.222.0.61 () {56 vars in 1126 bytes} [Tue May 10 20:15:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:07.236279 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92a039-1518-469d-b312-c841b55fd61e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:07.322507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965815b1-160e-478c-a611-41ba49092049 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:07.336230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92a039-1518-469d-b312-c841b55fd61e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:07.358983 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a48f8-3af9-4ce2-a8d4-d372a991dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:07.359595 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a48f8-3af9-4ce2-a8d4-d372a991dc0a None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:07.359879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a48f8-3af9-4ce2-a8d4-d372a991dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:07.360155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a48f8-3af9-4ce2-a8d4-d372a991dc0a None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:07.360900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a48f8-3af9-4ce2-a8d4-d372a991dc0a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:07.362516 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a48f8-3af9-4ce2-a8d4-d372a991dc0a None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:07.378038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e05aed-e826-4b12-adfd-a8904e4ec708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:07.379155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e05aed-e826-4b12-adfd-a8904e4ec708 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:07.379635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e05aed-e826-4b12-adfd-a8904e4ec708 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:07.380115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e05aed-e826-4b12-adfd-a8904e4ec708 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:07.389001 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 466/960] 10.222.0.61 () {60 vars in 1141 bytes} [Tue May 10 20:15:07 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:15:07.389605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e05aed-e826-4b12-adfd-a8904e4ec708 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:07.389973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e05aed-e826-4b12-adfd-a8904e4ec708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:07.391548 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e05aed-e826-4b12-adfd-a8904e4ec708 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:07.397675 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 495/961] 10.222.0.61 () {56 vars in 1122 bytes} [Tue May 10 20:15:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:07.403738 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a48f8-3af9-4ce2-a8d4-d372a991dc0a None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:07.524483 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a48f8-3af9-4ce2-a8d4-d372a991dc0a None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:07.538988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93cdd4-a96d-4c84-b19c-7d3fb3db000b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:07.539308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93cdd4-a96d-4c84-b19c-7d3fb3db000b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:07.539557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93cdd4-a96d-4c84-b19c-7d3fb3db000b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:07.545124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 496/962] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:07.547671 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664eb62-ac11-4400-87da-f84e8d9d0583 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:07.547965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664eb62-ac11-4400-87da-f84e8d9d0583 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:07.548246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664eb62-ac11-4400-87da-f84e8d9d0583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:07.561702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ea430-83d4-403d-b7dd-1816951136fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:07.562383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ea430-83d4-403d-b7dd-1816951136fc None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:07.562670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ea430-83d4-403d-b7dd-1816951136fc None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:07.563484 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ea430-83d4-403d-b7dd-1816951136fc None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:07.563670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ea430-83d4-403d-b7dd-1816951136fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:07.563975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ea430-83d4-403d-b7dd-1816951136fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:07.565411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ea430-83d4-403d-b7dd-1816951136fc None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:07.569652 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c664eb62-ac11-4400-87da-f84e8d9d0583 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:07.570893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c664eb62-ac11-4400-87da-f84e8d9d0583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:07.571345 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 467/963] 10.222.0.61 () {56 vars in 1122 bytes} [Tue May 10 20:15:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:07.582027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ea430-83d4-403d-b7dd-1816951136fc None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:07.652874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 497/964] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:15:07.676861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664eb62-ac11-4400-87da-f84e8d9d0583 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:07.701945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ea430-83d4-403d-b7dd-1816951136fc None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:07.745730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b2df9-073e-4c8d-8ee8-0f0f8dddf560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:07.746954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b2df9-073e-4c8d-8ee8-0f0f8dddf560 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:07.748165 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b2df9-073e-4c8d-8ee8-0f0f8dddf560 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:07.748640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b2df9-073e-4c8d-8ee8-0f0f8dddf560 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:07.749594 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b2df9-073e-4c8d-8ee8-0f0f8dddf560 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:07.751127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b2df9-073e-4c8d-8ee8-0f0f8dddf560 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:07.777594 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 468/965] 10.222.0.61 () {60 vars in 1144 bytes} [Tue May 10 20:15:07 2022] POST /identity/v3/endpoints => generated 349 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:15:07.783827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664eb62-ac11-4400-87da-f84e8d9d0583 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:07.826630 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e84a55-2420-4f0a-9bf3-eb1a28b6129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:07.827480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e84a55-2420-4f0a-9bf3-eb1a28b6129f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:07.827761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e84a55-2420-4f0a-9bf3-eb1a28b6129f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:07.828035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e84a55-2420-4f0a-9bf3-eb1a28b6129f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:07.841415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e84a55-2420-4f0a-9bf3-eb1a28b6129f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-75e84a55-2420-4f0a-9bf3-eb1a28b6129f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:15:07.850109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:07.851124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:07.851968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:07.851968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:07.851968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:07.851968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:07.851968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:15:07.851968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:15:07.851968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:15:07.851968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:15:07.851968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:15:07.851968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:15:07.851968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:15:07.851968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:07.851968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 498/966] 10.222.0.61 () {56 vars in 1120 bytes} [Tue May 10 20:15:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:07.859338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b2df9-073e-4c8d-8ee8-0f0f8dddf560 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:07.966202 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b2df9-073e-4c8d-8ee8-0f0f8dddf560 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:08.019174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dc556-90c5-4f77-90ea-a631393fd361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:08.019903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dc556-90c5-4f77-90ea-a631393fd361 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:08.020190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dc556-90c5-4f77-90ea-a631393fd361 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:08.020465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dc556-90c5-4f77-90ea-a631393fd361 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:08.021246 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dc556-90c5-4f77-90ea-a631393fd361 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:08.021867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dc556-90c5-4f77-90ea-a631393fd361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:08.023244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dc556-90c5-4f77-90ea-a631393fd361 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:08.029749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ea2c-eb40-4423-a27c-aac956553e89 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:08.030218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ea2c-eb40-4423-a27c-aac956553e89 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:08.030769 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ea2c-eb40-4423-a27c-aac956553e89 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:08.032388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 499/967] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:08.033634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 469/968] 10.222.0.61 () {56 vars in 1115 bytes} [Tue May 10 20:15:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:08.037642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded4f80-6f13-4116-8f23-001a4cc1092b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:08.037938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded4f80-6f13-4116-8f23-001a4cc1092b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:08.038219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded4f80-6f13-4116-8f23-001a4cc1092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:08.041437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dc556-90c5-4f77-90ea-a631393fd361 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:08.056216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5ded4f80-6f13-4116-8f23-001a4cc1092b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:08.057439 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5ded4f80-6f13-4116-8f23-001a4cc1092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:08.145160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dc556-90c5-4f77-90ea-a631393fd361 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:08.150334 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 500/969] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:08.174209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded4f80-6f13-4116-8f23-001a4cc1092b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:08.184031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2e256-c125-4e6b-a8ad-66ada78a7a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:08.184839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2e256-c125-4e6b-a8ad-66ada78a7a5a None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:08.185264 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2e256-c125-4e6b-a8ad-66ada78a7a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:08.185548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2e256-c125-4e6b-a8ad-66ada78a7a5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:08.197183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2e256-c125-4e6b-a8ad-66ada78a7a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:08.198643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2e256-c125-4e6b-a8ad-66ada78a7a5a None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-05c2e256-c125-4e6b-a8ad-66ada78a7a5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:15:08.216173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:08.217164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:08.222708 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:15:08.222708 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:15:08.222708 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:08.222708 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:08.222708 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 470/970] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:08.224441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2e256-c125-4e6b-a8ad-66ada78a7a5a None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:08.299774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded4f80-6f13-4116-8f23-001a4cc1092b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:08.335528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce6207-6a5c-42ba-9828-f5f9f200fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:08.336210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce6207-6a5c-42ba-9828-f5f9f200fa0b None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:08.336495 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce6207-6a5c-42ba-9828-f5f9f200fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:08.336822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce6207-6a5c-42ba-9828-f5f9f200fa0b None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:08.338071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce6207-6a5c-42ba-9828-f5f9f200fa0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:08.339570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce6207-6a5c-42ba-9828-f5f9f200fa0b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:08.340807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: WARNING keystone.server.flask.common [None req-86ce6207-6a5c-42ba-9828-f5f9f200fa0b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 20:15:08.342222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2e256-c125-4e6b-a8ad-66ada78a7a5a None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:08.353903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.sql.core [None req-86ce6207-6a5c-42ba-9828-f5f9f200fa0b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 20:15:08.353903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 20:15:08.353903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [parameters: {'user_id': '1b3ed9b5997a4321b97e336e420d288a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 20:15:08.353903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80021) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-86ce6207-6a5c-42ba-9828-f5f9f200fa0b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result = self._query(query) May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application conn.query(q) May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result.read() May 10 20:15:08.372018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 20:15:08.372964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application next(self.gen) May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application yield resource May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application next(self.gen) May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.session.rollback() May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.force_reraise() May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise self.value May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application session.commit() May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 20:15:08.374832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._prepare_impl() May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.session.flush() May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._flush(objects) May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application compat.raise_( May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application flush_context.execute() May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rec.execute(self) May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 20:15:08.375759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result = connection._execute_20( May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 20:15:08.376631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result = self._query(query) May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application conn.query(q) May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application result.read() May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 20:15:08.377525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [parameters: {'user_id': '1b3ed9b5997a4321b97e336e420d288a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:08.379188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 10 20:15:08.380641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 10 20:15:08.381936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 10 20:15:08.381936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 10 20:15:08.381936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 20:15:08.381936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 20:15:08.381936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 20:15:08.381936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:08.381936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 501/971] 10.222.0.61 () {60 vars in 1131 bytes} [Tue May 10 20:15:08 2022] POST /identity/v3/users => generated 160 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:08.382456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce6207-6a5c-42ba-9828-f5f9f200fa0b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:08.400408 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e11dc-7503-465b-ab39-42f28b96749b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:08.401567 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e11dc-7503-465b-ab39-42f28b96749b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:08.401949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e11dc-7503-465b-ab39-42f28b96749b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:08.402324 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e11dc-7503-465b-ab39-42f28b96749b None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:08.403163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e11dc-7503-465b-ab39-42f28b96749b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:08.403751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e11dc-7503-465b-ab39-42f28b96749b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:08.405953 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e11dc-7503-465b-ab39-42f28b96749b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:08.426758 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 471/972] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:08.428770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e11dc-7503-465b-ab39-42f28b96749b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:08.513693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce6207-6a5c-42ba-9828-f5f9f200fa0b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:08.531809 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e11dc-7503-465b-ab39-42f28b96749b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:08.548097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f93bc0-3e3a-4519-83eb-b36693d596cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:08.548897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f93bc0-3e3a-4519-83eb-b36693d596cd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:08.549227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f93bc0-3e3a-4519-83eb-b36693d596cd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:08.549503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f93bc0-3e3a-4519-83eb-b36693d596cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:08.557472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f93bc0-3e3a-4519-83eb-b36693d596cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:08.559046 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f93bc0-3e3a-4519-83eb-b36693d596cd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:08.570020 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceb6ac-7201-4466-ab91-416cee2f6184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:08.571221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb6ac-7201-4466-ab91-416cee2f6184 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:08.572209 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb6ac-7201-4466-ab91-416cee2f6184 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:08.572688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb6ac-7201-4466-ab91-416cee2f6184 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-49f93bc0-3e3a-4519-83eb-b36693d596cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:15:08.574977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:08.576000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:08.577546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:08.577546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:08.577546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:15:08.577546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:15:08.577546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:15:08.577546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:15:08.577546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:15:08.577546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:15:08.577546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:15:08.577546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:08.580988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 502/973] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:15:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:08.581814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f93bc0-3e3a-4519-83eb-b36693d596cd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:08.584800 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbceb6ac-7201-4466-ab91-416cee2f6184 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:08.586540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbceb6ac-7201-4466-ab91-416cee2f6184 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-dbceb6ac-7201-4466-ab91-416cee2f6184 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:15:08.602665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:08.603694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:08.604737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:08.604737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:08.604737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:15:08.604737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:15:08.604737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:15:08.604737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:15:08.604737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:15:08.604737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:15:08.604737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:15:08.604737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:08.611908 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 472/974] 10.222.0.61 () {56 vars in 1117 bytes} [Tue May 10 20:15:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:08.613378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceb6ac-7201-4466-ab91-416cee2f6184 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:08.685963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f93bc0-3e3a-4519-83eb-b36693d596cd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:08.720628 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceb6ac-7201-4466-ab91-416cee2f6184 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:08.722223 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37f189-ce71-45fc-beaf-e2c320ad3683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:08.722896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37f189-ce71-45fc-beaf-e2c320ad3683 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:08.723182 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37f189-ce71-45fc-beaf-e2c320ad3683 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:08.723458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37f189-ce71-45fc-beaf-e2c320ad3683 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:08.724871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37f189-ce71-45fc-beaf-e2c320ad3683 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:08.724871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37f189-ce71-45fc-beaf-e2c320ad3683 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:08.726089 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37f189-ce71-45fc-beaf-e2c320ad3683 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:08.757590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e699a7-1b63-49e9-8b1e-a636c5e9c588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:08.759220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e699a7-1b63-49e9-8b1e-a636c5e9c588 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:08.759715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e699a7-1b63-49e9-8b1e-a636c5e9c588 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:08.760230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e699a7-1b63-49e9-8b1e-a636c5e9c588 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:08.761302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e699a7-1b63-49e9-8b1e-a636c5e9c588 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:08.761821 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e699a7-1b63-49e9-8b1e-a636c5e9c588 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:08.763511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e699a7-1b63-49e9-8b1e-a636c5e9c588 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:08.769258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 503/975] 10.222.0.61 () {56 vars in 1101 bytes} [Tue May 10 20:15:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:08.789287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 473/976] 10.222.0.61 () {56 vars in 1149 bytes} [Tue May 10 20:15:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:08.791112 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37f189-ce71-45fc-beaf-e2c320ad3683 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:08.895434 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37f189-ce71-45fc-beaf-e2c320ad3683 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:08.932497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dcd96-fbaf-4f83-b6ed-99c00b81627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:08.933590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dcd96-fbaf-4f83-b6ed-99c00b81627b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:08.934108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dcd96-fbaf-4f83-b6ed-99c00b81627b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:08.934601 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2dcd96-fbaf-4f83-b6ed-99c00b81627b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:09.014887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dcd96-fbaf-4f83-b6ed-99c00b81627b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:09.016689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2dcd96-fbaf-4f83-b6ed-99c00b81627b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:09.119551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 504/977] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:15:08 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:15:09.122790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e699a7-1b63-49e9-8b1e-a636c5e9c588 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:09.217703 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e699a7-1b63-49e9-8b1e-a636c5e9c588 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:09.250201 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf2133-1446-41f9-a8ca-edee9a0ab78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:09.250993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2133-1446-41f9-a8ca-edee9a0ab78b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:09.251279 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2133-1446-41f9-a8ca-edee9a0ab78b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:09.251557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf2133-1446-41f9-a8ca-edee9a0ab78b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:09.261551 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf2133-1446-41f9-a8ca-edee9a0ab78b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:09.263002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf2133-1446-41f9-a8ca-edee9a0ab78b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-a4cf2133-1446-41f9-a8ca-edee9a0ab78b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:15:09.284935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:09.286006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:09.286900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:15:09.286900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:15:09.286900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:09.286900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:09.286900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 474/978] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:09.293588 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dcd96-fbaf-4f83-b6ed-99c00b81627b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:09.386321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2dcd96-fbaf-4f83-b6ed-99c00b81627b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:09.419641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd587a59-ac99-4b37-8edb-8be1bd0d0a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:09.420357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd587a59-ac99-4b37-8edb-8be1bd0d0a55 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:09.420641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd587a59-ac99-4b37-8edb-8be1bd0d0a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:09.420914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd587a59-ac99-4b37-8edb-8be1bd0d0a55 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:09.422148 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd587a59-ac99-4b37-8edb-8be1bd0d0a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:09.422647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd587a59-ac99-4b37-8edb-8be1bd0d0a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:09.424369 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd587a59-ac99-4b37-8edb-8be1bd0d0a55 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:09.437136 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 505/979] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:09.441145 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf2133-1446-41f9-a8ca-edee9a0ab78b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:09.535684 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf2133-1446-41f9-a8ca-edee9a0ab78b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:09.569827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8747f4-0e09-4465-b9cf-2383d2cbdcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:09.570653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8747f4-0e09-4465-b9cf-2383d2cbdcff None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:09.570938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8747f4-0e09-4465-b9cf-2383d2cbdcff None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:09.571252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8747f4-0e09-4465-b9cf-2383d2cbdcff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:09.578905 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8747f4-0e09-4465-b9cf-2383d2cbdcff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:09.580390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8747f4-0e09-4465-b9cf-2383d2cbdcff None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-fb8747f4-0e09-4465-b9cf-2383d2cbdcff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:15:09.595537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:09.596510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:09.603107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:15:09.603107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:15:09.603107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:15:09.603107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:15:09.603107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:15:09.603107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:15:09.603107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:15:09.603107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:09.603107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 475/980] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:15:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:09.603921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd587a59-ac99-4b37-8edb-8be1bd0d0a55 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:09.700389 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd587a59-ac99-4b37-8edb-8be1bd0d0a55 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:09.733093 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28494c-0b23-4a0b-906f-1f12e7ebdaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:09.733762 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28494c-0b23-4a0b-906f-1f12e7ebdaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:09.734047 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28494c-0b23-4a0b-906f-1f12e7ebdaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:09.734325 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28494c-0b23-4a0b-906f-1f12e7ebdaa8 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:09.735108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28494c-0b23-4a0b-906f-1f12e7ebdaa8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:09.735421 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28494c-0b23-4a0b-906f-1f12e7ebdaa8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:09.736868 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28494c-0b23-4a0b-906f-1f12e7ebdaa8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:09.746674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccbb18-c5db-410f-bc23-ec5bc06fce68 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:09.746956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccbb18-c5db-410f-bc23-ec5bc06fce68 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:09.747246 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccbb18-c5db-410f-bc23-ec5bc06fce68 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:09.748726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 476/981] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:15:09.754271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 506/982] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:15:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:09.755006 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28494c-0b23-4a0b-906f-1f12e7ebdaa8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:09.755427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f20ac1-35bf-4e6d-9308-16c5dfc80628 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:09.755678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f20ac1-35bf-4e6d-9308-16c5dfc80628 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:09.755960 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f20ac1-35bf-4e6d-9308-16c5dfc80628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:09.772711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-47f20ac1-35bf-4e6d-9308-16c5dfc80628 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:09.773919 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-47f20ac1-35bf-4e6d-9308-16c5dfc80628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:09.849364 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 477/983] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:15:09.858795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28494c-0b23-4a0b-906f-1f12e7ebdaa8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:09.864827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f20ac1-35bf-4e6d-9308-16c5dfc80628 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:09.891513 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0fa5f-52f7-49d6-9212-e158ed3873b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:09.892467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0fa5f-52f7-49d6-9212-e158ed3873b9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:09.892799 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0fa5f-52f7-49d6-9212-e158ed3873b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:09.893173 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0fa5f-52f7-49d6-9212-e158ed3873b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:09.893992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0fa5f-52f7-49d6-9212-e158ed3873b9 None admin] RBAC: Adding query filter params (role.id=18652702703b4785bda52db801961cbb, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=7cb2f98e2f844526b48475c783703d17) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:09.894302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0fa5f-52f7-49d6-9212-e158ed3873b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:09.895729 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0fa5f-52f7-49d6-9212-e158ed3873b9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:09.902362 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 507/984] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:15:09 2022] GET /identity/v3/role_assignments?user.id=7cb2f98e2f844526b48475c783703d17&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=18652702703b4785bda52db801961cbb => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:09.972861 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f20ac1-35bf-4e6d-9308-16c5dfc80628 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:10.008234 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70af69f-764d-40ae-8a01-b52029185b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:10.009609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70af69f-764d-40ae-8a01-b52029185b77 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:10.009891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70af69f-764d-40ae-8a01-b52029185b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:10.010162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70af69f-764d-40ae-8a01-b52029185b77 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:10.010825 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70af69f-764d-40ae-8a01-b52029185b77 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:10.012203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70af69f-764d-40ae-8a01-b52029185b77 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-b70af69f-764d-40ae-8a01-b52029185b77 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:10.025352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:10.026508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:10.032615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 478/985] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:15:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:10.035126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0fa5f-52f7-49d6-9212-e158ed3873b9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:10.109105 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36e783-dcce-4773-8867-7da36461bc23 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:10.109277 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36e783-dcce-4773-8867-7da36461bc23 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:10.109528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36e783-dcce-4773-8867-7da36461bc23 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:10.112075 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 479/986] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:10.116166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ab445-46d2-4373-b9e4-358ae0d14822 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:10.116452 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ab445-46d2-4373-b9e4-358ae0d14822 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:10.116731 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ab445-46d2-4373-b9e4-358ae0d14822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:10.134460 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-d88ab445-46d2-4373-b9e4-358ae0d14822 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:10.136276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d88ab445-46d2-4373-b9e4-358ae0d14822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:10.137470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0fa5f-52f7-49d6-9212-e158ed3873b9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:10.169848 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c7153-dfdd-462a-9ba7-b5e5498c5c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:10.170508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c7153-dfdd-462a-9ba7-b5e5498c5c2c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:10.170788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c7153-dfdd-462a-9ba7-b5e5498c5c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:10.171064 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c7153-dfdd-462a-9ba7-b5e5498c5c2c None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:10.171765 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c7153-dfdd-462a-9ba7-b5e5498c5c2c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:10.172065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c7153-dfdd-462a-9ba7-b5e5498c5c2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:10.173469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c7153-dfdd-462a-9ba7-b5e5498c5c2c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:10.178392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 508/987] 10.222.0.61 () {56 vars in 1112 bytes} [Tue May 10 20:15:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:10.184085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c7153-dfdd-462a-9ba7-b5e5498c5c2c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:10.209031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 480/988] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:10.224100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ab445-46d2-4373-b9e4-358ae0d14822 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:10.279624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c7153-dfdd-462a-9ba7-b5e5498c5c2c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:10.311761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cac86-914e-447b-9706-85a632749c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:10.312560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cac86-914e-447b-9706-85a632749c82 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:10.312846 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cac86-914e-447b-9706-85a632749c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:10.313152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cac86-914e-447b-9706-85a632749c82 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:10.313848 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cac86-914e-447b-9706-85a632749c82 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:10.314158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cac86-914e-447b-9706-85a632749c82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:10.315530 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cac86-914e-447b-9706-85a632749c82 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:10.320459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 509/989] 10.222.0.61 () {56 vars in 1112 bytes} [Tue May 10 20:15:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:10.321877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ab445-46d2-4373-b9e4-358ae0d14822 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:10.326528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cac86-914e-447b-9706-85a632749c82 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:10.354456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37e15-bf05-46ba-bff4-74468115fe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:10.355599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37e15-bf05-46ba-bff4-74468115fe53 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:10.356081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37e15-bf05-46ba-bff4-74468115fe53 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:10.356532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e37e15-bf05-46ba-bff4-74468115fe53 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:10.357384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e37e15-bf05-46ba-bff4-74468115fe53 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:10.358914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e37e15-bf05-46ba-bff4-74468115fe53 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-50e37e15-bf05-46ba-bff4-74468115fe53 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:10.371300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:10.372487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:10.373531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:10.373531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:10.373531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:10.373531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:10.373531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:10.373531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:10.373531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:10.373531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:10.373531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:10.373531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:10.373531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:15:10.373531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:10.373531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:15:10.373531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:10.375658 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 481/990] 10.222.0.61 () {56 vars in 1126 bytes} [Tue May 10 20:15:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:10.381808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37e15-bf05-46ba-bff4-74468115fe53 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:10.424527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cac86-914e-447b-9706-85a632749c82 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:10.459058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062e632-9641-4ac7-9a77-aad29c9dbd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:10.459718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062e632-9641-4ac7-9a77-aad29c9dbd77 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:10.460005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062e632-9641-4ac7-9a77-aad29c9dbd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:10.460282 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062e632-9641-4ac7-9a77-aad29c9dbd77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:10.461148 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062e632-9641-4ac7-9a77-aad29c9dbd77 None admin] RBAC: Adding query filter params (interface=public, service_id=075ab08a561946a78b01333fe488fede, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:10.461463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062e632-9641-4ac7-9a77-aad29c9dbd77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:10.462877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062e632-9641-4ac7-9a77-aad29c9dbd77 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:10.467971 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 510/991] 10.222.0.61 () {56 vars in 1251 bytes} [Tue May 10 20:15:10 2022] GET /identity/v3/endpoints?service_id=075ab08a561946a78b01333fe488fede&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:10.473279 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062e632-9641-4ac7-9a77-aad29c9dbd77 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:10.489438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e37e15-bf05-46ba-bff4-74468115fe53 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:10.522422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5f44d-9032-4446-aa11-df19d4bf2db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:10.523090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5f44d-9032-4446-aa11-df19d4bf2db9 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:10.523378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5f44d-9032-4446-aa11-df19d4bf2db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:10.523660 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5f44d-9032-4446-aa11-df19d4bf2db9 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:10.524396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5f44d-9032-4446-aa11-df19d4bf2db9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:10.524706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5f44d-9032-4446-aa11-df19d4bf2db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:10.526107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5f44d-9032-4446-aa11-df19d4bf2db9 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:10.530850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 482/992] 10.222.0.61 () {56 vars in 1122 bytes} [Tue May 10 20:15:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:10.537532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5f44d-9032-4446-aa11-df19d4bf2db9 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:10.574997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062e632-9641-4ac7-9a77-aad29c9dbd77 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:10.608807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158d9f0-4765-4f24-9bf1-ebd82293ccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:10.609489 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158d9f0-4765-4f24-9bf1-ebd82293ccd4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:10.609770 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158d9f0-4765-4f24-9bf1-ebd82293ccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:10.610040 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158d9f0-4765-4f24-9bf1-ebd82293ccd4 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:10.610717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158d9f0-4765-4f24-9bf1-ebd82293ccd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:10.612077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158d9f0-4765-4f24-9bf1-ebd82293ccd4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:10.618671 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 511/993] 10.222.0.61 () {56 vars in 1087 bytes} [Tue May 10 20:15:10 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:15:10.639103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5f44d-9032-4446-aa11-df19d4bf2db9 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:10.675070 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e7bf9-955d-4a85-a962-0b4724c52cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:10.675816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e7bf9-955d-4a85-a962-0b4724c52cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:10.676101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e7bf9-955d-4a85-a962-0b4724c52cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:10.676379 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e7bf9-955d-4a85-a962-0b4724c52cf0 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:10.677199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e7bf9-955d-4a85-a962-0b4724c52cf0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:10.677512 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e7bf9-955d-4a85-a962-0b4724c52cf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:10.678930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e7bf9-955d-4a85-a962-0b4724c52cf0 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:10.685022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 483/994] 10.222.0.61 () {56 vars in 1122 bytes} [Tue May 10 20:15:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:10.690744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158d9f0-4765-4f24-9bf1-ebd82293ccd4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:10.794458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158d9f0-4765-4f24-9bf1-ebd82293ccd4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:10.829854 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5353e-5247-4b68-b033-9c77c499ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:10.830515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5353e-5247-4b68-b033-9c77c499ad3f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:10.830849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5353e-5247-4b68-b033-9c77c499ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:10.831149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5353e-5247-4b68-b033-9c77c499ad3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:10.831954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5353e-5247-4b68-b033-9c77c499ad3f None admin] RBAC: Adding query filter params (interface=admin, service_id=9d7c0fead7974d2391efbb8b17bc4199, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:10.832267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5353e-5247-4b68-b033-9c77c499ad3f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:10.833702 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5353e-5247-4b68-b033-9c77c499ad3f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:10.842905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 512/995] 10.222.0.61 () {56 vars in 1249 bytes} [Tue May 10 20:15:10 2022] GET /identity/v3/endpoints?service_id=9d7c0fead7974d2391efbb8b17bc4199&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:10.844102 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e7bf9-955d-4a85-a962-0b4724c52cf0 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:10.939003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e7bf9-955d-4a85-a962-0b4724c52cf0 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:10.973713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782bd16-b7b5-4609-957e-70c9c51fd122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:10.974385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782bd16-b7b5-4609-957e-70c9c51fd122 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:10.974667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782bd16-b7b5-4609-957e-70c9c51fd122 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:10.974938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782bd16-b7b5-4609-957e-70c9c51fd122 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:10.975632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782bd16-b7b5-4609-957e-70c9c51fd122 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:10.977008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782bd16-b7b5-4609-957e-70c9c51fd122 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:10.993048 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 484/996] 10.222.0.61 () {56 vars in 1087 bytes} [Tue May 10 20:15:10 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:15:12.245639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddc6d7-b762-483d-8aef-d9d6493fd21f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:12.246129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddc6d7-b762-483d-8aef-d9d6493fd21f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:12.246129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddc6d7-b762-483d-8aef-d9d6493fd21f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:12.247670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 513/997] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:12.252870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61dcc4-f466-488c-9218-e897499c8926 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:12.253311 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61dcc4-f466-488c-9218-e897499c8926 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:12.253496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61dcc4-f466-488c-9218-e897499c8926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:12.270435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-8c61dcc4-f466-488c-9218-e897499c8926 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:12.271854 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-8c61dcc4-f466-488c-9218-e897499c8926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:12.335754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 485/998] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:12.358114 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddc6d7-b762-483d-8aef-d9d6493fd21f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:12.454333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddc6d7-b762-483d-8aef-d9d6493fd21f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:12.486691 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b09bd9-2948-4cde-8326-1af30d9975a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:12.487470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b09bd9-2948-4cde-8326-1af30d9975a1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:12.487752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b09bd9-2948-4cde-8326-1af30d9975a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:12.488024 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b09bd9-2948-4cde-8326-1af30d9975a1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:12.488668 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b09bd9-2948-4cde-8326-1af30d9975a1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:12.490055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b09bd9-2948-4cde-8326-1af30d9975a1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-f5b09bd9-2948-4cde-8326-1af30d9975a1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:12.501265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:12.502226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:12.503151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:12.503151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:12.503151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:12.503151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:12.503151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:12.503151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:12.503151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:12.503151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:12.503151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:12.503151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:12.503151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:15:12.503151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:12.503151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:15:12.503151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:12.505296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 514/999] 10.222.0.61 () {56 vars in 1105 bytes} [Tue May 10 20:15:12 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:12.508215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61dcc4-f466-488c-9218-e897499c8926 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:12.601196 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61dcc4-f466-488c-9218-e897499c8926 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:12.632809 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b830b5-524d-4852-99f3-ce9df858a371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:12.634022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b830b5-524d-4852-99f3-ce9df858a371 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:12.634298 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b830b5-524d-4852-99f3-ce9df858a371 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:12.634570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b830b5-524d-4852-99f3-ce9df858a371 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:12.635263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b830b5-524d-4852-99f3-ce9df858a371 None admin] RBAC: Adding query filter params (name=image) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:12.635567 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b830b5-524d-4852-99f3-ce9df858a371 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:12.636913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b830b5-524d-4852-99f3-ce9df858a371 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:12.645253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 486/1000] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:12.647770 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b09bd9-2948-4cde-8326-1af30d9975a1 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:12.748365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b09bd9-2948-4cde-8326-1af30d9975a1 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:12.781071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef580a6-b8a5-4334-9210-ed9658f9eceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:12.781674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef580a6-b8a5-4334-9210-ed9658f9eceb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:12.781956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef580a6-b8a5-4334-9210-ed9658f9eceb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:12.782231 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef580a6-b8a5-4334-9210-ed9658f9eceb None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:12.782936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef580a6-b8a5-4334-9210-ed9658f9eceb None admin] RBAC: Adding query filter params (type=image) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:12.783305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef580a6-b8a5-4334-9210-ed9658f9eceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:12.784774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef580a6-b8a5-4334-9210-ed9658f9eceb None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:12.797086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 515/1001] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:12.884368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d1ac2-40b5-4c38-99e0-9085c132bd04 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:12.884819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d1ac2-40b5-4c38-99e0-9085c132bd04 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:12.885242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d1ac2-40b5-4c38-99e0-9085c132bd04 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:12.886804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 487/1002] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:12.892768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ee0f9-25e1-4587-95a7-cf84bee010ec None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:12.893109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ee0f9-25e1-4587-95a7-cf84bee010ec None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:12.893384 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ee0f9-25e1-4587-95a7-cf84bee010ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:12.911228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-368ee0f9-25e1-4587-95a7-cf84bee010ec None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:12.912805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-368ee0f9-25e1-4587-95a7-cf84bee010ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:12.989681 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 516/1003] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:13.012322 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d1ac2-40b5-4c38-99e0-9085c132bd04 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:13.120758 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d1ac2-40b5-4c38-99e0-9085c132bd04 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:13.153307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461e6d1-c308-4738-b949-40e593f4f395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:13.154103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461e6d1-c308-4738-b949-40e593f4f395 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:13.154387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461e6d1-c308-4738-b949-40e593f4f395 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:13.154662 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461e6d1-c308-4738-b949-40e593f4f395 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:13.155306 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461e6d1-c308-4738-b949-40e593f4f395 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:13.156658 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461e6d1-c308-4738-b949-40e593f4f395 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-a461e6d1-c308-4738-b949-40e593f4f395 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:13.168486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:13.169528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:13.170384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 488/1004] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:15:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:13.177072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ee0f9-25e1-4587-95a7-cf84bee010ec None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:13.269057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd3f1b-5ddd-42dc-8972-1c72f89938d9 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:13.269575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd3f1b-5ddd-42dc-8972-1c72f89938d9 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:13.269575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd3f1b-5ddd-42dc-8972-1c72f89938d9 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:13.270678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ee0f9-25e1-4587-95a7-cf84bee010ec None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:13.271195 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 489/1005] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:15:13.277119 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8f917-da41-4461-93ce-7c811489525c None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:13.277410 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8f917-da41-4461-93ce-7c811489525c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:13.277688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8f917-da41-4461-93ce-7c811489525c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:13.296320 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-c6d8f917-da41-4461-93ce-7c811489525c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:13.296320 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c6d8f917-da41-4461-93ce-7c811489525c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:13.305164 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e718968-15fe-43f2-917d-8944dbe5db4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:13.305831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e718968-15fe-43f2-917d-8944dbe5db4c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:13.306114 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e718968-15fe-43f2-917d-8944dbe5db4c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:13.306390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e718968-15fe-43f2-917d-8944dbe5db4c None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:13.307089 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e718968-15fe-43f2-917d-8944dbe5db4c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:13.307396 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e718968-15fe-43f2-917d-8944dbe5db4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:13.308763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e718968-15fe-43f2-917d-8944dbe5db4c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:13.313537 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 517/1006] 10.222.0.61 () {56 vars in 1112 bytes} [Tue May 10 20:15:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:13.319001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e718968-15fe-43f2-917d-8944dbe5db4c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:13.366385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 490/1007] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:15:13.389243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8f917-da41-4461-93ce-7c811489525c None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:13.422323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e718968-15fe-43f2-917d-8944dbe5db4c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:13.455161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846f04e-796c-48c9-ad77-576767df0cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:13.455825 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846f04e-796c-48c9-ad77-576767df0cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:13.456104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846f04e-796c-48c9-ad77-576767df0cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:13.456374 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d846f04e-796c-48c9-ad77-576767df0cd0 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:13.457098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846f04e-796c-48c9-ad77-576767df0cd0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:13.457402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846f04e-796c-48c9-ad77-576767df0cd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:13.458769 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d846f04e-796c-48c9-ad77-576767df0cd0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:13.468520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 518/1008] 10.222.0.61 () {56 vars in 1112 bytes} [Tue May 10 20:15:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:13.469802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846f04e-796c-48c9-ad77-576767df0cd0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:13.487198 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8f917-da41-4461-93ce-7c811489525c None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:13.520536 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1d064-554b-4317-95b7-d663058ad5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:13.521624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d064-554b-4317-95b7-d663058ad5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:13.521915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d064-554b-4317-95b7-d663058ad5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:13.522192 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1d064-554b-4317-95b7-d663058ad5f6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:13.522838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1d064-554b-4317-95b7-d663058ad5f6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:13.524931 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1d064-554b-4317-95b7-d663058ad5f6 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-99f1d064-554b-4317-95b7-d663058ad5f6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:13.536637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:13.537685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:13.538527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 491/1009] 10.222.0.61 () {56 vars in 1126 bytes} [Tue May 10 20:15:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:13.543710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1d064-554b-4317-95b7-d663058ad5f6 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:13.568340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d846f04e-796c-48c9-ad77-576767df0cd0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:13.601660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4714ef-f7b9-45e1-a611-34cc1201d84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:13.603504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4714ef-f7b9-45e1-a611-34cc1201d84d None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:13.603889 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4714ef-f7b9-45e1-a611-34cc1201d84d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:13.604257 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4714ef-f7b9-45e1-a611-34cc1201d84d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:13.605156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4714ef-f7b9-45e1-a611-34cc1201d84d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:13.606612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4714ef-f7b9-45e1-a611-34cc1201d84d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:13.635000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 519/1010] 10.222.0.61 () {60 vars in 1144 bytes} [Tue May 10 20:15:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:15:13.644102 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1d064-554b-4317-95b7-d663058ad5f6 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:13.686924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5373ed-9b2c-48b0-a990-30662a80637c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:13.687609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5373ed-9b2c-48b0-a990-30662a80637c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:13.687892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5373ed-9b2c-48b0-a990-30662a80637c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:13.688167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5373ed-9b2c-48b0-a990-30662a80637c None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:13.688887 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5373ed-9b2c-48b0-a990-30662a80637c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:13.689241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5373ed-9b2c-48b0-a990-30662a80637c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:13.690649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5373ed-9b2c-48b0-a990-30662a80637c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:13.696931 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 492/1011] 10.222.0.61 () {56 vars in 1122 bytes} [Tue May 10 20:15:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:13.702568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4714ef-f7b9-45e1-a611-34cc1201d84d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:13.803765 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4714ef-f7b9-45e1-a611-34cc1201d84d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:13.837670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22110e-2cb0-48b2-b040-96aaaccd5a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:13.838345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22110e-2cb0-48b2-b040-96aaaccd5a93 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:13.838623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22110e-2cb0-48b2-b040-96aaaccd5a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:13.838902 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22110e-2cb0-48b2-b040-96aaaccd5a93 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:13.839614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22110e-2cb0-48b2-b040-96aaaccd5a93 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:13.839920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22110e-2cb0-48b2-b040-96aaaccd5a93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:13.841385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22110e-2cb0-48b2-b040-96aaaccd5a93 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:13.846418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 520/1012] 10.222.0.61 () {56 vars in 1122 bytes} [Tue May 10 20:15:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:13.851841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5373ed-9b2c-48b0-a990-30662a80637c None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:13.954865 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5373ed-9b2c-48b0-a990-30662a80637c None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:13.990189 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f67f6-91dd-40ec-b0cf-014814a50c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:13.990857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f67f6-91dd-40ec-b0cf-014814a50c42 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:13.991139 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f67f6-91dd-40ec-b0cf-014814a50c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:13.991410 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f67f6-91dd-40ec-b0cf-014814a50c42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:13.992159 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f67f6-91dd-40ec-b0cf-014814a50c42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:13.994052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f67f6-91dd-40ec-b0cf-014814a50c42 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:14.011246 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 493/1013] 10.222.0.61 () {60 vars in 1144 bytes} [Tue May 10 20:15:13 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:15:15.006487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da8233-377a-4e56-b96c-2922bf0c1dcd None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:15.006935 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da8233-377a-4e56-b96c-2922bf0c1dcd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:15.007132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da8233-377a-4e56-b96c-2922bf0c1dcd None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:15.009107 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 521/1014] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:15.013980 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14484413-5473-4f8e-8c06-831c618ca0dc None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:15.014372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14484413-5473-4f8e-8c06-831c618ca0dc None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:15.014549 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14484413-5473-4f8e-8c06-831c618ca0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:15.031644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-14484413-5473-4f8e-8c06-831c618ca0dc None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:15.032792 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-14484413-5473-4f8e-8c06-831c618ca0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:15.100000 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 494/1015] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:15 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:15.121690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da8233-377a-4e56-b96c-2922bf0c1dcd None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:15.221352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da8233-377a-4e56-b96c-2922bf0c1dcd None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:15.253055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446e4fe-4548-420c-9b9d-fba1e60d9db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:15.253648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446e4fe-4548-420c-9b9d-fba1e60d9db8 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:15.253931 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446e4fe-4548-420c-9b9d-fba1e60d9db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:15.254205 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446e4fe-4548-420c-9b9d-fba1e60d9db8 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:15.254925 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446e4fe-4548-420c-9b9d-fba1e60d9db8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:15.256284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446e4fe-4548-420c-9b9d-fba1e60d9db8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:15.270315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 522/1016] 10.222.0.61 () {60 vars in 1141 bytes} [Tue May 10 20:15:15 2022] POST /identity/v3/services => generated 242 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:15:15.973872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e1042-0557-497a-ab45-c7f1fd262266 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:15.974593 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e1042-0557-497a-ab45-c7f1fd262266 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:15.975101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e1042-0557-497a-ab45-c7f1fd262266 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:15.976943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 495/1017] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:15.984542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad94d38-dd41-461a-8513-27b729f266c7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:15.985103 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad94d38-dd41-461a-8513-27b729f266c7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:15.985590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad94d38-dd41-461a-8513-27b729f266c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:16.002185 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0ad94d38-dd41-461a-8513-27b729f266c7 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:16.003594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0ad94d38-dd41-461a-8513-27b729f266c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:16.081875 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 523/1018] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:16.105052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e1042-0557-497a-ab45-c7f1fd262266 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:16.209023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e1042-0557-497a-ab45-c7f1fd262266 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:16.243410 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5103dbf-b93b-4e35-b32d-a2d52b693a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:16.244529 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103dbf-b93b-4e35-b32d-a2d52b693a06 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:16.244993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103dbf-b93b-4e35-b32d-a2d52b693a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:16.245417 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103dbf-b93b-4e35-b32d-a2d52b693a06 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:16.251142 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997cd27-102b-41f4-a7c8-9d34762409e0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:16.251437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997cd27-102b-41f4-a7c8-9d34762409e0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:16.251715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997cd27-102b-41f4-a7c8-9d34762409e0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:16.253120 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 524/1019] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:15:16.256327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5103dbf-b93b-4e35-b32d-a2d52b693a06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:15:16.258126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3d305-1210-4298-ba8f-3749b3d84dd2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:16.258977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3d305-1210-4298-ba8f-3749b3d84dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:16.259259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3d305-1210-4298-ba8f-3749b3d84dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-d5103dbf-b93b-4e35-b32d-a2d52b693a06 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:15:16.265229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:16.266362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:16.267481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:16.267481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:16.267481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:16.267481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:16.267481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:15:16.267481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:15:16.267481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:15:16.267481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:15:16.267481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:15:16.267481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:15:16.267481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:15:16.267481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:16.267481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 496/1020] 10.222.0.61 () {56 vars in 1120 bytes} [Tue May 10 20:15:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:16.274799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5103dbf-b93b-4e35-b32d-a2d52b693a06 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:16.279199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-93d3d305-1210-4298-ba8f-3749b3d84dd2 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:16.280376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-93d3d305-1210-4298-ba8f-3749b3d84dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:16.347824 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 525/1021] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:16.371625 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3d305-1210-4298-ba8f-3749b3d84dd2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:16.374473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5103dbf-b93b-4e35-b32d-a2d52b693a06 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:16.407834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63359137-8694-44c9-9761-17bd8cdc294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:16.408508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359137-8694-44c9-9761-17bd8cdc294f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:16.408792 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359137-8694-44c9-9761-17bd8cdc294f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:16.409096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359137-8694-44c9-9761-17bd8cdc294f None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:16.409851 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63359137-8694-44c9-9761-17bd8cdc294f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:16.410161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63359137-8694-44c9-9761-17bd8cdc294f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:16.411533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63359137-8694-44c9-9761-17bd8cdc294f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:16.420253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 497/1022] 10.222.0.61 () {56 vars in 1115 bytes} [Tue May 10 20:15:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:16.426156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63359137-8694-44c9-9761-17bd8cdc294f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:16.471864 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3d305-1210-4298-ba8f-3749b3d84dd2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:16.512408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88771fb-74b8-47c2-b427-358accb5da54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:16.513188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88771fb-74b8-47c2-b427-358accb5da54 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:16.513469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88771fb-74b8-47c2-b427-358accb5da54 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:16.513744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88771fb-74b8-47c2-b427-358accb5da54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:16.514925 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88771fb-74b8-47c2-b427-358accb5da54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:16.516387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88771fb-74b8-47c2-b427-358accb5da54 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:16.518343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 526/1023] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:16.523820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88771fb-74b8-47c2-b427-358accb5da54 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:16.524324 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63359137-8694-44c9-9761-17bd8cdc294f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:16.557981 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d661f-b4c6-42d7-9ac1-09ed52d75af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:16.558768 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d661f-b4c6-42d7-9ac1-09ed52d75af5 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:16.559046 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d661f-b4c6-42d7-9ac1-09ed52d75af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:16.559326 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d661f-b4c6-42d7-9ac1-09ed52d75af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:16.569936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d661f-b4c6-42d7-9ac1-09ed52d75af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:16.571423 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d661f-b4c6-42d7-9ac1-09ed52d75af5 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-a69d661f-b4c6-42d7-9ac1-09ed52d75af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:15:16.588242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:16.589307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:16.590418 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:15:16.590418 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:15:16.590418 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:16.590418 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:16.594248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 498/1024] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:16.595088 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d661f-b4c6-42d7-9ac1-09ed52d75af5 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:16.626703 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88771fb-74b8-47c2-b427-358accb5da54 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:16.659188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf6f6c-ddbd-4709-ab2c-197113863565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:16.659866 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6f6c-ddbd-4709-ab2c-197113863565 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:16.660130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6f6c-ddbd-4709-ab2c-197113863565 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:16.660403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6f6c-ddbd-4709-ab2c-197113863565 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:16.661129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf6f6c-ddbd-4709-ab2c-197113863565 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:16.662552 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf6f6c-ddbd-4709-ab2c-197113863565 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:16.701001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 527/1025] 10.222.0.61 () {60 vars in 1141 bytes} [Tue May 10 20:15:16 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:15:16.701213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d661f-b4c6-42d7-9ac1-09ed52d75af5 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:16.732903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66170a77-9d07-4586-bb32-56de2819d87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:16.733605 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66170a77-9d07-4586-bb32-56de2819d87f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:16.733887 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66170a77-9d07-4586-bb32-56de2819d87f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:16.734161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66170a77-9d07-4586-bb32-56de2819d87f None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:16.734894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66170a77-9d07-4586-bb32-56de2819d87f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:16.735201 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66170a77-9d07-4586-bb32-56de2819d87f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:16.736585 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66170a77-9d07-4586-bb32-56de2819d87f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:16.749414 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 499/1026] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:16.755286 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf6f6c-ddbd-4709-ab2c-197113863565 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:16.858413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf6f6c-ddbd-4709-ab2c-197113863565 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:16.897615 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01796647-a3c9-49bb-9977-cc6104bffe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:16.898443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01796647-a3c9-49bb-9977-cc6104bffe2a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:16.898704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01796647-a3c9-49bb-9977-cc6104bffe2a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:16.899011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01796647-a3c9-49bb-9977-cc6104bffe2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:16.906970 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01796647-a3c9-49bb-9977-cc6104bffe2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:16.908666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01796647-a3c9-49bb-9977-cc6104bffe2a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-01796647-a3c9-49bb-9977-cc6104bffe2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:15:16.922869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:16.924043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:16.925245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:16.925245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:16.925245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:15:16.925245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:15:16.925245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:15:16.925245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:15:16.925245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:15:16.925245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:15:16.925245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:15:16.925245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:16.925245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 528/1027] 10.222.0.61 () {56 vars in 1093 bytes} [Tue May 10 20:15:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:16.930996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66170a77-9d07-4586-bb32-56de2819d87f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:17.028695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66170a77-9d07-4586-bb32-56de2819d87f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:17.061368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713477b8-7d50-49d3-9e6f-bd9b9efe3bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:17.062042 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713477b8-7d50-49d3-9e6f-bd9b9efe3bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:17.062326 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713477b8-7d50-49d3-9e6f-bd9b9efe3bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:17.062605 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713477b8-7d50-49d3-9e6f-bd9b9efe3bb5 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:17.063451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713477b8-7d50-49d3-9e6f-bd9b9efe3bb5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:17.063766 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713477b8-7d50-49d3-9e6f-bd9b9efe3bb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:17.065203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713477b8-7d50-49d3-9e6f-bd9b9efe3bb5 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:17.082773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 500/1028] 10.222.0.61 () {56 vars in 1133 bytes} [Tue May 10 20:15:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:17.088277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01796647-a3c9-49bb-9977-cc6104bffe2a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:17.191997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01796647-a3c9-49bb-9977-cc6104bffe2a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:17.226708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63529075-70b2-404f-80cb-8e44106ace83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:17.227877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63529075-70b2-404f-80cb-8e44106ace83 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:17.228162 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63529075-70b2-404f-80cb-8e44106ace83 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:17.228438 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63529075-70b2-404f-80cb-8e44106ace83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:17.292818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63529075-70b2-404f-80cb-8e44106ace83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:17.294293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63529075-70b2-404f-80cb-8e44106ace83 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:17.391287 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 529/1029] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:15:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 20:15:17.397371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713477b8-7d50-49d3-9e6f-bd9b9efe3bb5 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:17.499220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713477b8-7d50-49d3-9e6f-bd9b9efe3bb5 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:17.506199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d230d-c6a4-4d18-8510-501042a8189a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:17.506494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d230d-c6a4-4d18-8510-501042a8189a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:17.506772 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d230d-c6a4-4d18-8510-501042a8189a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:17.508955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 530/1030] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:15:17.513225 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04162813-a4fc-4b97-a8df-26392510db97 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:17.513515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04162813-a4fc-4b97-a8df-26392510db97 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:17.513789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04162813-a4fc-4b97-a8df-26392510db97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:17.530955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-04162813-a4fc-4b97-a8df-26392510db97 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:17.532116 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-04162813-a4fc-4b97-a8df-26392510db97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:17.533745 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c1657-f5cf-4d38-88f6-c9fc6b4ceb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:17.534540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c1657-f5cf-4d38-88f6-c9fc6b4ceb19 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:17.534829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c1657-f5cf-4d38-88f6-c9fc6b4ceb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:17.535110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c1657-f5cf-4d38-88f6-c9fc6b4ceb19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:17.545822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c1657-f5cf-4d38-88f6-c9fc6b4ceb19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:17.547260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43c1657-f5cf-4d38-88f6-c9fc6b4ceb19 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-f43c1657-f5cf-4d38-88f6-c9fc6b4ceb19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:15:17.564499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:17.565656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:17.566640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:15:17.566640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:15:17.566640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:17.566640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:17.566640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 501/1031] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:17.573913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c1657-f5cf-4d38-88f6-c9fc6b4ceb19 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:17.599884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 531/1032] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:15:17.622349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04162813-a4fc-4b97-a8df-26392510db97 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:17.671143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43c1657-f5cf-4d38-88f6-c9fc6b4ceb19 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:17.704459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef43b3-463d-4dcc-aa1e-0daaac3e7ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:17.705498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef43b3-463d-4dcc-aa1e-0daaac3e7ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:17.705778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef43b3-463d-4dcc-aa1e-0daaac3e7ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:17.706053 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef43b3-463d-4dcc-aa1e-0daaac3e7ce9 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:17.706762 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef43b3-463d-4dcc-aa1e-0daaac3e7ce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:17.707065 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef43b3-463d-4dcc-aa1e-0daaac3e7ce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:17.708412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef43b3-463d-4dcc-aa1e-0daaac3e7ce9 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:17.717273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04162813-a4fc-4b97-a8df-26392510db97 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:17.724058 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 502/1033] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:17.725487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef43b3-463d-4dcc-aa1e-0daaac3e7ce9 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:17.751122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17a67a-aff7-4109-8f2b-18144c612504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:17.752141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17a67a-aff7-4109-8f2b-18144c612504 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:17.752614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17a67a-aff7-4109-8f2b-18144c612504 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:17.753112 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17a67a-aff7-4109-8f2b-18144c612504 None admin] PATH_INFO: `/v3/services/image` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:17.753933 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17a67a-aff7-4109-8f2b-18144c612504 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:17.755488 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17a67a-aff7-4109-8f2b-18144c612504 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-6c17a67a-aff7-4109-8f2b-18144c612504 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:17.767433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:17.768426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:17.769388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 532/1034] 10.222.0.61 () {56 vars in 1105 bytes} [Tue May 10 20:15:17 2022] GET /identity/v3/services/image => generated 86 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:17.774891 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17a67a-aff7-4109-8f2b-18144c612504 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:17.824857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef43b3-463d-4dcc-aa1e-0daaac3e7ce9 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:17.856575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0390f29-f631-4c9b-9d76-3dab1117bc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:17.857422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0390f29-f631-4c9b-9d76-3dab1117bc8b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:17.857707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0390f29-f631-4c9b-9d76-3dab1117bc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:17.857985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0390f29-f631-4c9b-9d76-3dab1117bc8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:17.865342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0390f29-f631-4c9b-9d76-3dab1117bc8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:17.866819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0390f29-f631-4c9b-9d76-3dab1117bc8b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:17.869979 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17a67a-aff7-4109-8f2b-18144c612504 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-f0390f29-f631-4c9b-9d76-3dab1117bc8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:15:17.883999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:17.885179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:17.891120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:15:17.891120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:15:17.891120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:15:17.891120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:15:17.891120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:15:17.891120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:15:17.891120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:15:17.891120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:17.891120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 503/1035] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:15:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:17.891120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0390f29-f631-4c9b-9d76-3dab1117bc8b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:17.912357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e223f80-748f-422d-bec5-a1018be8260d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:17.913048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e223f80-748f-422d-bec5-a1018be8260d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:17.913336 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e223f80-748f-422d-bec5-a1018be8260d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:17.913612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e223f80-748f-422d-bec5-a1018be8260d None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:17.914320 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e223f80-748f-422d-bec5-a1018be8260d None admin] RBAC: Adding query filter params (name=image) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:17.915165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e223f80-748f-422d-bec5-a1018be8260d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:17.916531 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e223f80-748f-422d-bec5-a1018be8260d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:17.921264 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 533/1036] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:17.926883 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e223f80-748f-422d-bec5-a1018be8260d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:17.991732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0390f29-f631-4c9b-9d76-3dab1117bc8b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:18.022101 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e223f80-748f-422d-bec5-a1018be8260d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:18.024479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217425e3-2553-4d0f-a0be-915dd17d1a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:18.025176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217425e3-2553-4d0f-a0be-915dd17d1a44 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:18.025461 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217425e3-2553-4d0f-a0be-915dd17d1a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:18.025734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217425e3-2553-4d0f-a0be-915dd17d1a44 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:18.026510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217425e3-2553-4d0f-a0be-915dd17d1a44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:18.026820 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217425e3-2553-4d0f-a0be-915dd17d1a44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:18.028239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217425e3-2553-4d0f-a0be-915dd17d1a44 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:18.040098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 504/1037] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:15:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:18.045789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217425e3-2553-4d0f-a0be-915dd17d1a44 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:18.054458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bbe24-2165-48bb-9ad6-d0fd330c1eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:18.055196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bbe24-2165-48bb-9ad6-d0fd330c1eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:18.055967 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bbe24-2165-48bb-9ad6-d0fd330c1eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:18.056241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bbe24-2165-48bb-9ad6-d0fd330c1eb7 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:18.056940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bbe24-2165-48bb-9ad6-d0fd330c1eb7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:18.057274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bbe24-2165-48bb-9ad6-d0fd330c1eb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:18.058622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bbe24-2165-48bb-9ad6-d0fd330c1eb7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:18.063447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 534/1038] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:18.069135 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bbe24-2165-48bb-9ad6-d0fd330c1eb7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:18.139651 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217425e3-2553-4d0f-a0be-915dd17d1a44 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:18.161585 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bbe24-2165-48bb-9ad6-d0fd330c1eb7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:18.171558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2151de0-e62c-4a31-98bb-7f151bbffa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:18.172235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2151de0-e62c-4a31-98bb-7f151bbffa38 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:18.172524 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2151de0-e62c-4a31-98bb-7f151bbffa38 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:18.172800 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2151de0-e62c-4a31-98bb-7f151bbffa38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:18.173664 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2151de0-e62c-4a31-98bb-7f151bbffa38 None admin] RBAC: Adding query filter params (role.id=18652702703b4785bda52db801961cbb, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:18.173975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2151de0-e62c-4a31-98bb-7f151bbffa38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:18.175393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2151de0-e62c-4a31-98bb-7f151bbffa38 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:18.183547 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 505/1039] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:15:18 2022] GET /identity/v3/role_assignments?user.id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=18652702703b4785bda52db801961cbb => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:18.194490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba8673-e0fd-49e8-910d-7e82358cd962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:18.195267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba8673-e0fd-49e8-910d-7e82358cd962 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:18.195616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba8673-e0fd-49e8-910d-7e82358cd962 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:18.196020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba8673-e0fd-49e8-910d-7e82358cd962 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:18.196901 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba8673-e0fd-49e8-910d-7e82358cd962 None admin] RBAC: Adding query filter params (interface=public, service_id=7c8db078c6c14c87886455c13007cc3d, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:18.197325 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba8673-e0fd-49e8-910d-7e82358cd962 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:18.198844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba8673-e0fd-49e8-910d-7e82358cd962 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:18.204867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 535/1040] 10.222.0.61 () {56 vars in 1251 bytes} [Tue May 10 20:15:18 2022] GET /identity/v3/endpoints?service_id=7c8db078c6c14c87886455c13007cc3d&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:18.210584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2151de0-e62c-4a31-98bb-7f151bbffa38 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:18.312904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2151de0-e62c-4a31-98bb-7f151bbffa38 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:18.347320 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2f7e95-4a91-438b-b2f2-ba16b546366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:18.347996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f7e95-4a91-438b-b2f2-ba16b546366d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:18.348275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f7e95-4a91-438b-b2f2-ba16b546366d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:18.348547 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f7e95-4a91-438b-b2f2-ba16b546366d None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:18.349266 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f7e95-4a91-438b-b2f2-ba16b546366d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:18.350644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2f7e95-4a91-438b-b2f2-ba16b546366d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:18.365004 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 506/1041] 10.222.0.61 () {56 vars in 1087 bytes} [Tue May 10 20:15:18 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:15:18.976989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26aa3f-1bd6-4b7f-95b4-060a9574cced None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:18.977388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26aa3f-1bd6-4b7f-95b4-060a9574cced None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:18.977571 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26aa3f-1bd6-4b7f-95b4-060a9574cced None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:18.980529 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 536/1042] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:18.984618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f79c9b-3f25-439c-ba8a-e1492110e344 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:18.985084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f79c9b-3f25-439c-ba8a-e1492110e344 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:18.985249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f79c9b-3f25-439c-ba8a-e1492110e344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:19.001577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-08f79c9b-3f25-439c-ba8a-e1492110e344 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:19.002753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-08f79c9b-3f25-439c-ba8a-e1492110e344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:19.067505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 507/1043] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:19.091778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26aa3f-1bd6-4b7f-95b4-060a9574cced None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:19.188104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26aa3f-1bd6-4b7f-95b4-060a9574cced None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:19.221162 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6c748-ea4b-456f-a2b1-1b7304caee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:19.221945 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6c748-ea4b-456f-a2b1-1b7304caee40 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:19.222232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6c748-ea4b-456f-a2b1-1b7304caee40 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:19.222512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6c748-ea4b-456f-a2b1-1b7304caee40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:19.223676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6c748-ea4b-456f-a2b1-1b7304caee40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:19.225117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b6c748-ea4b-456f-a2b1-1b7304caee40 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:19.227552 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 537/1044] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:19.232929 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f79c9b-3f25-439c-ba8a-e1492110e344 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:19.334261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f79c9b-3f25-439c-ba8a-e1492110e344 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:19.367468 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dea46-8224-492b-82d6-1e3f9c8b7216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:19.368530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dea46-8224-492b-82d6-1e3f9c8b7216 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:19.369066 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dea46-8224-492b-82d6-1e3f9c8b7216 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:19.369561 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dea46-8224-492b-82d6-1e3f9c8b7216 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:19.370471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dea46-8224-492b-82d6-1e3f9c8b7216 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:19.372086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dea46-8224-492b-82d6-1e3f9c8b7216 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:19.394688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 508/1045] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:15:19 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:15:20.392342 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ef5f0-56a0-4b75-b6f6-c5ed01b388d9 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:20.392907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ef5f0-56a0-4b75-b6f6-c5ed01b388d9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:20.392907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ef5f0-56a0-4b75-b6f6-c5ed01b388d9 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:20.394502 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 538/1046] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:20.400533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b2945-2966-420a-8d54-f477e9ce7e41 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:20.401227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b2945-2966-420a-8d54-f477e9ce7e41 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:20.401227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b2945-2966-420a-8d54-f477e9ce7e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:20.418899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-2a6b2945-2966-420a-8d54-f477e9ce7e41 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:20.420084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2a6b2945-2966-420a-8d54-f477e9ce7e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:20.485286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 509/1047] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:20.508039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ef5f0-56a0-4b75-b6f6-c5ed01b388d9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:20.575454 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac52fa-48fd-4675-b895-67472c31603f None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:20.575767 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac52fa-48fd-4675-b895-67472c31603f None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:20.576019 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac52fa-48fd-4675-b895-67472c31603f None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:20.577428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 510/1048] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:15:20.582442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2c039-e424-412f-a077-5b4a85ab4589 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:20.582727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2c039-e424-412f-a077-5b4a85ab4589 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:20.583006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2c039-e424-412f-a077-5b4a85ab4589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:20.599612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b5f2c039-e424-412f-a077-5b4a85ab4589 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:20.600692 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b5f2c039-e424-412f-a077-5b4a85ab4589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:20.610469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ef5f0-56a0-4b75-b6f6-c5ed01b388d9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:20.644826 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae4cd7-c3a7-43ec-8c94-ce903f8ec2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:20.645574 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae4cd7-c3a7-43ec-8c94-ce903f8ec2bb None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:20.645855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae4cd7-c3a7-43ec-8c94-ce903f8ec2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:20.646123 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae4cd7-c3a7-43ec-8c94-ce903f8ec2bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:20.656836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae4cd7-c3a7-43ec-8c94-ce903f8ec2bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-7eae4cd7-c3a7-43ec-8c94-ce903f8ec2bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:15:20.665519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:20.666476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:20.667340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:20.667340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:20.667340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:20.667340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:20.667340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:15:20.667340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:15:20.667340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:15:20.667340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:15:20.667340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:15:20.667340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:15:20.667340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:15:20.667340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:20.667340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 539/1049] 10.222.0.61 () {56 vars in 1120 bytes} [Tue May 10 20:15:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:20.672487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 511/1050] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:15:20.672634 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae4cd7-c3a7-43ec-8c94-ce903f8ec2bb None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:20.695120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2c039-e424-412f-a077-5b4a85ab4589 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:20.767795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae4cd7-c3a7-43ec-8c94-ce903f8ec2bb None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:20.790251 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f2c039-e424-412f-a077-5b4a85ab4589 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:20.807481 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd3be-3fbf-43f9-bfc6-cb11e9434c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:20.808408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd3be-3fbf-43f9-bfc6-cb11e9434c25 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:20.808875 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd3be-3fbf-43f9-bfc6-cb11e9434c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:20.809352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd3be-3fbf-43f9-bfc6-cb11e9434c25 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:20.810291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdd3be-3fbf-43f9-bfc6-cb11e9434c25 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:20.810781 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdd3be-3fbf-43f9-bfc6-cb11e9434c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:20.812339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdd3be-3fbf-43f9-bfc6-cb11e9434c25 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:20.821388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 540/1051] 10.222.0.61 () {56 vars in 1115 bytes} [Tue May 10 20:15:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:20.822240 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a28706-a014-4a6e-bd08-61fa1a53ca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:20.823030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a28706-a014-4a6e-bd08-61fa1a53ca2d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:20.823310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a28706-a014-4a6e-bd08-61fa1a53ca2d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:20.823582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a28706-a014-4a6e-bd08-61fa1a53ca2d None admin] PATH_INFO: `/v3/services/image` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:20.824235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a28706-a014-4a6e-bd08-61fa1a53ca2d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:20.825873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a28706-a014-4a6e-bd08-61fa1a53ca2d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:20.827007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd3be-3fbf-43f9-bfc6-cb11e9434c25 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-f7a28706-a014-4a6e-bd08-61fa1a53ca2d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:20.838039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:20.839055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:20.840318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 512/1052] 10.222.0.61 () {56 vars in 1105 bytes} [Tue May 10 20:15:20 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:20.845134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a28706-a014-4a6e-bd08-61fa1a53ca2d None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:20.926773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd3be-3fbf-43f9-bfc6-cb11e9434c25 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:20.943777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a28706-a014-4a6e-bd08-61fa1a53ca2d None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:20.958834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a8936-ab0a-45d2-8183-cdbc98921658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:20.959626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a8936-ab0a-45d2-8183-cdbc98921658 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:20.959912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a8936-ab0a-45d2-8183-cdbc98921658 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:20.960191 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76a8936-ab0a-45d2-8183-cdbc98921658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:20.971039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a8936-ab0a-45d2-8183-cdbc98921658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:20.972499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76a8936-ab0a-45d2-8183-cdbc98921658 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:20.984358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a09bc-8fcc-46c0-be2c-b2ba623c5019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:20.985107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a09bc-8fcc-46c0-be2c-b2ba623c5019 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:20.985395 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a09bc-8fcc-46c0-be2c-b2ba623c5019 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:20.985674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a09bc-8fcc-46c0-be2c-b2ba623c5019 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:20.986386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a09bc-8fcc-46c0-be2c-b2ba623c5019 None admin] RBAC: Adding query filter params (name=image) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:20.986696 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a09bc-8fcc-46c0-be2c-b2ba623c5019 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:20.988058 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a09bc-8fcc-46c0-be2c-b2ba623c5019 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d76a8936-ab0a-45d2-8183-cdbc98921658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:15:20.989856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:20.990934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:20.992201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:15:20.992201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:15:20.992201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:20.992201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:20.992201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 541/1053] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:20.994771 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 513/1054] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:20.996651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a8936-ab0a-45d2-8183-cdbc98921658 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:21.000843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a09bc-8fcc-46c0-be2c-b2ba623c5019 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:21.095147 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76a8936-ab0a-45d2-8183-cdbc98921658 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:21.095506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a09bc-8fcc-46c0-be2c-b2ba623c5019 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:21.126687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31934b-5289-4233-af58-e291017b1312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:21.127074 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d440b-e91e-4481-a92a-6529ef2a1f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:21.127349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31934b-5289-4233-af58-e291017b1312 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:21.127632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31934b-5289-4233-af58-e291017b1312 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:21.127733 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d440b-e91e-4481-a92a-6529ef2a1f09 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:21.127922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31934b-5289-4233-af58-e291017b1312 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:21.128019 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d440b-e91e-4481-a92a-6529ef2a1f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:21.128258 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d440b-e91e-4481-a92a-6529ef2a1f09 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:21.128621 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31934b-5289-4233-af58-e291017b1312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:21.128930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31934b-5289-4233-af58-e291017b1312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:21.129132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d440b-e91e-4481-a92a-6529ef2a1f09 None admin] RBAC: Adding query filter params (type=image) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:21.129290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d440b-e91e-4481-a92a-6529ef2a1f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:21.130317 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31934b-5289-4233-af58-e291017b1312 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:21.130612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d440b-e91e-4481-a92a-6529ef2a1f09 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:21.136393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 514/1055] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:21.141817 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d440b-e91e-4481-a92a-6529ef2a1f09 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:21.148080 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 542/1056] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:21.149782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31934b-5289-4233-af58-e291017b1312 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:21.241038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d440b-e91e-4481-a92a-6529ef2a1f09 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:21.244203 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31934b-5289-4233-af58-e291017b1312 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:21.275141 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db8168-1e4f-4af1-b7ad-add7df0ce8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:21.275803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db8168-1e4f-4af1-b7ad-add7df0ce8d5 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:21.276087 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db8168-1e4f-4af1-b7ad-add7df0ce8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:21.276362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db8168-1e4f-4af1-b7ad-add7df0ce8d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:21.277141 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db8168-1e4f-4af1-b7ad-add7df0ce8d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:21.278499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db8168-1e4f-4af1-b7ad-add7df0ce8d5 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:21.280304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34585709-e776-4bb9-b966-0c6c5964f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:21.281328 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34585709-e776-4bb9-b966-0c6c5964f217 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:21.281960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34585709-e776-4bb9-b966-0c6c5964f217 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:21.282447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34585709-e776-4bb9-b966-0c6c5964f217 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:21.290688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34585709-e776-4bb9-b966-0c6c5964f217 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:21.292130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34585709-e776-4bb9-b966-0c6c5964f217 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:21.309257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 515/1057] 10.222.0.61 () {60 vars in 1144 bytes} [Tue May 10 20:15:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-34585709-e776-4bb9-b966-0c6c5964f217 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:15:21.318316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:21.319382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:21.326359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:21.326359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:21.326359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:15:21.326359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:15:21.326359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:15:21.326359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:15:21.326359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:15:21.326359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:15:21.326359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:15:21.326359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:21.326359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 543/1058] 10.222.0.61 () {56 vars in 1093 bytes} [Tue May 10 20:15:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:21.328265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db8168-1e4f-4af1-b7ad-add7df0ce8d5 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:21.444328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db8168-1e4f-4af1-b7ad-add7df0ce8d5 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:21.481781 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fdd77-7e35-4c78-af3b-ba66fadf113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:21.482691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fdd77-7e35-4c78-af3b-ba66fadf113e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:21.482823 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fdd77-7e35-4c78-af3b-ba66fadf113e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:21.482995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fdd77-7e35-4c78-af3b-ba66fadf113e None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:21.483856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fdd77-7e35-4c78-af3b-ba66fadf113e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:21.484147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fdd77-7e35-4c78-af3b-ba66fadf113e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:21.485663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fdd77-7e35-4c78-af3b-ba66fadf113e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:21.504207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 516/1059] 10.222.0.61 () {56 vars in 1133 bytes} [Tue May 10 20:15:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:21.510716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34585709-e776-4bb9-b966-0c6c5964f217 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:21.612302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34585709-e776-4bb9-b966-0c6c5964f217 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:21.644628 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e154f2-16b6-4888-91c6-f0ae175a0060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:21.645446 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e154f2-16b6-4888-91c6-f0ae175a0060 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:21.645727 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e154f2-16b6-4888-91c6-f0ae175a0060 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:21.645996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e154f2-16b6-4888-91c6-f0ae175a0060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:21.656374 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e154f2-16b6-4888-91c6-f0ae175a0060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:21.657831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e154f2-16b6-4888-91c6-f0ae175a0060 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-58e154f2-16b6-4888-91c6-f0ae175a0060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:15:21.674829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:21.675763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:21.676660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:15:21.676660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:15:21.676660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:21.676660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:21.677414 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 544/1060] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:21.682356 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fdd77-7e35-4c78-af3b-ba66fadf113e None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:21.706553 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898a517-db03-48dd-87a7-50bac8bbd835 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:21.706927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898a517-db03-48dd-87a7-50bac8bbd835 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:21.707107 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898a517-db03-48dd-87a7-50bac8bbd835 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:21.708473 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 545/1061] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:15:21.713512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47569c-28f4-4034-9e53-dbe43105950f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:21.713799 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47569c-28f4-4034-9e53-dbe43105950f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:21.714075 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47569c-28f4-4034-9e53-dbe43105950f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:21.730858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fa47569c-28f4-4034-9e53-dbe43105950f None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:21.732037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fa47569c-28f4-4034-9e53-dbe43105950f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:21.780615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fdd77-7e35-4c78-af3b-ba66fadf113e None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:21.796771 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 546/1062] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:15:21.814086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4186ae-c4c1-4734-add1-90cfea06aedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:21.814752 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4186ae-c4c1-4734-add1-90cfea06aedc None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:21.815038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4186ae-c4c1-4734-add1-90cfea06aedc None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:21.815316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4186ae-c4c1-4734-add1-90cfea06aedc None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:21.816036 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4186ae-c4c1-4734-add1-90cfea06aedc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:21.816346 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4186ae-c4c1-4734-add1-90cfea06aedc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:21.817726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4186ae-c4c1-4734-add1-90cfea06aedc None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:21.819614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47569c-28f4-4034-9e53-dbe43105950f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:21.830185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 517/1063] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:21.835147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4186ae-c4c1-4734-add1-90cfea06aedc None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:21.920732 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47569c-28f4-4034-9e53-dbe43105950f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:21.938710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4186ae-c4c1-4734-add1-90cfea06aedc None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:21.962359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ce3dc-0db2-40c1-b82c-f9606a7a03a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:21.963392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ce3dc-0db2-40c1-b82c-f9606a7a03a3 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:21.963820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ce3dc-0db2-40c1-b82c-f9606a7a03a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:21.964307 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ce3dc-0db2-40c1-b82c-f9606a7a03a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:21.971666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70a470-ffae-4136-941c-0e72853a76bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:21.972586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70a470-ffae-4136-941c-0e72853a76bf None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:21.972948 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70a470-ffae-4136-941c-0e72853a76bf None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:21.973314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70a470-ffae-4136-941c-0e72853a76bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:21.980356 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70a470-ffae-4136-941c-0e72853a76bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:21.980997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605ce3dc-0db2-40c1-b82c-f9606a7a03a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:15:21.981907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70a470-ffae-4136-941c-0e72853a76bf None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-605ce3dc-0db2-40c1-b82c-f9606a7a03a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:15:21.988939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:21.990085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:21.991213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:21.991213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:21.991213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:21.991213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:21.991213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:15:21.991213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:15:21.991213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:15:21.991213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:15:21.991213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:15:21.991213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:15:21.991213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:15:21.991213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:21.993014 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 547/1064] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:15:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:21.998404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ce3dc-0db2-40c1-b82c-f9606a7a03a3 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-8f70a470-ffae-4136-941c-0e72853a76bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:15:21.999223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:22.000278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:22.001428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:15:22.001428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:15:22.001428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:15:22.001428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:15:22.001428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:15:22.001428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:15:22.001428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:15:22.001428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:22.007562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 518/1065] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:22.009080 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70a470-ffae-4136-941c-0e72853a76bf None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:22.102699 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ce3dc-0db2-40c1-b82c-f9606a7a03a3 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:22.106392 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70a470-ffae-4136-941c-0e72853a76bf None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:22.136288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c9b0b-d643-46bf-9d39-719d7021ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:22.137130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c9b0b-d643-46bf-9d39-719d7021ec1a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:22.137515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c9b0b-d643-46bf-9d39-719d7021ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:22.137889 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c9b0b-d643-46bf-9d39-719d7021ec1a None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:22.138656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e34859-f39a-4ad5-b764-1ea2a8dc0172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:22.138832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c9b0b-d643-46bf-9d39-719d7021ec1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:22.139239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c9b0b-d643-46bf-9d39-719d7021ec1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:22.139329 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e34859-f39a-4ad5-b764-1ea2a8dc0172 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:22.139574 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e34859-f39a-4ad5-b764-1ea2a8dc0172 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:22.139847 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e34859-f39a-4ad5-b764-1ea2a8dc0172 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:22.140624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e34859-f39a-4ad5-b764-1ea2a8dc0172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:22.140930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e34859-f39a-4ad5-b764-1ea2a8dc0172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:22.141181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c9b0b-d643-46bf-9d39-719d7021ec1a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:22.142365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e34859-f39a-4ad5-b764-1ea2a8dc0172 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:22.154823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 548/1066] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:15:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:22.155870 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c9b0b-d643-46bf-9d39-719d7021ec1a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:22.158772 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 519/1067] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:22.165096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e34859-f39a-4ad5-b764-1ea2a8dc0172 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:22.256726 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c9b0b-d643-46bf-9d39-719d7021ec1a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:22.267761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e34859-f39a-4ad5-b764-1ea2a8dc0172 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:22.288843 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313741a-6fa1-4d44-8606-8142e165713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:22.290354 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313741a-6fa1-4d44-8606-8142e165713c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:22.290762 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313741a-6fa1-4d44-8606-8142e165713c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:22.291043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313741a-6fa1-4d44-8606-8142e165713c None admin] PATH_INFO: `/v3/users/7df8996e802d4e6c90985704f94ae9ba` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:22.300029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac032c-8039-4ac5-b492-81099ef48362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:22.300917 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac032c-8039-4ac5-b492-81099ef48362 None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:22.301242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac032c-8039-4ac5-b492-81099ef48362 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:22.301527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac032c-8039-4ac5-b492-81099ef48362 None admin] PATH_INFO: `/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/8c3c6fe7e21c4c1ebc01cf91c3c05c4f/roles/18652702703b4785bda52db801961cbb` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:22.303869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac032c-8039-4ac5-b492-81099ef48362 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b37547e1bf4906b65ac39aad3a608c, user_id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f, role_id=18652702703b4785bda52db801961cbb)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:22.304515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313741a-6fa1-4d44-8606-8142e165713c None admin] RBAC: Authorizing `identity:get_user(user_id=7df8996e802d4e6c90985704f94ae9ba)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:22.305797 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac032c-8039-4ac5-b492-81099ef48362 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:22.306669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313741a-6fa1-4d44-8606-8142e165713c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:22.308563 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 549/1068] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:15:22 2022] GET /identity/v3/users/7df8996e802d4e6c90985704f94ae9ba => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:22.313960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313741a-6fa1-4d44-8606-8142e165713c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:22.327787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 520/1069] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:15:22 2022] PUT /identity/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/8c3c6fe7e21c4c1ebc01cf91c3c05c4f/roles/18652702703b4785bda52db801961cbb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:15:22.427923 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313741a-6fa1-4d44-8606-8142e165713c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:22.465621 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caa8e2-b3bb-44ab-a6d6-9275b4e2f88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:22.466296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caa8e2-b3bb-44ab-a6d6-9275b4e2f88d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:22.466582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caa8e2-b3bb-44ab-a6d6-9275b4e2f88d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:22.466859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56caa8e2-b3bb-44ab-a6d6-9275b4e2f88d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:22.538955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56caa8e2-b3bb-44ab-a6d6-9275b4e2f88d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:22.541055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56caa8e2-b3bb-44ab-a6d6-9275b4e2f88d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:22.639966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 550/1070] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:15:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 20:15:22.645730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac032c-8039-4ac5-b492-81099ef48362 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:22.742044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac032c-8039-4ac5-b492-81099ef48362 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:22.773148 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4967c01-6674-4946-8256-93d9a1392c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:22.774524 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4967c01-6674-4946-8256-93d9a1392c6a None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:22.774809 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4967c01-6674-4946-8256-93d9a1392c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:22.775084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4967c01-6674-4946-8256-93d9a1392c6a None admin] PATH_INFO: `/v3/projects/b4d927714c56431bbb020873922df22d` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:22.776263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4967c01-6674-4946-8256-93d9a1392c6a None admin] RBAC: Authorizing `identity:get_project(project_id=b4d927714c56431bbb020873922df22d)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:22.777716 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4967c01-6674-4946-8256-93d9a1392c6a None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:22.784343 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 521/1071] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:15:22 2022] GET /identity/v3/projects/b4d927714c56431bbb020873922df22d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:22.785598 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caa8e2-b3bb-44ab-a6d6-9275b4e2f88d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:22.879976 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56caa8e2-b3bb-44ab-a6d6-9275b4e2f88d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:22.913114 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141de3a8-c816-4f05-b581-92d0561535d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:22.913770 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141de3a8-c816-4f05-b581-92d0561535d8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:22.914052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141de3a8-c816-4f05-b581-92d0561535d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:22.914357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141de3a8-c816-4f05-b581-92d0561535d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:22.915176 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141de3a8-c816-4f05-b581-92d0561535d8 None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=b4d927714c56431bbb020873922df22d, user.id=7df8996e802d4e6c90985704f94ae9ba) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:22.915487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141de3a8-c816-4f05-b581-92d0561535d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:22.916910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141de3a8-c816-4f05-b581-92d0561535d8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:22.929226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 551/1072] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:15:22 2022] GET /identity/v3/role_assignments?user.id=7df8996e802d4e6c90985704f94ae9ba&scope.project.id=b4d927714c56431bbb020873922df22d&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:23.551852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279ee5a-a33c-47be-8f2f-0f6cc8a39ab8 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:23.552183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279ee5a-a33c-47be-8f2f-0f6cc8a39ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:23.552405 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279ee5a-a33c-47be-8f2f-0f6cc8a39ab8 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:23.553944 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 522/1073] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:23.559700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e91d7-886d-4aee-86de-1c6fe7d43892 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:23.560167 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e91d7-886d-4aee-86de-1c6fe7d43892 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:23.560247 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e91d7-886d-4aee-86de-1c6fe7d43892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:23.576597 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-076e91d7-886d-4aee-86de-1c6fe7d43892 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:23.577796 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-076e91d7-886d-4aee-86de-1c6fe7d43892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:23.640291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 552/1074] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:23.663321 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279ee5a-a33c-47be-8f2f-0f6cc8a39ab8 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:23.761263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279ee5a-a33c-47be-8f2f-0f6cc8a39ab8 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:23.793277 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3457f-aa57-4727-91ac-024edb45ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:23.793978 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3457f-aa57-4727-91ac-024edb45ab2a None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:23.794317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3457f-aa57-4727-91ac-024edb45ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:23.794600 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3457f-aa57-4727-91ac-024edb45ab2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:23.858460 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3457f-aa57-4727-91ac-024edb45ab2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:23.859822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3457f-aa57-4727-91ac-024edb45ab2a None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:23.953409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 523/1075] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:15:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 20:15:23.959489 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e91d7-886d-4aee-86de-1c6fe7d43892 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:24.065065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e91d7-886d-4aee-86de-1c6fe7d43892 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:24.097918 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcc36c-c6ef-4987-9833-ec3ea7d89656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:24.098711 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcc36c-c6ef-4987-9833-ec3ea7d89656 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:24.098996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcc36c-c6ef-4987-9833-ec3ea7d89656 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:24.099272 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcc36c-c6ef-4987-9833-ec3ea7d89656 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:24.109698 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcc36c-c6ef-4987-9833-ec3ea7d89656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:24.111095 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcc36c-c6ef-4987-9833-ec3ea7d89656 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-a6bcc36c-c6ef-4987-9833-ec3ea7d89656 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:15:24.128293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:24.129514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:24.130426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:15:24.130426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:15:24.130426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:24.130426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:24.130426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 553/1076] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:24.136589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3457f-aa57-4727-91ac-024edb45ab2a None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:24.231254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3457f-aa57-4727-91ac-024edb45ab2a None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:24.262565 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653554cf-4cd6-493f-a70c-6d8abc5fa2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:24.263224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653554cf-4cd6-493f-a70c-6d8abc5fa2ed None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:24.263503 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653554cf-4cd6-493f-a70c-6d8abc5fa2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:24.263776 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653554cf-4cd6-493f-a70c-6d8abc5fa2ed None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:24.264487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653554cf-4cd6-493f-a70c-6d8abc5fa2ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:24.264793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653554cf-4cd6-493f-a70c-6d8abc5fa2ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:24.266263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653554cf-4cd6-493f-a70c-6d8abc5fa2ed None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:24.279337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 524/1077] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:15:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:24.564182 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126a993-7584-4d9a-8174-9b00d191432b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:24.564689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126a993-7584-4d9a-8174-9b00d191432b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:24.564768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126a993-7584-4d9a-8174-9b00d191432b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:24.566306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 554/1078] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:24.571973 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a45f7-c3a2-4a24-9021-0126141e9c6b None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:24.572269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a45f7-c3a2-4a24-9021-0126141e9c6b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:24.572545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a45f7-c3a2-4a24-9021-0126141e9c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:24.589860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-498a45f7-c3a2-4a24-9021-0126141e9c6b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:24.591029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-498a45f7-c3a2-4a24-9021-0126141e9c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:24.661622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 525/1079] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:24.685290 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126a993-7584-4d9a-8174-9b00d191432b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:24.788526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126a993-7584-4d9a-8174-9b00d191432b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:24.821163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40d17a-b038-4460-a2c0-36e86e926976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:24.821918 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40d17a-b038-4460-a2c0-36e86e926976 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:24.822202 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40d17a-b038-4460-a2c0-36e86e926976 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:24.822480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40d17a-b038-4460-a2c0-36e86e926976 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:24.832013 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40d17a-b038-4460-a2c0-36e86e926976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ae40d17a-b038-4460-a2c0-36e86e926976 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:15:24.840132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:24.841226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:24.842097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:24.842097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:24.842097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:24.842097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:24.842097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:15:24.842097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:15:24.842097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:15:24.842097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:15:24.842097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:15:24.842097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:15:24.842097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:15:24.842097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:24.845122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 555/1080] 10.222.0.61 () {56 vars in 1120 bytes} [Tue May 10 20:15:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:24.848601 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a45f7-c3a2-4a24-9021-0126141e9c6b None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:24.942404 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a45f7-c3a2-4a24-9021-0126141e9c6b None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:24.978395 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8e429-0e75-41ee-b5a1-d27c0d1c56cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:24.979083 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8e429-0e75-41ee-b5a1-d27c0d1c56cb None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:24.979371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8e429-0e75-41ee-b5a1-d27c0d1c56cb None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:24.979648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8e429-0e75-41ee-b5a1-d27c0d1c56cb None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:24.980408 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8e429-0e75-41ee-b5a1-d27c0d1c56cb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:24.980715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8e429-0e75-41ee-b5a1-d27c0d1c56cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:24.982127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8e429-0e75-41ee-b5a1-d27c0d1c56cb None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:24.990827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 526/1081] 10.222.0.61 () {56 vars in 1115 bytes} [Tue May 10 20:15:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:24.997405 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40d17a-b038-4460-a2c0-36e86e926976 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:25.092632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40d17a-b038-4460-a2c0-36e86e926976 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:25.123477 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef131d1-dd81-453b-bef0-7be93111886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:25.124266 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef131d1-dd81-453b-bef0-7be93111886f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:25.124550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef131d1-dd81-453b-bef0-7be93111886f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:25.124828 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef131d1-dd81-453b-bef0-7be93111886f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:25.135618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef131d1-dd81-453b-bef0-7be93111886f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:25.137035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e8788-1332-489b-a4e3-2e4d460ad5e2 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:25.137143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef131d1-dd81-453b-bef0-7be93111886f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:25.137328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e8788-1332-489b-a4e3-2e4d460ad5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:25.137712 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e8788-1332-489b-a4e3-2e4d460ad5e2 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:25.139072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 527/1082] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:15:25.143879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505519c9-0aae-403e-b461-a9f1cce8e712 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:25.144164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505519c9-0aae-403e-b461-a9f1cce8e712 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:25.144437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505519c9-0aae-403e-b461-a9f1cce8e712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-fef131d1-dd81-453b-bef0-7be93111886f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:15:25.154782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:25.155813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:25.156704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:15:25.156704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:15:25.156704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:25.156704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:25.156704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 556/1083] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:25.161441 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef131d1-dd81-453b-bef0-7be93111886f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:25.161849 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-505519c9-0aae-403e-b461-a9f1cce8e712 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:25.163006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-505519c9-0aae-403e-b461-a9f1cce8e712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:25.225649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 528/1084] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:15:25.247081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505519c9-0aae-403e-b461-a9f1cce8e712 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:25.254575 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef131d1-dd81-453b-bef0-7be93111886f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:25.287170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440dcfc-2745-47e5-a0fc-2f50126cbdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:25.287831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440dcfc-2745-47e5-a0fc-2f50126cbdaa None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:25.288118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440dcfc-2745-47e5-a0fc-2f50126cbdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:25.288397 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440dcfc-2745-47e5-a0fc-2f50126cbdaa None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:25.289172 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440dcfc-2745-47e5-a0fc-2f50126cbdaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:25.289482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440dcfc-2745-47e5-a0fc-2f50126cbdaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:25.290869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440dcfc-2745-47e5-a0fc-2f50126cbdaa None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:25.302142 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 557/1085] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:25.307666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440dcfc-2745-47e5-a0fc-2f50126cbdaa None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:25.338411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505519c9-0aae-403e-b461-a9f1cce8e712 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:25.369352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176987c-571b-4601-b6f6-769a09c4e42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:25.370064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176987c-571b-4601-b6f6-769a09c4e42f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:25.370344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176987c-571b-4601-b6f6-769a09c4e42f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:25.370615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176987c-571b-4601-b6f6-769a09c4e42f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:25.380157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176987c-571b-4601-b6f6-769a09c4e42f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-f176987c-571b-4601-b6f6-769a09c4e42f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:15:25.388223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:25.389402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:25.390428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:25.390428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:25.390428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:25.390428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:25.390428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:15:25.390428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:15:25.390428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:15:25.390428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:15:25.390428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:15:25.390428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:15:25.390428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:15:25.390428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:25.393269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 529/1086] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:15:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:25.395091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176987c-571b-4601-b6f6-769a09c4e42f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:25.401129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440dcfc-2745-47e5-a0fc-2f50126cbdaa None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:25.434883 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f63f67-f218-48f6-8f6e-dc03dab906ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:25.435667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63f67-f218-48f6-8f6e-dc03dab906ec None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:25.435951 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63f67-f218-48f6-8f6e-dc03dab906ec None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:25.436231 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63f67-f218-48f6-8f6e-dc03dab906ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:25.443051 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f63f67-f218-48f6-8f6e-dc03dab906ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:25.444523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f63f67-f218-48f6-8f6e-dc03dab906ec None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-c3f63f67-f218-48f6-8f6e-dc03dab906ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:15:25.459178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:25.460117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:25.461122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:25.461122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:25.461122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:15:25.461122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:15:25.461122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:15:25.461122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:15:25.461122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:15:25.461122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:15:25.461122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:15:25.461122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:25.461122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 558/1087] 10.222.0.61 () {56 vars in 1093 bytes} [Tue May 10 20:15:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:25.466033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f63f67-f218-48f6-8f6e-dc03dab906ec None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:25.489386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176987c-571b-4601-b6f6-769a09c4e42f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:25.522067 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176030fd-a664-482b-a5d8-3e652dbcde6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:25.522730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176030fd-a664-482b-a5d8-3e652dbcde6f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:25.523016 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176030fd-a664-482b-a5d8-3e652dbcde6f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:25.523383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176030fd-a664-482b-a5d8-3e652dbcde6f None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:25.524827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176030fd-a664-482b-a5d8-3e652dbcde6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:25.525174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176030fd-a664-482b-a5d8-3e652dbcde6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:25.527235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176030fd-a664-482b-a5d8-3e652dbcde6f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:25.541157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 530/1088] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:15:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:25.547398 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176030fd-a664-482b-a5d8-3e652dbcde6f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:25.562299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f63f67-f218-48f6-8f6e-dc03dab906ec None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:25.594463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05dd96-2437-4ca0-b76e-2606b00541e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:25.595112 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05dd96-2437-4ca0-b76e-2606b00541e5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:25.595399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05dd96-2437-4ca0-b76e-2606b00541e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:25.595674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05dd96-2437-4ca0-b76e-2606b00541e5 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:25.596502 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05dd96-2437-4ca0-b76e-2606b00541e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:25.596813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05dd96-2437-4ca0-b76e-2606b00541e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:25.598260 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05dd96-2437-4ca0-b76e-2606b00541e5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:25.615010 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 559/1089] 10.222.0.61 () {56 vars in 1133 bytes} [Tue May 10 20:15:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:25.620752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05dd96-2437-4ca0-b76e-2606b00541e5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:25.640989 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176030fd-a664-482b-a5d8-3e652dbcde6f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:25.672694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7e416-d517-4b5d-9a53-951ffc13394c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:25.673571 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7e416-d517-4b5d-9a53-951ffc13394c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:25.673850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7e416-d517-4b5d-9a53-951ffc13394c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:25.674122 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7e416-d517-4b5d-9a53-951ffc13394c None admin] PATH_INFO: `/v3/users/7df8996e802d4e6c90985704f94ae9ba` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:25.675407 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7e416-d517-4b5d-9a53-951ffc13394c None admin] RBAC: Authorizing `identity:get_user(user_id=7df8996e802d4e6c90985704f94ae9ba)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:25.676816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7e416-d517-4b5d-9a53-951ffc13394c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:25.678448 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 531/1090] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:15:25 2022] GET /identity/v3/users/7df8996e802d4e6c90985704f94ae9ba => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:25.683949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7e416-d517-4b5d-9a53-951ffc13394c None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:25.713221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05dd96-2437-4ca0-b76e-2606b00541e5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:25.745096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8d36f-882b-4a13-90ea-bd20fd9a4a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:25.745745 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d36f-882b-4a13-90ea-bd20fd9a4a1d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:25.746032 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d36f-882b-4a13-90ea-bd20fd9a4a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:25.746308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d36f-882b-4a13-90ea-bd20fd9a4a1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:25.775965 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7e416-d517-4b5d-9a53-951ffc13394c None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:25.807140 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe600d2-552a-441a-815a-a1205c194344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:25.807991 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe600d2-552a-441a-815a-a1205c194344 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:25.808269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe600d2-552a-441a-815a-a1205c194344 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:25.808548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe600d2-552a-441a-815a-a1205c194344 None admin] PATH_INFO: `/v3/projects/b4d927714c56431bbb020873922df22d` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:25.808882 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8d36f-882b-4a13-90ea-bd20fd9a4a1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:25.809732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe600d2-552a-441a-815a-a1205c194344 None admin] RBAC: Authorizing `identity:get_project(project_id=b4d927714c56431bbb020873922df22d)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:25.810357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8d36f-882b-4a13-90ea-bd20fd9a4a1d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:25.811134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe600d2-552a-441a-815a-a1205c194344 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:25.812812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 532/1091] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:15:25 2022] GET /identity/v3/projects/b4d927714c56431bbb020873922df22d => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:25.818474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe600d2-552a-441a-815a-a1205c194344 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:25.902977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 560/1092] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:15:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 20:15:25.908730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8d36f-882b-4a13-90ea-bd20fd9a4a1d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:25.911419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe600d2-552a-441a-815a-a1205c194344 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:25.942784 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ce80a-6650-4bd2-9d29-1453ee61f123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:25.943661 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ce80a-6650-4bd2-9d29-1453ee61f123 None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:25.943945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ce80a-6650-4bd2-9d29-1453ee61f123 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:25.944215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ce80a-6650-4bd2-9d29-1453ee61f123 None admin] PATH_INFO: `/v3/projects/b4d927714c56431bbb020873922df22d/users/7df8996e802d4e6c90985704f94ae9ba/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:25.946746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ce80a-6650-4bd2-9d29-1453ee61f123 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4d927714c56431bbb020873922df22d, user_id=7df8996e802d4e6c90985704f94ae9ba, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:25.948199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ce80a-6650-4bd2-9d29-1453ee61f123 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:25.964882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 533/1093] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:15:25 2022] PUT /identity/v3/projects/b4d927714c56431bbb020873922df22d/users/7df8996e802d4e6c90985704f94ae9ba/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:15:26.005484 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8d36f-882b-4a13-90ea-bd20fd9a4a1d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:26.041688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b66e3-c497-41f2-bf7d-335156d14d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:26.042528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b66e3-c497-41f2-bf7d-335156d14d8e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:26.042808 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b66e3-c497-41f2-bf7d-335156d14d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:26.043082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b66e3-c497-41f2-bf7d-335156d14d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:26.053965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b66e3-c497-41f2-bf7d-335156d14d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:26.055470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b66e3-c497-41f2-bf7d-335156d14d8e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d72b66e3-c497-41f2-bf7d-335156d14d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:15:26.075154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:26.076166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:26.077126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:15:26.077126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:15:26.077126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:15:26.077126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:26.077126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 561/1094] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:15:26.082248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ce80a-6650-4bd2-9d29-1453ee61f123 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:26.183022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ce80a-6650-4bd2-9d29-1453ee61f123 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:26.214434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3733c-9a13-40e9-a649-546321e63dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:26.215097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3733c-9a13-40e9-a649-546321e63dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:26.215382 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3733c-9a13-40e9-a649-546321e63dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:26.215657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3733c-9a13-40e9-a649-546321e63dc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:26.216372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3733c-9a13-40e9-a649-546321e63dc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:26.216679 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3733c-9a13-40e9-a649-546321e63dc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:26.218073 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3733c-9a13-40e9-a649-546321e63dc3 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:26.229305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 534/1095] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:26.234841 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b66e3-c497-41f2-bf7d-335156d14d8e None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:26.329733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b66e3-c497-41f2-bf7d-335156d14d8e None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:26.361133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3d8a8-9475-4957-bb6c-0cb278f70315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:26.361920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3d8a8-9475-4957-bb6c-0cb278f70315 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:26.362203 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3d8a8-9475-4957-bb6c-0cb278f70315 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:26.362477 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3d8a8-9475-4957-bb6c-0cb278f70315 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:26.369623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3d8a8-9475-4957-bb6c-0cb278f70315 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:26.371082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3d8a8-9475-4957-bb6c-0cb278f70315 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-e6f3d8a8-9475-4957-bb6c-0cb278f70315 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:15:26.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:26.385954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:26.386874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:15:26.386874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:15:26.386874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:15:26.386874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:15:26.386874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:15:26.386874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:15:26.386874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:15:26.386874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:26.386874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 562/1096] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:15:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:26.391914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3733c-9a13-40e9-a649-546321e63dc3 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:26.487401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3733c-9a13-40e9-a649-546321e63dc3 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:26.519833 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a934ed2-7fe1-497f-811a-7e9eb6b03cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:26.520487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934ed2-7fe1-497f-811a-7e9eb6b03cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:26.520769 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934ed2-7fe1-497f-811a-7e9eb6b03cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:26.521084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934ed2-7fe1-497f-811a-7e9eb6b03cf8 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:26.522136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a934ed2-7fe1-497f-811a-7e9eb6b03cf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:26.522449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a934ed2-7fe1-497f-811a-7e9eb6b03cf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:26.524405 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a934ed2-7fe1-497f-811a-7e9eb6b03cf8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:26.535729 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 535/1097] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:15:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:26.542269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3d8a8-9475-4957-bb6c-0cb278f70315 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:26.640170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3d8a8-9475-4957-bb6c-0cb278f70315 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:26.672906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ee010-d157-4bde-b328-6dbdc02c3166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:26.673608 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee010-d157-4bde-b328-6dbdc02c3166 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:26.673893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee010-d157-4bde-b328-6dbdc02c3166 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:26.674171 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee010-d157-4bde-b328-6dbdc02c3166 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:26.675011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ee010-d157-4bde-b328-6dbdc02c3166 None admin] RBAC: Adding query filter params (role.id=18652702703b4785bda52db801961cbb, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:26.675327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ee010-d157-4bde-b328-6dbdc02c3166 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:26.676776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ee010-d157-4bde-b328-6dbdc02c3166 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:26.683516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 563/1098] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:15:26 2022] GET /identity/v3/role_assignments?user.id=8c3c6fe7e21c4c1ebc01cf91c3c05c4f&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=18652702703b4785bda52db801961cbb => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:28.160779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46f7d8-0cd3-4f2c-a978-a0621bc84d7f None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:28.161342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46f7d8-0cd3-4f2c-a978-a0621bc84d7f None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:28.161342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46f7d8-0cd3-4f2c-a978-a0621bc84d7f None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:28.162722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 536/1099] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:28.168578 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde37b64-a5e9-4cd7-8a89-66e8af3e1fec None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:28.168998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde37b64-a5e9-4cd7-8a89-66e8af3e1fec None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:28.169173 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde37b64-a5e9-4cd7-8a89-66e8af3e1fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:28.186022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fde37b64-a5e9-4cd7-8a89-66e8af3e1fec None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:28.187202 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fde37b64-a5e9-4cd7-8a89-66e8af3e1fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:28.248932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 564/1100] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:28.271825 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46f7d8-0cd3-4f2c-a978-a0621bc84d7f None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:28.366239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46f7d8-0cd3-4f2c-a978-a0621bc84d7f None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:28.397512 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34bb88-065e-43ef-9217-f730f9b474d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:28.398274 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34bb88-065e-43ef-9217-f730f9b474d0 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:28.398580 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34bb88-065e-43ef-9217-f730f9b474d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:28.398853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34bb88-065e-43ef-9217-f730f9b474d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:28.408695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34bb88-065e-43ef-9217-f730f9b474d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-0c34bb88-065e-43ef-9217-f730f9b474d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:15:28.416714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:28.417934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:28.419185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:28.419185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:28.419185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:28.419185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:28.419185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:15:28.419185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:15:28.419185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:15:28.419185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:15:28.419185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:15:28.419185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:15:28.419185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:15:28.419185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:28.419185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 537/1101] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:15:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:28.423734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde37b64-a5e9-4cd7-8a89-66e8af3e1fec None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:28.515704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde37b64-a5e9-4cd7-8a89-66e8af3e1fec None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:28.547441 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901e0b-a9a8-403f-9d49-5b399931cf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:28.548090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901e0b-a9a8-403f-9d49-5b399931cf64 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:28.548369 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901e0b-a9a8-403f-9d49-5b399931cf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:28.548640 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901e0b-a9a8-403f-9d49-5b399931cf64 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:28.549465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69901e0b-a9a8-403f-9d49-5b399931cf64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:28.549769 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69901e0b-a9a8-403f-9d49-5b399931cf64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:28.551126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69901e0b-a9a8-403f-9d49-5b399931cf64 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:28.559623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 565/1102] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:15:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:28.565397 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34bb88-065e-43ef-9217-f730f9b474d0 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:28.656723 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34bb88-065e-43ef-9217-f730f9b474d0 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:28.687985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e57995-a0bd-4f45-9442-d0edfbba19c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:28.688828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e57995-a0bd-4f45-9442-d0edfbba19c4 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:28.689131 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e57995-a0bd-4f45-9442-d0edfbba19c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:28.689400 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e57995-a0bd-4f45-9442-d0edfbba19c4 None admin] PATH_INFO: `/v3/users/7df8996e802d4e6c90985704f94ae9ba` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:28.690557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e57995-a0bd-4f45-9442-d0edfbba19c4 None admin] RBAC: Authorizing `identity:get_user(user_id=7df8996e802d4e6c90985704f94ae9ba)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:28.691965 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e57995-a0bd-4f45-9442-d0edfbba19c4 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:28.693582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 538/1103] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:15:28 2022] GET /identity/v3/users/7df8996e802d4e6c90985704f94ae9ba => generated 285 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:28.699130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901e0b-a9a8-403f-9d49-5b399931cf64 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:28.791720 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901e0b-a9a8-403f-9d49-5b399931cf64 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:28.822498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860a981-48bb-4544-b89a-2445e3a33ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:28.823131 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860a981-48bb-4544-b89a-2445e3a33ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:28.823413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860a981-48bb-4544-b89a-2445e3a33ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:28.823688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860a981-48bb-4544-b89a-2445e3a33ba8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:28.885853 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860a981-48bb-4544-b89a-2445e3a33ba8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:28.887289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860a981-48bb-4544-b89a-2445e3a33ba8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:28.978165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 566/1104] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:15:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:15:28.984025 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e57995-a0bd-4f45-9442-d0edfbba19c4 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:29.075605 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e57995-a0bd-4f45-9442-d0edfbba19c4 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:29.107064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b6a99-a085-456d-8fb4-24761424fb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:29.107898 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6a99-a085-456d-8fb4-24761424fb50 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:29.108176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6a99-a085-456d-8fb4-24761424fb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:29.108444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6a99-a085-456d-8fb4-24761424fb50 None admin] PATH_INFO: `/v3/projects/b4d927714c56431bbb020873922df22d` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:29.109602 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b6a99-a085-456d-8fb4-24761424fb50 None admin] RBAC: Authorizing `identity:get_project(project_id=b4d927714c56431bbb020873922df22d)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:29.111001 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b6a99-a085-456d-8fb4-24761424fb50 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:29.112636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 539/1105] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:15:28 2022] GET /identity/v3/projects/b4d927714c56431bbb020873922df22d => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:29.118519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860a981-48bb-4544-b89a-2445e3a33ba8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:29.210415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860a981-48bb-4544-b89a-2445e3a33ba8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:29.241841 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e8d74-be44-427c-8014-b62512715256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:29.242500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e8d74-be44-427c-8014-b62512715256 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:29.242780 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e8d74-be44-427c-8014-b62512715256 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:29.243050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e8d74-be44-427c-8014-b62512715256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:29.243859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e8d74-be44-427c-8014-b62512715256 None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=b4d927714c56431bbb020873922df22d, user.id=7df8996e802d4e6c90985704f94ae9ba) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:29.244168 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e8d74-be44-427c-8014-b62512715256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:29.245598 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e8d74-be44-427c-8014-b62512715256 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:29.250963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 567/1106] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:15:29 2022] GET /identity/v3/role_assignments?user.id=7df8996e802d4e6c90985704f94ae9ba&scope.project.id=b4d927714c56431bbb020873922df22d&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:31.457819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6eb36-c474-4244-90c6-e4b95012e8f6 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:31.458344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6eb36-c474-4244-90c6-e4b95012e8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:31.458344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6eb36-c474-4244-90c6-e4b95012e8f6 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:31.459722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 540/1107] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:31.465379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401274b-632f-45b4-953d-a3b194c3e5bc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:31.465747 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401274b-632f-45b4-953d-a3b194c3e5bc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:31.465932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401274b-632f-45b4-953d-a3b194c3e5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:31.482672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4401274b-632f-45b4-953d-a3b194c3e5bc None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:31.484649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4401274b-632f-45b4-953d-a3b194c3e5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:31.548717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 568/1108] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:31.572872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6eb36-c474-4244-90c6-e4b95012e8f6 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:31.679012 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a6eb36-c474-4244-90c6-e4b95012e8f6 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:31.710155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464f634-37b6-4668-adad-0aee11f958f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:31.711389 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464f634-37b6-4668-adad-0aee11f958f3 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:31.711671 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464f634-37b6-4668-adad-0aee11f958f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:31.711945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464f634-37b6-4668-adad-0aee11f958f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:31.713142 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464f634-37b6-4668-adad-0aee11f958f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:31.714564 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464f634-37b6-4668-adad-0aee11f958f3 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:31.716154 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 541/1109] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:31.724284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401274b-632f-45b4-953d-a3b194c3e5bc None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:31.819339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401274b-632f-45b4-953d-a3b194c3e5bc None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:31.856505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46540681-1f21-4f2d-8d49-9e62e5149c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:31.857190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46540681-1f21-4f2d-8d49-9e62e5149c8b None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:31.857472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46540681-1f21-4f2d-8d49-9e62e5149c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:31.857741 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46540681-1f21-4f2d-8d49-9e62e5149c8b None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:31.858430 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46540681-1f21-4f2d-8d49-9e62e5149c8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:31.859840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46540681-1f21-4f2d-8d49-9e62e5149c8b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:31.879000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 569/1110] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:15:31 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:15:34.087641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833463f-2eca-4b69-9f26-4527c1f7a81c None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:34.088152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833463f-2eca-4b69-9f26-4527c1f7a81c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:34.088259 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833463f-2eca-4b69-9f26-4527c1f7a81c None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:34.089568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 542/1111] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:34.094811 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657fc75-70d6-4f49-a025-f337e1257110 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:34.095216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657fc75-70d6-4f49-a025-f337e1257110 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:34.095365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657fc75-70d6-4f49-a025-f337e1257110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:34.111817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5657fc75-70d6-4f49-a025-f337e1257110 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:34.112966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5657fc75-70d6-4f49-a025-f337e1257110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:34.175740 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 570/1112] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:15:34.198682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833463f-2eca-4b69-9f26-4527c1f7a81c None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:34.295059 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833463f-2eca-4b69-9f26-4527c1f7a81c None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:34.326325 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaaa44-cbc6-429b-b815-4bf327960496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:34.327163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaaa44-cbc6-429b-b815-4bf327960496 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:34.327444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaaa44-cbc6-429b-b815-4bf327960496 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:34.327717 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaaa44-cbc6-429b-b815-4bf327960496 None admin] PATH_INFO: `/v3/roles/472b056b3a5047109259d7fad9133274` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:34.329194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaaaa44-cbc6-429b-b815-4bf327960496 None admin] RBAC: Authorizing `identity:get_role(role_id=472b056b3a5047109259d7fad9133274)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:34.330546 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaaaa44-cbc6-429b-b815-4bf327960496 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:34.331882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 543/1113] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:15:34 2022] GET /identity/v3/roles/472b056b3a5047109259d7fad9133274 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:34.337578 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657fc75-70d6-4f49-a025-f337e1257110 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:34.430565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657fc75-70d6-4f49-a025-f337e1257110 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:34.462014 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1286e6-4b77-4166-bf36-6e4792a55b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:34.462861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1286e6-4b77-4166-bf36-6e4792a55b4b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:34.463142 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1286e6-4b77-4166-bf36-6e4792a55b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:34.463415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1286e6-4b77-4166-bf36-6e4792a55b4b None admin] PATH_INFO: `/v3/users/0f263dc6c8344c56bb56ce1d48e7275e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:34.476227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1286e6-4b77-4166-bf36-6e4792a55b4b None admin] RBAC: Authorizing `identity:get_user(user_id=0f263dc6c8344c56bb56ce1d48e7275e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:34.477701 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1286e6-4b77-4166-bf36-6e4792a55b4b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:34.479301 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 571/1114] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:15:34 2022] GET /identity/v3/users/0f263dc6c8344c56bb56ce1d48e7275e => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:34.484876 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaaa44-cbc6-429b-b815-4bf327960496 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:34.577995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaaa44-cbc6-429b-b815-4bf327960496 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:34.609117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5948c8-9bb4-45dd-a3f6-cae704e02206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:34.609740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5948c8-9bb4-45dd-a3f6-cae704e02206 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:34.610022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5948c8-9bb4-45dd-a3f6-cae704e02206 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:34.610295 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5948c8-9bb4-45dd-a3f6-cae704e02206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:34.672834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5948c8-9bb4-45dd-a3f6-cae704e02206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:34.674285 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5948c8-9bb4-45dd-a3f6-cae704e02206 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:34.765242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 544/1115] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:15:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:15:34.771525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1286e6-4b77-4166-bf36-6e4792a55b4b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:34.861832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1286e6-4b77-4166-bf36-6e4792a55b4b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:34.892719 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af3157-45f4-44cc-a0ee-643d8e892b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:34.893580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3157-45f4-44cc-a0ee-643d8e892b6e None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:34.893863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3157-45f4-44cc-a0ee-643d8e892b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:34.894132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3157-45f4-44cc-a0ee-643d8e892b6e None admin] PATH_INFO: `/v3/projects/b4d927714c56431bbb020873922df22d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:34.895277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af3157-45f4-44cc-a0ee-643d8e892b6e None admin] RBAC: Authorizing `identity:get_project(project_id=b4d927714c56431bbb020873922df22d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:34.896947 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af3157-45f4-44cc-a0ee-643d8e892b6e None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:34.898639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 572/1116] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:15:34 2022] GET /identity/v3/projects/b4d927714c56431bbb020873922df22d => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:34.904490 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5948c8-9bb4-45dd-a3f6-cae704e02206 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:34.998274 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5948c8-9bb4-45dd-a3f6-cae704e02206 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:35.029555 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8398c-aa80-45a6-bd42-43639e4bca6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:35.030197 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8398c-aa80-45a6-bd42-43639e4bca6c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:35.030482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8398c-aa80-45a6-bd42-43639e4bca6c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:35.030757 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8398c-aa80-45a6-bd42-43639e4bca6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:35.031578 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8398c-aa80-45a6-bd42-43639e4bca6c None admin] RBAC: Adding query filter params (role.id=472b056b3a5047109259d7fad9133274, scope.project.id=b4d927714c56431bbb020873922df22d, user.id=0f263dc6c8344c56bb56ce1d48e7275e) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:35.031891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8398c-aa80-45a6-bd42-43639e4bca6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:35.033338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8398c-aa80-45a6-bd42-43639e4bca6c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:35.038472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 545/1117] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:15:34 2022] GET /identity/v3/role_assignments?user.id=0f263dc6c8344c56bb56ce1d48e7275e&scope.project.id=b4d927714c56431bbb020873922df22d&role.id=472b056b3a5047109259d7fad9133274 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:37.177644 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9cac4-470b-425d-ae91-65c86a3c28cf None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:37.178176 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9cac4-470b-425d-ae91-65c86a3c28cf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:37.178176 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9cac4-470b-425d-ae91-65c86a3c28cf None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:37.179564 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 573/1118] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:37.184612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788483e2-c608-48e9-bb87-3de03505af55 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:37.185016 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788483e2-c608-48e9-bb87-3de03505af55 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:37.185203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788483e2-c608-48e9-bb87-3de03505af55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:37.201789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-788483e2-c608-48e9-bb87-3de03505af55 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:37.202950 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-788483e2-c608-48e9-bb87-3de03505af55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:37.265538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 546/1119] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:37.287391 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9cac4-470b-425d-ae91-65c86a3c28cf None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:37.379410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9cac4-470b-425d-ae91-65c86a3c28cf None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:37.411108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012e06f-b61e-432b-bf55-fcd1295bcc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:37.411932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012e06f-b61e-432b-bf55-fcd1295bcc23 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:37.412210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012e06f-b61e-432b-bf55-fcd1295bcc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:37.412483 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012e06f-b61e-432b-bf55-fcd1295bcc23 None admin] PATH_INFO: `/v3/roles/472b056b3a5047109259d7fad9133274` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:37.413971 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012e06f-b61e-432b-bf55-fcd1295bcc23 None admin] RBAC: Authorizing `identity:get_role(role_id=472b056b3a5047109259d7fad9133274)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:37.415318 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012e06f-b61e-432b-bf55-fcd1295bcc23 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:37.416628 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 574/1120] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:15:37 2022] GET /identity/v3/roles/472b056b3a5047109259d7fad9133274 => generated 223 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:37.422126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788483e2-c608-48e9-bb87-3de03505af55 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:37.514124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788483e2-c608-48e9-bb87-3de03505af55 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:37.545471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cd31b-10d6-4887-ac3b-4fe51e73bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:37.546280 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cd31b-10d6-4887-ac3b-4fe51e73bb7f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:37.546561 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cd31b-10d6-4887-ac3b-4fe51e73bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:37.546831 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cd31b-10d6-4887-ac3b-4fe51e73bb7f None admin] PATH_INFO: `/v3/users/0f263dc6c8344c56bb56ce1d48e7275e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:37.548004 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cd31b-10d6-4887-ac3b-4fe51e73bb7f None admin] RBAC: Authorizing `identity:get_user(user_id=0f263dc6c8344c56bb56ce1d48e7275e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:37.549451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cd31b-10d6-4887-ac3b-4fe51e73bb7f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:37.551038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 547/1121] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:15:37 2022] GET /identity/v3/users/0f263dc6c8344c56bb56ce1d48e7275e => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:37.557160 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012e06f-b61e-432b-bf55-fcd1295bcc23 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:37.654875 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012e06f-b61e-432b-bf55-fcd1295bcc23 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:37.691428 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e2bfa-34cf-486f-8dce-e0ace40791f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:37.692280 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e2bfa-34cf-486f-8dce-e0ace40791f0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:37.692564 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e2bfa-34cf-486f-8dce-e0ace40791f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:37.692849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e2bfa-34cf-486f-8dce-e0ace40791f0 None admin] PATH_INFO: `/v3/projects/b4d927714c56431bbb020873922df22d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:37.694048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e2bfa-34cf-486f-8dce-e0ace40791f0 None admin] RBAC: Authorizing `identity:get_project(project_id=b4d927714c56431bbb020873922df22d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:37.696169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e2bfa-34cf-486f-8dce-e0ace40791f0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:37.697909 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 575/1122] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:15:37 2022] GET /identity/v3/projects/b4d927714c56431bbb020873922df22d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:37.703858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cd31b-10d6-4887-ac3b-4fe51e73bb7f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:37.796704 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cd31b-10d6-4887-ac3b-4fe51e73bb7f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:37.828129 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164a623-2f94-407b-a49a-70b0eb449f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:37.829013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164a623-2f94-407b-a49a-70b0eb449f08 None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:37.829301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164a623-2f94-407b-a49a-70b0eb449f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:37.829577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164a623-2f94-407b-a49a-70b0eb449f08 None admin] PATH_INFO: `/v3/projects/b4d927714c56431bbb020873922df22d/users/0f263dc6c8344c56bb56ce1d48e7275e/roles/472b056b3a5047109259d7fad9133274` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:37.831727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164a623-2f94-407b-a49a-70b0eb449f08 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4d927714c56431bbb020873922df22d, user_id=0f263dc6c8344c56bb56ce1d48e7275e, role_id=472b056b3a5047109259d7fad9133274)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:37.833181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164a623-2f94-407b-a49a-70b0eb449f08 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:37.844852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 548/1123] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:15:37 2022] PUT /identity/v3/projects/b4d927714c56431bbb020873922df22d/users/0f263dc6c8344c56bb56ce1d48e7275e/roles/472b056b3a5047109259d7fad9133274 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:15:40.021666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccecb3-1ed0-4e15-b251-0fb0dc85b9c2 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:40.022131 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccecb3-1ed0-4e15-b251-0fb0dc85b9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:40.022226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccecb3-1ed0-4e15-b251-0fb0dc85b9c2 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:40.023670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 576/1124] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:40.029133 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc8933-c807-4255-a818-3aba0458358c None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:40.029519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc8933-c807-4255-a818-3aba0458358c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:40.029691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc8933-c807-4255-a818-3aba0458358c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:40.046228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-0fbc8933-c807-4255-a818-3aba0458358c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:40.047419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0fbc8933-c807-4255-a818-3aba0458358c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:40.109139 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 549/1125] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:40.132022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccecb3-1ed0-4e15-b251-0fb0dc85b9c2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:40.224981 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccecb3-1ed0-4e15-b251-0fb0dc85b9c2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:40.257048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf008fb-1919-4a49-885b-359991eed81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:40.257865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf008fb-1919-4a49-885b-359991eed81a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:40.258142 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf008fb-1919-4a49-885b-359991eed81a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:40.258412 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf008fb-1919-4a49-885b-359991eed81a None admin] PATH_INFO: `/v3/roles/472b056b3a5047109259d7fad9133274` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:40.259849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf008fb-1919-4a49-885b-359991eed81a None admin] RBAC: Authorizing `identity:get_role(role_id=472b056b3a5047109259d7fad9133274)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:40.261223 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf008fb-1919-4a49-885b-359991eed81a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:40.262535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 577/1126] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:15:40 2022] GET /identity/v3/roles/472b056b3a5047109259d7fad9133274 => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:40.268110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc8933-c807-4255-a818-3aba0458358c None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:40.361707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc8933-c807-4255-a818-3aba0458358c None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:40.392871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f88ba1-bae4-40cd-b11a-cfe500c9c510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:40.393754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f88ba1-bae4-40cd-b11a-cfe500c9c510 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:40.394038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f88ba1-bae4-40cd-b11a-cfe500c9c510 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:40.394311 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f88ba1-bae4-40cd-b11a-cfe500c9c510 None admin] PATH_INFO: `/v3/users/0f263dc6c8344c56bb56ce1d48e7275e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:40.395478 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f88ba1-bae4-40cd-b11a-cfe500c9c510 None admin] RBAC: Authorizing `identity:get_user(user_id=0f263dc6c8344c56bb56ce1d48e7275e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:40.397184 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f88ba1-bae4-40cd-b11a-cfe500c9c510 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:40.398826 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 550/1127] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:15:40 2022] GET /identity/v3/users/0f263dc6c8344c56bb56ce1d48e7275e => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:40.404561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf008fb-1919-4a49-885b-359991eed81a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:40.497474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf008fb-1919-4a49-885b-359991eed81a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:40.528786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af066c-9eec-4a58-ba80-8369024a6343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:40.529381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af066c-9eec-4a58-ba80-8369024a6343 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:40.529661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af066c-9eec-4a58-ba80-8369024a6343 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:40.529929 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af066c-9eec-4a58-ba80-8369024a6343 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:40.591433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af066c-9eec-4a58-ba80-8369024a6343 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:40.592876 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af066c-9eec-4a58-ba80-8369024a6343 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:40.683472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 578/1128] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:15:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:15:40.689236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f88ba1-bae4-40cd-b11a-cfe500c9c510 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:40.780592 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f88ba1-bae4-40cd-b11a-cfe500c9c510 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:40.811726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65a649-5202-42fb-a863-37bfdc74ddc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:40.812559 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65a649-5202-42fb-a863-37bfdc74ddc5 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:40.812839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65a649-5202-42fb-a863-37bfdc74ddc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:40.813138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65a649-5202-42fb-a863-37bfdc74ddc5 None admin] PATH_INFO: `/v3/projects/b4d927714c56431bbb020873922df22d` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:40.814287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65a649-5202-42fb-a863-37bfdc74ddc5 None admin] RBAC: Authorizing `identity:get_project(project_id=b4d927714c56431bbb020873922df22d)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:40.815697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65a649-5202-42fb-a863-37bfdc74ddc5 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:40.817385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 551/1129] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:15:40 2022] GET /identity/v3/projects/b4d927714c56431bbb020873922df22d => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:40.823910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af066c-9eec-4a58-ba80-8369024a6343 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:40.915547 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af066c-9eec-4a58-ba80-8369024a6343 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:40.946668 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e2881-7f77-44e1-bf95-0ddff332a9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:40.947309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e2881-7f77-44e1-bf95-0ddff332a9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:40.947591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e2881-7f77-44e1-bf95-0ddff332a9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:40.947865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e2881-7f77-44e1-bf95-0ddff332a9e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:40.948680 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e2881-7f77-44e1-bf95-0ddff332a9e6 None admin] RBAC: Adding query filter params (role.id=472b056b3a5047109259d7fad9133274, scope.project.id=b4d927714c56431bbb020873922df22d, user.id=0f263dc6c8344c56bb56ce1d48e7275e) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:40.949018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e2881-7f77-44e1-bf95-0ddff332a9e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:40.950442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e2881-7f77-44e1-bf95-0ddff332a9e6 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:40.955958 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 579/1130] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:15:40 2022] GET /identity/v3/role_assignments?user.id=0f263dc6c8344c56bb56ce1d48e7275e&scope.project.id=b4d927714c56431bbb020873922df22d&role.id=472b056b3a5047109259d7fad9133274 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:43.157860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c52a6-5657-4f43-ae2d-f422f2f836e0 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:43.158403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c52a6-5657-4f43-ae2d-f422f2f836e0 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:43.158403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c52a6-5657-4f43-ae2d-f422f2f836e0 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:43.159779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 552/1131] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:43.165532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aad50-1d7c-4a61-bd7b-421f118bd54c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:43.165951 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aad50-1d7c-4a61-bd7b-421f118bd54c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:43.166086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47aad50-1d7c-4a61-bd7b-421f118bd54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:43.182817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a47aad50-1d7c-4a61-bd7b-421f118bd54c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:43.183988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a47aad50-1d7c-4a61-bd7b-421f118bd54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:43.246684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 580/1132] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:15:43.269819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c52a6-5657-4f43-ae2d-f422f2f836e0 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:43.366597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c52a6-5657-4f43-ae2d-f422f2f836e0 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:43.399590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d880027-1c47-495b-b01e-cb28393e0d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:43.400372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d880027-1c47-495b-b01e-cb28393e0d84 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:43.400657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d880027-1c47-495b-b01e-cb28393e0d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:43.400931 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d880027-1c47-495b-b01e-cb28393e0d84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:43.402125 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d880027-1c47-495b-b01e-cb28393e0d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:43.403574 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d880027-1c47-495b-b01e-cb28393e0d84 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:43.405206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 553/1133] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:43.411076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aad50-1d7c-4a61-bd7b-421f118bd54c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:43.503089 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47aad50-1d7c-4a61-bd7b-421f118bd54c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:43.534807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbddb51a-711d-459d-8d50-f4be5b749e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:43.535450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddb51a-711d-459d-8d50-f4be5b749e17 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:43.535737 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddb51a-711d-459d-8d50-f4be5b749e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:43.536017 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbddb51a-711d-459d-8d50-f4be5b749e17 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:43.536724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddb51a-711d-459d-8d50-f4be5b749e17 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:43.538177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbddb51a-711d-459d-8d50-f4be5b749e17 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:43.562001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 581/1134] 10.222.0.61 () {60 vars in 1141 bytes} [Tue May 10 20:15:43 2022] POST /identity/v3/projects => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:15:45.781962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6d1cc-dbdb-45f8-b1c2-ace7868a967c None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:45.782525 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6d1cc-dbdb-45f8-b1c2-ace7868a967c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:45.782525 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6d1cc-dbdb-45f8-b1c2-ace7868a967c None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:45.783848 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 554/1135] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:45.789058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3931aad-ce24-4e22-8981-f1da5442b1f8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:45.789429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3931aad-ce24-4e22-8981-f1da5442b1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:45.789617 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3931aad-ce24-4e22-8981-f1da5442b1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:45.806070 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a3931aad-ce24-4e22-8981-f1da5442b1f8 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:45.807227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a3931aad-ce24-4e22-8981-f1da5442b1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:45.868570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 582/1136] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:45.892463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6d1cc-dbdb-45f8-b1c2-ace7868a967c None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:45.986876 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6d1cc-dbdb-45f8-b1c2-ace7868a967c None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:46.019811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb947d-cb48-47a0-9907-5223554c946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:46.020594 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb947d-cb48-47a0-9907-5223554c946f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:46.021143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb947d-cb48-47a0-9907-5223554c946f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:46.021422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb947d-cb48-47a0-9907-5223554c946f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:46.022583 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb947d-cb48-47a0-9907-5223554c946f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:46.024013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb947d-cb48-47a0-9907-5223554c946f None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:46.025657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 555/1137] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:15:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:46.032395 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3931aad-ce24-4e22-8981-f1da5442b1f8 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:46.127266 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3931aad-ce24-4e22-8981-f1da5442b1f8 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:46.158593 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025ef8c-8b66-49e5-b108-8285e2f08ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:46.159249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025ef8c-8b66-49e5-b108-8285e2f08ee9 None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:46.159532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025ef8c-8b66-49e5-b108-8285e2f08ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:46.159808 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025ef8c-8b66-49e5-b108-8285e2f08ee9 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:46.160509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025ef8c-8b66-49e5-b108-8285e2f08ee9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:46.161965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025ef8c-8b66-49e5-b108-8285e2f08ee9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:46.181613 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 583/1138] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:15:46 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:15:48.414685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadd159-d41b-49d8-a6f1-149113d26194 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:48.415209 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadd159-d41b-49d8-a6f1-149113d26194 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:48.415725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaadd159-d41b-49d8-a6f1-149113d26194 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:48.417024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 556/1139] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:48.422377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68f514-78fb-4bcb-8069-ae198d53a92d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:48.422749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68f514-78fb-4bcb-8069-ae198d53a92d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:48.422942 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68f514-78fb-4bcb-8069-ae198d53a92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:48.440158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4a68f514-78fb-4bcb-8069-ae198d53a92d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:48.441379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4a68f514-78fb-4bcb-8069-ae198d53a92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:48.503263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 584/1140] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:48.527480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadd159-d41b-49d8-a6f1-149113d26194 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:48.621150 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaadd159-d41b-49d8-a6f1-149113d26194 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:48.653249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3431ab-0ce7-4144-b1dd-8e558d355ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:48.654019 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3431ab-0ce7-4144-b1dd-8e558d355ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:48.654299 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3431ab-0ce7-4144-b1dd-8e558d355ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:48.654570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3431ab-0ce7-4144-b1dd-8e558d355ca0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:48.664097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3431ab-0ce7-4144-b1dd-8e558d355ca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-1a3431ab-0ce7-4144-b1dd-8e558d355ca0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:15:48.671672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:48.672795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:48.674113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:48.674113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:48.674113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:48.674113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:48.674113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:15:48.674113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:15:48.674113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:15:48.674113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:15:48.674113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:15:48.674113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:15:48.674113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:15:48.674113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:48.674113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 557/1141] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:15:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:48.678500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68f514-78fb-4bcb-8069-ae198d53a92d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:48.773128 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68f514-78fb-4bcb-8069-ae198d53a92d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:48.804258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a71ec-ba2f-4e2f-9d35-58aa74e9dc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:48.804910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a71ec-ba2f-4e2f-9d35-58aa74e9dc52 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:48.805222 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a71ec-ba2f-4e2f-9d35-58aa74e9dc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:48.805497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a71ec-ba2f-4e2f-9d35-58aa74e9dc52 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:48.806234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a71ec-ba2f-4e2f-9d35-58aa74e9dc52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:48.806541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a71ec-ba2f-4e2f-9d35-58aa74e9dc52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:48.807900 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a71ec-ba2f-4e2f-9d35-58aa74e9dc52 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:48.815482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 585/1142] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:15:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:48.821597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3431ab-0ce7-4144-b1dd-8e558d355ca0 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:48.913868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3431ab-0ce7-4144-b1dd-8e558d355ca0 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:48.945483 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4de470-eb6f-4382-a6f9-ed0c66c2cdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:48.946290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4de470-eb6f-4382-a6f9-ed0c66c2cdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:48.946573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4de470-eb6f-4382-a6f9-ed0c66c2cdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:48.946847 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4de470-eb6f-4382-a6f9-ed0c66c2cdf7 None admin] PATH_INFO: `/v3/users/ba7dee60f8634a8e81acbe5bcf27ddcf` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:48.959070 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4de470-eb6f-4382-a6f9-ed0c66c2cdf7 None admin] RBAC: Authorizing `identity:get_user(user_id=ba7dee60f8634a8e81acbe5bcf27ddcf)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:48.960550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4de470-eb6f-4382-a6f9-ed0c66c2cdf7 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:48.962205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 558/1143] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:15:48 2022] GET /identity/v3/users/ba7dee60f8634a8e81acbe5bcf27ddcf => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:48.968141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a71ec-ba2f-4e2f-9d35-58aa74e9dc52 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:49.062312 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a71ec-ba2f-4e2f-9d35-58aa74e9dc52 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:49.093865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ed61b-0938-4bf9-a82e-d0e0aff028a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:49.094505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ed61b-0938-4bf9-a82e-d0e0aff028a7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:49.094788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ed61b-0938-4bf9-a82e-d0e0aff028a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:49.095063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ed61b-0938-4bf9-a82e-d0e0aff028a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:49.156379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ed61b-0938-4bf9-a82e-d0e0aff028a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:49.157897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ed61b-0938-4bf9-a82e-d0e0aff028a7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:49.246265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 586/1144] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:15:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:15:49.252184 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4de470-eb6f-4382-a6f9-ed0c66c2cdf7 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:49.344165 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4de470-eb6f-4382-a6f9-ed0c66c2cdf7 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:49.379144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038dcda-3d90-4eb7-a6f8-54feb183d1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:49.379979 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038dcda-3d90-4eb7-a6f8-54feb183d1ca None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:49.380258 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038dcda-3d90-4eb7-a6f8-54feb183d1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:49.380584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038dcda-3d90-4eb7-a6f8-54feb183d1ca None admin] PATH_INFO: `/v3/projects/2389561c941c46a4bb26056369a54cb5` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:49.382255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038dcda-3d90-4eb7-a6f8-54feb183d1ca None admin] RBAC: Authorizing `identity:get_project(project_id=2389561c941c46a4bb26056369a54cb5)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:49.383710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038dcda-3d90-4eb7-a6f8-54feb183d1ca None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:49.385372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 559/1145] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:15:49 2022] GET /identity/v3/projects/2389561c941c46a4bb26056369a54cb5 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:49.391211 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ed61b-0938-4bf9-a82e-d0e0aff028a7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:49.482047 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ed61b-0938-4bf9-a82e-d0e0aff028a7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:49.513593 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bd4a6-1b09-4664-89ba-b532da8c694d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:49.514165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bd4a6-1b09-4664-89ba-b532da8c694d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:49.514444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bd4a6-1b09-4664-89ba-b532da8c694d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:49.514716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bd4a6-1b09-4664-89ba-b532da8c694d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:49.515521 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bd4a6-1b09-4664-89ba-b532da8c694d None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=2389561c941c46a4bb26056369a54cb5, user.id=ba7dee60f8634a8e81acbe5bcf27ddcf) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:49.515829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bd4a6-1b09-4664-89ba-b532da8c694d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:49.517274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bd4a6-1b09-4664-89ba-b532da8c694d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:49.522596 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 587/1146] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:15:49 2022] GET /identity/v3/role_assignments?user.id=ba7dee60f8634a8e81acbe5bcf27ddcf&scope.project.id=2389561c941c46a4bb26056369a54cb5&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:51.683940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d0d5-9ee7-4ce5-b561-c4d7e69a8a41 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:51.684491 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d0d5-9ee7-4ce5-b561-c4d7e69a8a41 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:51.684491 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d0d5-9ee7-4ce5-b561-c4d7e69a8a41 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:51.685870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 560/1147] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:51.691086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951f371-b694-4d8e-943b-239b013578de None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:51.691520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951f371-b694-4d8e-943b-239b013578de None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:51.691625 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951f371-b694-4d8e-943b-239b013578de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:51.707693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b951f371-b694-4d8e-943b-239b013578de None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:51.708831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b951f371-b694-4d8e-943b-239b013578de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:51.770597 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 588/1148] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:51.793491 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000d0d5-9ee7-4ce5-b561-c4d7e69a8a41 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:51.888026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000d0d5-9ee7-4ce5-b561-c4d7e69a8a41 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:51.920893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74448b06-416d-4b63-97b4-169246ee4a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:51.921694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74448b06-416d-4b63-97b4-169246ee4a9f None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:51.921974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74448b06-416d-4b63-97b4-169246ee4a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:51.922244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74448b06-416d-4b63-97b4-169246ee4a9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:51.932181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74448b06-416d-4b63-97b4-169246ee4a9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-74448b06-416d-4b63-97b4-169246ee4a9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:15:51.939683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:51.940793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:51.941872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:51.941872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:51.941872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:51.941872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:51.941872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:15:51.941872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:15:51.941872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:15:51.941872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:15:51.941872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:15:51.941872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:15:51.941872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:15:51.941872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:51.941872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 561/1149] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:15:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:51.946821 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951f371-b694-4d8e-943b-239b013578de None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:52.038806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951f371-b694-4d8e-943b-239b013578de None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:52.072624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f1ef0-e7c1-4915-bb1a-b2304e0dbda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:52.073309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f1ef0-e7c1-4915-bb1a-b2304e0dbda0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:52.073590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f1ef0-e7c1-4915-bb1a-b2304e0dbda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:52.073861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f1ef0-e7c1-4915-bb1a-b2304e0dbda0 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:52.074595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f1ef0-e7c1-4915-bb1a-b2304e0dbda0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:52.074900 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f1ef0-e7c1-4915-bb1a-b2304e0dbda0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:52.076269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f1ef0-e7c1-4915-bb1a-b2304e0dbda0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:52.083917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 589/1150] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:15:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:52.090403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74448b06-416d-4b63-97b4-169246ee4a9f None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:52.183741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74448b06-416d-4b63-97b4-169246ee4a9f None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:52.214141 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416db71-5f7d-4ebe-bf0c-d045d3ec1510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:52.214924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416db71-5f7d-4ebe-bf0c-d045d3ec1510 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:52.215206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416db71-5f7d-4ebe-bf0c-d045d3ec1510 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:52.215479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416db71-5f7d-4ebe-bf0c-d045d3ec1510 None admin] PATH_INFO: `/v3/users/ba7dee60f8634a8e81acbe5bcf27ddcf` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:52.216768 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416db71-5f7d-4ebe-bf0c-d045d3ec1510 None admin] RBAC: Authorizing `identity:get_user(user_id=ba7dee60f8634a8e81acbe5bcf27ddcf)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:52.218212 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416db71-5f7d-4ebe-bf0c-d045d3ec1510 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:52.219782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 562/1151] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:15:52 2022] GET /identity/v3/users/ba7dee60f8634a8e81acbe5bcf27ddcf => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:52.225305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f1ef0-e7c1-4915-bb1a-b2304e0dbda0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:52.318495 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f1ef0-e7c1-4915-bb1a-b2304e0dbda0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:52.348932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e91ca7-1822-45e7-9b39-04f28b60fea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:52.349801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e91ca7-1822-45e7-9b39-04f28b60fea1 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:52.350082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e91ca7-1822-45e7-9b39-04f28b60fea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:52.350353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e91ca7-1822-45e7-9b39-04f28b60fea1 None admin] PATH_INFO: `/v3/projects/2389561c941c46a4bb26056369a54cb5` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:52.352015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e91ca7-1822-45e7-9b39-04f28b60fea1 None admin] RBAC: Authorizing `identity:get_project(project_id=2389561c941c46a4bb26056369a54cb5)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:52.353469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e91ca7-1822-45e7-9b39-04f28b60fea1 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:52.355099 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 590/1152] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:15:52 2022] GET /identity/v3/projects/2389561c941c46a4bb26056369a54cb5 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:52.360672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416db71-5f7d-4ebe-bf0c-d045d3ec1510 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:52.452137 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416db71-5f7d-4ebe-bf0c-d045d3ec1510 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:52.483621 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c0d85-a24b-48df-9e3f-e3731716305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:52.484427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0d85-a24b-48df-9e3f-e3731716305b None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:52.484705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0d85-a24b-48df-9e3f-e3731716305b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:52.485003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c0d85-a24b-48df-9e3f-e3731716305b None admin] PATH_INFO: `/v3/projects/2389561c941c46a4bb26056369a54cb5/users/ba7dee60f8634a8e81acbe5bcf27ddcf/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:52.486936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c0d85-a24b-48df-9e3f-e3731716305b None admin] RBAC: Authorizing `identity:create_grant(project_id=2389561c941c46a4bb26056369a54cb5, user_id=ba7dee60f8634a8e81acbe5bcf27ddcf, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:52.488327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c0d85-a24b-48df-9e3f-e3731716305b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:52.500381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 563/1153] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:15:52 2022] PUT /identity/v3/projects/2389561c941c46a4bb26056369a54cb5/users/ba7dee60f8634a8e81acbe5bcf27ddcf/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:15:54.677183 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e405-da89-45c7-8d30-c305388dbcc2 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:54.677715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e405-da89-45c7-8d30-c305388dbcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:54.677826 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637e405-da89-45c7-8d30-c305388dbcc2 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:54.679634 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 591/1154] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:54.685044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c493e9-e9bf-40a8-8598-15c0b63d0f72 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:54.685487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c493e9-e9bf-40a8-8598-15c0b63d0f72 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:54.685610 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c493e9-e9bf-40a8-8598-15c0b63d0f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:54.702179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-96c493e9-e9bf-40a8-8598-15c0b63d0f72 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:54.703334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-96c493e9-e9bf-40a8-8598-15c0b63d0f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:54.764842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 564/1155] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:54.787608 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637e405-da89-45c7-8d30-c305388dbcc2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:54.881251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637e405-da89-45c7-8d30-c305388dbcc2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:54.912819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee72241-0695-4c0d-9b9e-88c8718f8d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:54.913616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee72241-0695-4c0d-9b9e-88c8718f8d51 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:54.913893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee72241-0695-4c0d-9b9e-88c8718f8d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:54.914162 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee72241-0695-4c0d-9b9e-88c8718f8d51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:54.923614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee72241-0695-4c0d-9b9e-88c8718f8d51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-eee72241-0695-4c0d-9b9e-88c8718f8d51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:15:54.931627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:54.932709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:54.933746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:54.933746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:54.933746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:54.933746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:54.933746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:15:54.933746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:15:54.933746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:15:54.933746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:15:54.933746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:15:54.933746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:15:54.933746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:15:54.933746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:15:54.933746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 592/1156] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:54.938537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c493e9-e9bf-40a8-8598-15c0b63d0f72 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:55.031092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c493e9-e9bf-40a8-8598-15c0b63d0f72 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:55.062523 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebed880-4e19-420d-b536-d6d1208a08ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:55.063183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebed880-4e19-420d-b536-d6d1208a08ba None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:55.063465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebed880-4e19-420d-b536-d6d1208a08ba None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:55.063741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebed880-4e19-420d-b536-d6d1208a08ba None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:55.064481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebed880-4e19-420d-b536-d6d1208a08ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:55.064787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebed880-4e19-420d-b536-d6d1208a08ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:55.066193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebed880-4e19-420d-b536-d6d1208a08ba None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:55.074296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 565/1157] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:55.081095 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee72241-0695-4c0d-9b9e-88c8718f8d51 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:55.172067 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee72241-0695-4c0d-9b9e-88c8718f8d51 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:55.202791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32615f-9ea3-4e68-bd88-96451c2ba59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:55.203581 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32615f-9ea3-4e68-bd88-96451c2ba59c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:55.203860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32615f-9ea3-4e68-bd88-96451c2ba59c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:55.204132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32615f-9ea3-4e68-bd88-96451c2ba59c None admin] PATH_INFO: `/v3/users/ba7dee60f8634a8e81acbe5bcf27ddcf` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:55.205429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32615f-9ea3-4e68-bd88-96451c2ba59c None admin] RBAC: Authorizing `identity:get_user(user_id=ba7dee60f8634a8e81acbe5bcf27ddcf)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:55.206855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32615f-9ea3-4e68-bd88-96451c2ba59c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:55.208451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 593/1158] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:15:55 2022] GET /identity/v3/users/ba7dee60f8634a8e81acbe5bcf27ddcf => generated 286 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:55.214515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebed880-4e19-420d-b536-d6d1208a08ba None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:55.306167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebed880-4e19-420d-b536-d6d1208a08ba None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:55.337536 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87d2c1-e390-4fdd-b325-16aa19e094d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:55.338165 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87d2c1-e390-4fdd-b325-16aa19e094d9 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:55.338450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87d2c1-e390-4fdd-b325-16aa19e094d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:55.338721 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87d2c1-e390-4fdd-b325-16aa19e094d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:55.407047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87d2c1-e390-4fdd-b325-16aa19e094d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:55.408480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87d2c1-e390-4fdd-b325-16aa19e094d9 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:55.500595 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 566/1159] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:15:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 20:15:55.506376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32615f-9ea3-4e68-bd88-96451c2ba59c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:55.598026 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32615f-9ea3-4e68-bd88-96451c2ba59c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:55.628811 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ce33f-dbc5-40af-9acf-d134f9144d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:55.629670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ce33f-dbc5-40af-9acf-d134f9144d5b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:55.629953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ce33f-dbc5-40af-9acf-d134f9144d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:55.630231 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ce33f-dbc5-40af-9acf-d134f9144d5b None admin] PATH_INFO: `/v3/projects/2389561c941c46a4bb26056369a54cb5` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:55.631381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ce33f-dbc5-40af-9acf-d134f9144d5b None admin] RBAC: Authorizing `identity:get_project(project_id=2389561c941c46a4bb26056369a54cb5)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:55.632809 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645ce33f-dbc5-40af-9acf-d134f9144d5b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:55.634481 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 594/1160] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:15:55 2022] GET /identity/v3/projects/2389561c941c46a4bb26056369a54cb5 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:15:55.640527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87d2c1-e390-4fdd-b325-16aa19e094d9 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:55.733528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87d2c1-e390-4fdd-b325-16aa19e094d9 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:55.768366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4510fe3-caf9-45cf-bfa6-ac801ceba0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:55.768952 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4510fe3-caf9-45cf-bfa6-ac801ceba0fe None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:55.769271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4510fe3-caf9-45cf-bfa6-ac801ceba0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:55.769546 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4510fe3-caf9-45cf-bfa6-ac801ceba0fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:55.770379 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4510fe3-caf9-45cf-bfa6-ac801ceba0fe None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=2389561c941c46a4bb26056369a54cb5, user.id=ba7dee60f8634a8e81acbe5bcf27ddcf) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:55.770931 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4510fe3-caf9-45cf-bfa6-ac801ceba0fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:55.772364 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4510fe3-caf9-45cf-bfa6-ac801ceba0fe None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:55.778158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 567/1161] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:15:55 2022] GET /identity/v3/role_assignments?user.id=ba7dee60f8634a8e81acbe5bcf27ddcf&scope.project.id=2389561c941c46a4bb26056369a54cb5&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:15:57.960954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77b330-9e9a-4e9a-9cfb-cdc23fc122f2 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:57.961523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77b330-9e9a-4e9a-9cfb-cdc23fc122f2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:57.961523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77b330-9e9a-4e9a-9cfb-cdc23fc122f2 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:57.962865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 595/1162] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:15:57.968149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91650-b175-4336-b782-565d30d193e6 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:57.968576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91650-b175-4336-b782-565d30d193e6 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:57.968702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91650-b175-4336-b782-565d30d193e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:57.985739 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-5db91650-b175-4336-b782-565d30d193e6 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:15:57.986895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5db91650-b175-4336-b782-565d30d193e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:15:58.050694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 568/1163] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:15:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:15:58.072767 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77b330-9e9a-4e9a-9cfb-cdc23fc122f2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:58.166969 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77b330-9e9a-4e9a-9cfb-cdc23fc122f2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:58.198065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dcf4b-6d85-4298-a050-4512764fede0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:58.198691 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dcf4b-6d85-4298-a050-4512764fede0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:58.198973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dcf4b-6d85-4298-a050-4512764fede0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:58.199247 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dcf4b-6d85-4298-a050-4512764fede0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:58.260686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dcf4b-6d85-4298-a050-4512764fede0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:58.262097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dcf4b-6d85-4298-a050-4512764fede0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:58.351440 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 596/1164] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:15:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:15:58.357357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db91650-b175-4336-b782-565d30d193e6 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:58.450230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db91650-b175-4336-b782-565d30d193e6 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:58.481234 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd535b-cc8a-4eee-909d-8fbdae16c3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:58.482018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd535b-cc8a-4eee-909d-8fbdae16c3cd None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:58.482305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd535b-cc8a-4eee-909d-8fbdae16c3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:58.482584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd535b-cc8a-4eee-909d-8fbdae16c3cd None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:58.488997 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd535b-cc8a-4eee-909d-8fbdae16c3cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:58.490439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd535b-cc8a-4eee-909d-8fbdae16c3cd None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-9bfd535b-cc8a-4eee-909d-8fbdae16c3cd None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:15:58.504587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:15:58.505828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:15:58.507459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 569/1165] 10.222.0.61 () {56 vars in 1117 bytes} [Tue May 10 20:15:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:15:58.512129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dcf4b-6d85-4298-a050-4512764fede0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:15:58.603104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dcf4b-6d85-4298-a050-4512764fede0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:15:58.634398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3e734-e276-4724-b4e7-260cae351619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:15:58.635036 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e734-e276-4724-b4e7-260cae351619 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:15:58.635317 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e734-e276-4724-b4e7-260cae351619 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:15:58.635592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e734-e276-4724-b4e7-260cae351619 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:15:58.636884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3e734-e276-4724-b4e7-260cae351619 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:15:58.637218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3e734-e276-4724-b4e7-260cae351619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:15:58.638573 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3e734-e276-4724-b4e7-260cae351619 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:15:58.645359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 597/1166] 10.222.0.61 () {56 vars in 1115 bytes} [Tue May 10 20:15:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:16:00.810054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb1cfd-a28c-4a09-b121-02ba99727750 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:00.810620 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb1cfd-a28c-4a09-b121-02ba99727750 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:00.810620 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb1cfd-a28c-4a09-b121-02ba99727750 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:00.811951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 570/1167] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:16:00.817481 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c99861-083b-45ba-b8c0-997c2500a825 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:00.817858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c99861-083b-45ba-b8c0-997c2500a825 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:00.818039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c99861-083b-45ba-b8c0-997c2500a825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:00.834677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c6c99861-083b-45ba-b8c0-997c2500a825 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:16:00.835849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c6c99861-083b-45ba-b8c0-997c2500a825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:16:00.896808 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 598/1168] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:16:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:16:00.918972 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb1cfd-a28c-4a09-b121-02ba99727750 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:01.014787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb1cfd-a28c-4a09-b121-02ba99727750 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:01.046162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4cf2d-b727-4fa0-a8a7-357c60cec777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:01.046804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4cf2d-b727-4fa0-a8a7-357c60cec777 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:01.047082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4cf2d-b727-4fa0-a8a7-357c60cec777 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:01.047352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4cf2d-b727-4fa0-a8a7-357c60cec777 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:01.048087 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4cf2d-b727-4fa0-a8a7-357c60cec777 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:01.049472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4cf2d-b727-4fa0-a8a7-357c60cec777 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:01.064224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 571/1169] 10.222.0.61 () {60 vars in 1138 bytes} [Tue May 10 20:16:00 2022] POST /identity/v3/domains => generated 267 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:16:03.280465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529ce5e-ac26-4f56-ab54-2086d846f668 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:03.281038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529ce5e-ac26-4f56-ab54-2086d846f668 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:03.281038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529ce5e-ac26-4f56-ab54-2086d846f668 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:03.282385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 599/1170] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:16:03.287994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b3c02-6059-48fc-9521-2a261dd25b32 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:03.288416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b3c02-6059-48fc-9521-2a261dd25b32 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:03.288551 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b3c02-6059-48fc-9521-2a261dd25b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:03.305212 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6c8b3c02-6059-48fc-9521-2a261dd25b32 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:16:03.306373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6c8b3c02-6059-48fc-9521-2a261dd25b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:16:03.367444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 572/1171] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:16:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:16:03.389766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529ce5e-ac26-4f56-ab54-2086d846f668 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:03.483321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529ce5e-ac26-4f56-ab54-2086d846f668 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:03.514550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e53b32-2db7-4f01-828b-bc78d8500dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:03.515385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e53b32-2db7-4f01-828b-bc78d8500dea None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:03.515664 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e53b32-2db7-4f01-828b-bc78d8500dea None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:03.515938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e53b32-2db7-4f01-828b-bc78d8500dea None admin] PATH_INFO: `/v3/domains/1a25428948764aca9a8a994cd3f3c31d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:03.526119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e53b32-2db7-4f01-828b-bc78d8500dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=1a25428948764aca9a8a994cd3f3c31d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:03.527561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e53b32-2db7-4f01-828b-bc78d8500dea None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:03.529161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 600/1172] 10.222.0.61 () {56 vars in 1183 bytes} [Tue May 10 20:16:03 2022] GET /identity/v3/domains/1a25428948764aca9a8a994cd3f3c31d => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:16:03.537031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b3c02-6059-48fc-9521-2a261dd25b32 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:03.631865 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b3c02-6059-48fc-9521-2a261dd25b32 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:03.664043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb949e-1a49-4f81-ad15-6bee36b7eaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:03.664688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb949e-1a49-4f81-ad15-6bee36b7eaeb None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:03.664992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb949e-1a49-4f81-ad15-6bee36b7eaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:03.665272 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb949e-1a49-4f81-ad15-6bee36b7eaeb None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:03.665966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb949e-1a49-4f81-ad15-6bee36b7eaeb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:03.667382 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb949e-1a49-4f81-ad15-6bee36b7eaeb None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:03.691934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 573/1173] 10.222.0.61 () {60 vars in 1141 bytes} [Tue May 10 20:16:03 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:16:05.883573 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e338433-37f0-4bae-937c-0b029c20f873 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:05.884139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e338433-37f0-4bae-937c-0b029c20f873 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:05.884139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e338433-37f0-4bae-937c-0b029c20f873 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:05.885506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 601/1174] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:16:05.890741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c063760-f642-48a9-86d3-e959e34d5a55 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:05.891170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c063760-f642-48a9-86d3-e959e34d5a55 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:05.891301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c063760-f642-48a9-86d3-e959e34d5a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:05.907872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6c063760-f642-48a9-86d3-e959e34d5a55 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:16:05.909073 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6c063760-f642-48a9-86d3-e959e34d5a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:16:05.971645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 574/1175] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:16:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:16:05.996653 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e338433-37f0-4bae-937c-0b029c20f873 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:06.093492 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e338433-37f0-4bae-937c-0b029c20f873 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:06.124840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897d37f-e95b-4004-b2b4-c0aeac2dc22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:06.125704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897d37f-e95b-4004-b2b4-c0aeac2dc22d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:06.125984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897d37f-e95b-4004-b2b4-c0aeac2dc22d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:06.126255 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897d37f-e95b-4004-b2b4-c0aeac2dc22d None admin] PATH_INFO: `/v3/domains/1a25428948764aca9a8a994cd3f3c31d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:06.127382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897d37f-e95b-4004-b2b4-c0aeac2dc22d None admin] RBAC: Authorizing `identity:get_domain(domain_id=1a25428948764aca9a8a994cd3f3c31d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:06.128812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897d37f-e95b-4004-b2b4-c0aeac2dc22d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:06.130420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 602/1176] 10.222.0.61 () {56 vars in 1183 bytes} [Tue May 10 20:16:05 2022] GET /identity/v3/domains/1a25428948764aca9a8a994cd3f3c31d => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:16:06.136235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c063760-f642-48a9-86d3-e959e34d5a55 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:06.228119 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c063760-f642-48a9-86d3-e959e34d5a55 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:06.260379 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477ea9c-84f6-456e-b220-75f6b3e1e0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:06.261140 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477ea9c-84f6-456e-b220-75f6b3e1e0b3 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:06.261419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477ea9c-84f6-456e-b220-75f6b3e1e0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:06.261688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477ea9c-84f6-456e-b220-75f6b3e1e0b3 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:06.262378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477ea9c-84f6-456e-b220-75f6b3e1e0b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:06.263864 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477ea9c-84f6-456e-b220-75f6b3e1e0b3 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:06.283119 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 575/1177] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:16:06 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:16:08.509892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38760c7-7c57-474b-b287-2a39fde67acd None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:08.510431 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38760c7-7c57-474b-b287-2a39fde67acd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:08.510431 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38760c7-7c57-474b-b287-2a39fde67acd None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:08.511771 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 603/1178] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:16:08.517060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe80676-6908-427d-ad0d-f906486b1c62 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:08.517484 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe80676-6908-427d-ad0d-f906486b1c62 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:08.517627 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe80676-6908-427d-ad0d-f906486b1c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:08.534638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-5fe80676-6908-427d-ad0d-f906486b1c62 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:16:08.535806 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5fe80676-6908-427d-ad0d-f906486b1c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:16:08.598464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 576/1179] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:16:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:16:08.620653 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38760c7-7c57-474b-b287-2a39fde67acd None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:08.714724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38760c7-7c57-474b-b287-2a39fde67acd None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:08.745248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82e846-5649-4744-a448-405459c23bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:08.746011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82e846-5649-4744-a448-405459c23bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:08.746290 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82e846-5649-4744-a448-405459c23bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:08.746560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82e846-5649-4744-a448-405459c23bb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:08.756397 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82e846-5649-4744-a448-405459c23bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-ba82e846-5649-4744-a448-405459c23bb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:16:08.763877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:16:08.765054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:16:08.765961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:16:08.765961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:16:08.765961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:16:08.765961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:16:08.765961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:16:08.765961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:16:08.765961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:16:08.765961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:16:08.765961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:16:08.765961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:16:08.765961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:16:08.765961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:16:08.765961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 604/1180] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:16:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:16:08.770993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe80676-6908-427d-ad0d-f906486b1c62 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:08.868656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe80676-6908-427d-ad0d-f906486b1c62 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:08.900994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d86da-686f-4d08-9f39-5dc131edb624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:08.901669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d86da-686f-4d08-9f39-5dc131edb624 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:08.901946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d86da-686f-4d08-9f39-5dc131edb624 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:08.902213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d86da-686f-4d08-9f39-5dc131edb624 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:08.902946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d86da-686f-4d08-9f39-5dc131edb624 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:16:08.903245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d86da-686f-4d08-9f39-5dc131edb624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:08.904587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d86da-686f-4d08-9f39-5dc131edb624 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:08.912109 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 577/1181] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:16:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:16:08.917815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82e846-5649-4744-a448-405459c23bb6 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:09.011114 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82e846-5649-4744-a448-405459c23bb6 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:09.041816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80b47c-fe58-499e-9b98-845f1352b6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:09.042618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80b47c-fe58-499e-9b98-845f1352b6ac None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:09.042901 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80b47c-fe58-499e-9b98-845f1352b6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:09.043176 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80b47c-fe58-499e-9b98-845f1352b6ac None admin] PATH_INFO: `/v3/users/8eec4c5dd8a343c5b67eaaf5bf20ef43` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:09.055961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80b47c-fe58-499e-9b98-845f1352b6ac None admin] RBAC: Authorizing `identity:get_user(user_id=8eec4c5dd8a343c5b67eaaf5bf20ef43)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:09.057427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80b47c-fe58-499e-9b98-845f1352b6ac None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:09.059036 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 605/1182] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:16:08 2022] GET /identity/v3/users/8eec4c5dd8a343c5b67eaaf5bf20ef43 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:16:09.064718 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d86da-686f-4d08-9f39-5dc131edb624 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:09.156557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d86da-686f-4d08-9f39-5dc131edb624 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:09.187591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc279fba-069d-43d1-81a7-230f607c104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:09.188230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279fba-069d-43d1-81a7-230f607c104e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:09.188511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279fba-069d-43d1-81a7-230f607c104e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:09.188783 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279fba-069d-43d1-81a7-230f607c104e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:09.253992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc279fba-069d-43d1-81a7-230f607c104e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:09.257168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc279fba-069d-43d1-81a7-230f607c104e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:09.348650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 578/1183] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:16:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:16:09.354969 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80b47c-fe58-499e-9b98-845f1352b6ac None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:09.448276 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80b47c-fe58-499e-9b98-845f1352b6ac None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:09.479657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1794608-3186-4a78-8dee-f1c033786d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:09.480497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794608-3186-4a78-8dee-f1c033786d0a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:09.480784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794608-3186-4a78-8dee-f1c033786d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:09.481088 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1794608-3186-4a78-8dee-f1c033786d0a None admin] PATH_INFO: `/v3/projects/32ac2523c57b4cf4a6301fac8545d06c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:09.482254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1794608-3186-4a78-8dee-f1c033786d0a None admin] RBAC: Authorizing `identity:get_project(project_id=32ac2523c57b4cf4a6301fac8545d06c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:09.483706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1794608-3186-4a78-8dee-f1c033786d0a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:09.485435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 606/1184] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:16:09 2022] GET /identity/v3/projects/32ac2523c57b4cf4a6301fac8545d06c => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:16:09.492084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc279fba-069d-43d1-81a7-230f607c104e None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:09.588077 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc279fba-069d-43d1-81a7-230f607c104e None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:09.621511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407e7de-ee8e-49ec-8758-b38f99254bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:09.622098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e7de-ee8e-49ec-8758-b38f99254bef None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:09.622380 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e7de-ee8e-49ec-8758-b38f99254bef None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:09.622656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e7de-ee8e-49ec-8758-b38f99254bef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:09.623473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407e7de-ee8e-49ec-8758-b38f99254bef None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=32ac2523c57b4cf4a6301fac8545d06c, user.id=8eec4c5dd8a343c5b67eaaf5bf20ef43) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:16:09.623785 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407e7de-ee8e-49ec-8758-b38f99254bef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:09.625223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407e7de-ee8e-49ec-8758-b38f99254bef None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:09.630370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 579/1185] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:16:09 2022] GET /identity/v3/role_assignments?user.id=8eec4c5dd8a343c5b67eaaf5bf20ef43&scope.project.id=32ac2523c57b4cf4a6301fac8545d06c&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:16:11.817938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d2eb4-4121-4e8e-b0a5-ec511acd203a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:11.818998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d2eb4-4121-4e8e-b0a5-ec511acd203a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:11.818998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d2eb4-4121-4e8e-b0a5-ec511acd203a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:11.820372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 607/1186] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:16:11.825549 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c68b-5bef-4b8e-aa35-a4fa30e34fef None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:11.825952 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c68b-5bef-4b8e-aa35-a4fa30e34fef None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:11.826101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c68b-5bef-4b8e-aa35-a4fa30e34fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:11.842871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-fa36c68b-5bef-4b8e-aa35-a4fa30e34fef None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:16:11.844035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fa36c68b-5bef-4b8e-aa35-a4fa30e34fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:16:11.908334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 580/1187] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:16:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:16:11.931378 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d2eb4-4121-4e8e-b0a5-ec511acd203a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:12.028862 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d2eb4-4121-4e8e-b0a5-ec511acd203a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:12.071431 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726697-a723-4661-87cf-de48ca360d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:12.072147 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726697-a723-4661-87cf-de48ca360d92 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:12.072429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726697-a723-4661-87cf-de48ca360d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:12.072705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726697-a723-4661-87cf-de48ca360d92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:12.083591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8726697-a723-4661-87cf-de48ca360d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-e8726697-a723-4661-87cf-de48ca360d92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:16:12.091667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:16:12.092791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:16:12.093949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:16:12.093949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:16:12.093949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:16:12.093949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:16:12.093949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:16:12.093949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:16:12.093949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:16:12.093949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:16:12.093949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:16:12.093949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:16:12.093949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:16:12.093949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:16:12.093949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 608/1188] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:16:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:16:12.098878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36c68b-5bef-4b8e-aa35-a4fa30e34fef None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:12.198212 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36c68b-5bef-4b8e-aa35-a4fa30e34fef None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:12.229808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a27e7-0a0d-4a3e-b37d-9c7c1ef07ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:12.230470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a27e7-0a0d-4a3e-b37d-9c7c1ef07ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:12.230752 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a27e7-0a0d-4a3e-b37d-9c7c1ef07ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:12.231033 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a27e7-0a0d-4a3e-b37d-9c7c1ef07ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:12.231775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a27e7-0a0d-4a3e-b37d-9c7c1ef07ca8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:16:12.232080 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a27e7-0a0d-4a3e-b37d-9c7c1ef07ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:12.233474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a27e7-0a0d-4a3e-b37d-9c7c1ef07ca8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:12.241052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 581/1189] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:16:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:16:12.246890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726697-a723-4661-87cf-de48ca360d92 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:12.341655 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726697-a723-4661-87cf-de48ca360d92 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:12.371868 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e5c4b-63f7-4075-b11e-5c65d090680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:12.372718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e5c4b-63f7-4075-b11e-5c65d090680a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:12.373019 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e5c4b-63f7-4075-b11e-5c65d090680a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:12.373298 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e5c4b-63f7-4075-b11e-5c65d090680a None admin] PATH_INFO: `/v3/users/8eec4c5dd8a343c5b67eaaf5bf20ef43` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:12.374462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e5c4b-63f7-4075-b11e-5c65d090680a None admin] RBAC: Authorizing `identity:get_user(user_id=8eec4c5dd8a343c5b67eaaf5bf20ef43)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:12.375885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e5c4b-63f7-4075-b11e-5c65d090680a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:12.377515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 609/1190] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:16:12 2022] GET /identity/v3/users/8eec4c5dd8a343c5b67eaaf5bf20ef43 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:16:12.383703 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a27e7-0a0d-4a3e-b37d-9c7c1ef07ca8 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:12.475362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a27e7-0a0d-4a3e-b37d-9c7c1ef07ca8 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:12.506828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350457f-a742-43f1-9971-b153b59563fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:12.507669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350457f-a742-43f1-9971-b153b59563fa None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:12.507942 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350457f-a742-43f1-9971-b153b59563fa None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:12.508207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350457f-a742-43f1-9971-b153b59563fa None admin] PATH_INFO: `/v3/projects/32ac2523c57b4cf4a6301fac8545d06c` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:12.509394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350457f-a742-43f1-9971-b153b59563fa None admin] RBAC: Authorizing `identity:get_project(project_id=32ac2523c57b4cf4a6301fac8545d06c)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:12.510799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350457f-a742-43f1-9971-b153b59563fa None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:12.512454 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 582/1191] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:16:12 2022] GET /identity/v3/projects/32ac2523c57b4cf4a6301fac8545d06c => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:16:12.518337 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e5c4b-63f7-4075-b11e-5c65d090680a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:12.610549 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e5c4b-63f7-4075-b11e-5c65d090680a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:12.641747 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fb30f-ae87-4853-87a9-e763d8a01828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:12.642613 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fb30f-ae87-4853-87a9-e763d8a01828 None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:12.642894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fb30f-ae87-4853-87a9-e763d8a01828 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:12.643170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fb30f-ae87-4853-87a9-e763d8a01828 None admin] PATH_INFO: `/v3/projects/32ac2523c57b4cf4a6301fac8545d06c/users/8eec4c5dd8a343c5b67eaaf5bf20ef43/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:12.645111 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fb30f-ae87-4853-87a9-e763d8a01828 None admin] RBAC: Authorizing `identity:create_grant(project_id=32ac2523c57b4cf4a6301fac8545d06c, user_id=8eec4c5dd8a343c5b67eaaf5bf20ef43, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:12.646790 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fb30f-ae87-4853-87a9-e763d8a01828 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:12.659451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 610/1192] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:16:12 2022] PUT /identity/v3/projects/32ac2523c57b4cf4a6301fac8545d06c/users/8eec4c5dd8a343c5b67eaaf5bf20ef43/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:16:14.813539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba52bc-43af-4aed-a120-4f4fdbb46486 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:14.814067 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba52bc-43af-4aed-a120-4f4fdbb46486 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:14.814067 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba52bc-43af-4aed-a120-4f4fdbb46486 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:14.815441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 583/1193] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:16:14.821296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ccc3d-7f26-4a01-b9bf-dee90c4ed3de None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:14.821701 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ccc3d-7f26-4a01-b9bf-dee90c4ed3de None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:14.821862 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ccc3d-7f26-4a01-b9bf-dee90c4ed3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:14.838027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-dc3ccc3d-7f26-4a01-b9bf-dee90c4ed3de None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:16:14.839197 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-dc3ccc3d-7f26-4a01-b9bf-dee90c4ed3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:16:14.901147 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 611/1194] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:16:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:16:14.923482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba52bc-43af-4aed-a120-4f4fdbb46486 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:15.018945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba52bc-43af-4aed-a120-4f4fdbb46486 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:15.050619 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4d537-95ac-489f-a0eb-4a1f9db95aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:15.051391 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4d537-95ac-489f-a0eb-4a1f9db95aab None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:15.051673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4d537-95ac-489f-a0eb-4a1f9db95aab None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:15.051943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4d537-95ac-489f-a0eb-4a1f9db95aab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:15.062562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4d537-95ac-489f-a0eb-4a1f9db95aab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-3fe4d537-95ac-489f-a0eb-4a1f9db95aab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:16:15.070631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:16:15.071715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:16:15.072728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:16:15.072728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:16:15.072728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:16:15.072728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:16:15.072728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:16:15.072728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:16:15.072728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:16:15.072728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:16:15.072728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:16:15.072728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:16:15.072728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:16:15.072728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:16:15.072728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 584/1195] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:16:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:16:15.077782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ccc3d-7f26-4a01-b9bf-dee90c4ed3de None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:15.169503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ccc3d-7f26-4a01-b9bf-dee90c4ed3de None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:15.200473 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bf2b7-dd48-45ba-8b86-44ef56d4e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:15.201156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bf2b7-dd48-45ba-8b86-44ef56d4e454 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:15.201443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bf2b7-dd48-45ba-8b86-44ef56d4e454 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:15.201720 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726bf2b7-dd48-45ba-8b86-44ef56d4e454 None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:15.202456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bf2b7-dd48-45ba-8b86-44ef56d4e454 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:16:15.202762 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bf2b7-dd48-45ba-8b86-44ef56d4e454 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:15.204197 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726bf2b7-dd48-45ba-8b86-44ef56d4e454 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:15.212304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 612/1196] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:16:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:16:15.218068 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4d537-95ac-489f-a0eb-4a1f9db95aab None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:15.312213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4d537-95ac-489f-a0eb-4a1f9db95aab None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:15.344842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058932d-4211-4820-b72c-fcf30ded9a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:15.345783 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058932d-4211-4820-b72c-fcf30ded9a3d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:15.346065 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058932d-4211-4820-b72c-fcf30ded9a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:15.346338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058932d-4211-4820-b72c-fcf30ded9a3d None admin] PATH_INFO: `/v3/users/8eec4c5dd8a343c5b67eaaf5bf20ef43` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:15.347508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058932d-4211-4820-b72c-fcf30ded9a3d None admin] RBAC: Authorizing `identity:get_user(user_id=8eec4c5dd8a343c5b67eaaf5bf20ef43)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:15.348925 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058932d-4211-4820-b72c-fcf30ded9a3d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:15.350591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 585/1197] 10.222.0.61 () {56 vars in 1177 bytes} [Tue May 10 20:16:15 2022] GET /identity/v3/users/8eec4c5dd8a343c5b67eaaf5bf20ef43 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:16:15.356295 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bf2b7-dd48-45ba-8b86-44ef56d4e454 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:15.448949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726bf2b7-dd48-45ba-8b86-44ef56d4e454 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:15.479913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8d90f-38d6-43d2-8af5-4929babbd20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:15.480546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8d90f-38d6-43d2-8af5-4929babbd20d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:15.480827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8d90f-38d6-43d2-8af5-4929babbd20d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:15.481132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8d90f-38d6-43d2-8af5-4929babbd20d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:15.543038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8d90f-38d6-43d2-8af5-4929babbd20d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:15.544461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8d90f-38d6-43d2-8af5-4929babbd20d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:15.635379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 613/1198] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:16:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:16:15.641361 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058932d-4211-4820-b72c-fcf30ded9a3d None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:15.740780 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058932d-4211-4820-b72c-fcf30ded9a3d None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:15.772522 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790e340-1978-4233-8d94-ee6ec8ffdcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:15.773387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790e340-1978-4233-8d94-ee6ec8ffdcee None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:15.773668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790e340-1978-4233-8d94-ee6ec8ffdcee None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:15.773943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790e340-1978-4233-8d94-ee6ec8ffdcee None admin] PATH_INFO: `/v3/projects/32ac2523c57b4cf4a6301fac8545d06c` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:15.775098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790e340-1978-4233-8d94-ee6ec8ffdcee None admin] RBAC: Authorizing `identity:get_project(project_id=32ac2523c57b4cf4a6301fac8545d06c)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:15.776516 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790e340-1978-4233-8d94-ee6ec8ffdcee None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:15.778212 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 586/1199] 10.222.0.61 () {56 vars in 1186 bytes} [Tue May 10 20:16:15 2022] GET /identity/v3/projects/32ac2523c57b4cf4a6301fac8545d06c => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:16:15.784129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8d90f-38d6-43d2-8af5-4929babbd20d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:16:15.874850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8d90f-38d6-43d2-8af5-4929babbd20d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:16:15.906850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258b380-072b-4b59-8a68-2c160b2b464a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:16:15.907427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258b380-072b-4b59-8a68-2c160b2b464a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:16:15.907703 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258b380-072b-4b59-8a68-2c160b2b464a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:16:15.907974 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258b380-072b-4b59-8a68-2c160b2b464a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:16:15.908780 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258b380-072b-4b59-8a68-2c160b2b464a None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=32ac2523c57b4cf4a6301fac8545d06c, user.id=8eec4c5dd8a343c5b67eaaf5bf20ef43) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:16:15.909116 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258b380-072b-4b59-8a68-2c160b2b464a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:16:15.910522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258b380-072b-4b59-8a68-2c160b2b464a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:16:15.915972 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 614/1200] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:16:15 2022] GET /identity/v3/role_assignments?user.id=8eec4c5dd8a343c5b67eaaf5bf20ef43&scope.project.id=32ac2523c57b4cf4a6301fac8545d06c&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:15.917873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac803819-590f-4b2b-9d1e-46c31811b9b9 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:15.918517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac803819-590f-4b2b-9d1e-46c31811b9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:15.918517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac803819-590f-4b2b-9d1e-46c31811b9b9 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:15.920058 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 587/1201] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:17:15.928299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b72ca3-040f-4ae7-919e-b187bc8d3635 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:15.928299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b72ca3-040f-4ae7-919e-b187bc8d3635 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:15.928299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b72ca3-040f-4ae7-919e-b187bc8d3635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:15.947340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-36b72ca3-040f-4ae7-919e-b187bc8d3635 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:17:15.948958 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-36b72ca3-040f-4ae7-919e-b187bc8d3635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:17:16.031819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 615/1202] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:17:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:17:16.057545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac803819-590f-4b2b-9d1e-46c31811b9b9 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:16.188432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac803819-590f-4b2b-9d1e-46c31811b9b9 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:16.235977 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdbf2e-c1c7-41fe-8b69-81fb7da6ac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:16.237164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdbf2e-c1c7-41fe-8b69-81fb7da6ac0d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:16.237479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdbf2e-c1c7-41fe-8b69-81fb7da6ac0d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:16.237734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdbf2e-c1c7-41fe-8b69-81fb7da6ac0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:16.250974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdbf2e-c1c7-41fe-8b69-81fb7da6ac0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:16.252589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdbf2e-c1c7-41fe-8b69-81fb7da6ac0d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-d6cdbf2e-c1c7-41fe-8b69-81fb7da6ac0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:17:16.274055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:16.277204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:16.278433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:17:16.278433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:17:16.278433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:16.278433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:16.278433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 588/1203] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:16.282064 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b72ca3-040f-4ae7-919e-b187bc8d3635 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:16.393715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b72ca3-040f-4ae7-919e-b187bc8d3635 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:16.433657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb8422-d5f8-4778-aec2-1f401313d1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:16.434493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8422-d5f8-4778-aec2-1f401313d1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:16.434785 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8422-d5f8-4778-aec2-1f401313d1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:16.435089 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb8422-d5f8-4778-aec2-1f401313d1b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:16.435988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb8422-d5f8-4778-aec2-1f401313d1b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:16.436446 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb8422-d5f8-4778-aec2-1f401313d1b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:16.438176 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb8422-d5f8-4778-aec2-1f401313d1b5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:16.453226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 616/1204] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:17:16.458327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdbf2e-c1c7-41fe-8b69-81fb7da6ac0d None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:16.571599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdbf2e-c1c7-41fe-8b69-81fb7da6ac0d None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:16.606933 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3aea4-9d2e-4bc1-be9d-3ee8462b23d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:16.607753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3aea4-9d2e-4bc1-be9d-3ee8462b23d2 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:16.608139 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3aea4-9d2e-4bc1-be9d-3ee8462b23d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:16.608528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3aea4-9d2e-4bc1-be9d-3ee8462b23d2 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:16.609396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3aea4-9d2e-4bc1-be9d-3ee8462b23d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:16.610895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3aea4-9d2e-4bc1-be9d-3ee8462b23d2 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:16.641697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 589/1205] 10.222.0.61 () {60 vars in 1132 bytes} [Tue May 10 20:17:16 2022] POST /identity/v3/users => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:17:19.245512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bffa58-3619-4588-8bb6-59729b6c1ad4 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:19.246022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bffa58-3619-4588-8bb6-59729b6c1ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:19.246022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bffa58-3619-4588-8bb6-59729b6c1ad4 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:19.247358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 617/1206] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:17:19.255083 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7679f-d19e-48c6-918b-32a2983f3851 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:19.255636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7679f-d19e-48c6-918b-32a2983f3851 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:19.255746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7679f-d19e-48c6-918b-32a2983f3851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:19.275693 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-83e7679f-d19e-48c6-918b-32a2983f3851 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:17:19.277062 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-83e7679f-d19e-48c6-918b-32a2983f3851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:17:19.351017 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 590/1207] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:17:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:17:19.376293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bffa58-3619-4588-8bb6-59729b6c1ad4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:19.494304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bffa58-3619-4588-8bb6-59729b6c1ad4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:19.530925 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cbd6a-a110-4f07-b852-d72a77d519ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:19.531690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cbd6a-a110-4f07-b852-d72a77d519ad None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:19.531970 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cbd6a-a110-4f07-b852-d72a77d519ad None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:19.532353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cbd6a-a110-4f07-b852-d72a77d519ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:19.544010 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cbd6a-a110-4f07-b852-d72a77d519ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-be5cbd6a-a110-4f07-b852-d72a77d519ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:17:19.552723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:19.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:19.555068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:19.555068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:19.555068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:19.555068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:19.555068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:17:19.555068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:17:19.555068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:17:19.555068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:17:19.555068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:17:19.555068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:17:19.555068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:17:19.555068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:19.555068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 618/1208] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:17:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:19.560872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7679f-d19e-48c6-918b-32a2983f3851 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:19.673130 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7679f-d19e-48c6-918b-32a2983f3851 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:19.712395 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaa9eb-484b-4f19-86ee-3535f1faa4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:19.713494 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaa9eb-484b-4f19-86ee-3535f1faa4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:19.713933 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaa9eb-484b-4f19-86ee-3535f1faa4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:19.714028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaa9eb-484b-4f19-86ee-3535f1faa4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:19.714787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aaa9eb-484b-4f19-86ee-3535f1faa4d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:19.715090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aaa9eb-484b-4f19-86ee-3535f1faa4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:19.716515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aaa9eb-484b-4f19-86ee-3535f1faa4d8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:19.726145 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 591/1209] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:17:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:17:19.731637 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cbd6a-a110-4f07-b852-d72a77d519ad None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:19.843002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cbd6a-a110-4f07-b852-d72a77d519ad None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:19.880371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd784314-9c4f-4c62-a00b-8fb4f816bde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:19.881499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd784314-9c4f-4c62-a00b-8fb4f816bde0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:19.881896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd784314-9c4f-4c62-a00b-8fb4f816bde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:19.882264 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd784314-9c4f-4c62-a00b-8fb4f816bde0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:19.896150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd784314-9c4f-4c62-a00b-8fb4f816bde0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:19.897743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd784314-9c4f-4c62-a00b-8fb4f816bde0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-dd784314-9c4f-4c62-a00b-8fb4f816bde0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:17:19.918651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:19.919880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:19.921008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:17:19.921008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:17:19.921008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:19.921008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:19.921008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 619/1210] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:19.926635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaa9eb-484b-4f19-86ee-3535f1faa4d8 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:20.039079 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaa9eb-484b-4f19-86ee-3535f1faa4d8 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:20.079044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92709-54d1-4de9-83b3-dac04119a7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:20.079746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92709-54d1-4de9-83b3-dac04119a7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:20.080056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92709-54d1-4de9-83b3-dac04119a7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:20.080411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92709-54d1-4de9-83b3-dac04119a7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:20.081760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd92709-54d1-4de9-83b3-dac04119a7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:20.082120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd92709-54d1-4de9-83b3-dac04119a7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:20.083567 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd92709-54d1-4de9-83b3-dac04119a7e8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:20.097428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 592/1211] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:20.102893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd784314-9c4f-4c62-a00b-8fb4f816bde0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:20.215224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd784314-9c4f-4c62-a00b-8fb4f816bde0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:20.258462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683db3c-d219-46aa-b015-d8eb9e949df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:20.259410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683db3c-d219-46aa-b015-d8eb9e949df5 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:20.259920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683db3c-d219-46aa-b015-d8eb9e949df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:20.260208 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683db3c-d219-46aa-b015-d8eb9e949df5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:20.270643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683db3c-d219-46aa-b015-d8eb9e949df5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:20.272340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683db3c-d219-46aa-b015-d8eb9e949df5 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-2683db3c-d219-46aa-b015-d8eb9e949df5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:17:20.288375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:20.289836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:20.290980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:20.290980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:20.290980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:17:20.290980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:17:20.290980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:17:20.290980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:17:20.290980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:17:20.290980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:17:20.290980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 20:17:20.290980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:20.290980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 620/1212] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:20.295514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92709-54d1-4de9-83b3-dac04119a7e8 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:20.405444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92709-54d1-4de9-83b3-dac04119a7e8 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:20.443056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a802d-6b22-419b-9a43-87fccccd27c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:20.444030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a802d-6b22-419b-9a43-87fccccd27c8 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:20.444457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a802d-6b22-419b-9a43-87fccccd27c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:20.444852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a802d-6b22-419b-9a43-87fccccd27c8 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:20.445830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a802d-6b22-419b-9a43-87fccccd27c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:20.446268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a802d-6b22-419b-9a43-87fccccd27c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:20.447829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a802d-6b22-419b-9a43-87fccccd27c8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:20.467751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 593/1213] 10.222.0.61 () {56 vars in 1143 bytes} [Tue May 10 20:17:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:20.473360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683db3c-d219-46aa-b015-d8eb9e949df5 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:20.574850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683db3c-d219-46aa-b015-d8eb9e949df5 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:20.615059 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d859222-ae5d-43ea-9f21-c69a2e31e0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:20.615863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d859222-ae5d-43ea-9f21-c69a2e31e0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:20.616258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d859222-ae5d-43ea-9f21-c69a2e31e0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:20.616701 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d859222-ae5d-43ea-9f21-c69a2e31e0e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:20.684259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d859222-ae5d-43ea-9f21-c69a2e31e0e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:20.685686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d859222-ae5d-43ea-9f21-c69a2e31e0e0 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:20.785218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 621/1214] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:17:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:17:20.790661 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a802d-6b22-419b-9a43-87fccccd27c8 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:20.897363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a802d-6b22-419b-9a43-87fccccd27c8 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:20.935272 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49779ea2-aef7-4c94-8ae9-03d189830556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:20.936062 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49779ea2-aef7-4c94-8ae9-03d189830556 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:20.936340 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49779ea2-aef7-4c94-8ae9-03d189830556 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:20.936643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49779ea2-aef7-4c94-8ae9-03d189830556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:20.947570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49779ea2-aef7-4c94-8ae9-03d189830556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:20.949495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49779ea2-aef7-4c94-8ae9-03d189830556 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-49779ea2-aef7-4c94-8ae9-03d189830556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:17:20.969250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:20.970508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:20.971605 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:17:20.971605 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:17:20.971605 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:20.971605 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:20.971605 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 594/1215] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:17:20.974533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d859222-ae5d-43ea-9f21-c69a2e31e0e0 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:21.081702 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d859222-ae5d-43ea-9f21-c69a2e31e0e0 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:21.117899 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4cdf7-5222-41de-9c43-222786809925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:21.118730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4cdf7-5222-41de-9c43-222786809925 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:21.119137 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4cdf7-5222-41de-9c43-222786809925 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:21.119501 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4cdf7-5222-41de-9c43-222786809925 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:21.120287 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4cdf7-5222-41de-9c43-222786809925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:21.120665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4cdf7-5222-41de-9c43-222786809925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:21.122282 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4cdf7-5222-41de-9c43-222786809925 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:21.139905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 622/1216] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:21.141269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49779ea2-aef7-4c94-8ae9-03d189830556 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:21.251166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49779ea2-aef7-4c94-8ae9-03d189830556 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:21.290330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bc47d-7595-4e30-b030-d8098f0fd6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:21.291224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bc47d-7595-4e30-b030-d8098f0fd6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:21.291506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bc47d-7595-4e30-b030-d8098f0fd6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:21.291777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bc47d-7595-4e30-b030-d8098f0fd6f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:21.300789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bc47d-7595-4e30-b030-d8098f0fd6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:21.302759 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bc47d-7595-4e30-b030-d8098f0fd6f5 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-ea1bc47d-7595-4e30-b030-d8098f0fd6f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:17:21.322157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:21.323303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:21.324720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:17:21.324720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:17:21.324720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:17:21.324720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:17:21.324720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:17:21.324720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:17:21.324720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:17:21.324720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:21.324720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 595/1217] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:17:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:17:21.329651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4cdf7-5222-41de-9c43-222786809925 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:21.464489 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4cdf7-5222-41de-9c43-222786809925 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:21.517532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ee72c-f5e9-4839-98bb-1126cdbf9146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:21.518750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ee72c-f5e9-4839-98bb-1126cdbf9146 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:21.519650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ee72c-f5e9-4839-98bb-1126cdbf9146 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:21.520247 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ee72c-f5e9-4839-98bb-1126cdbf9146 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:21.521878 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ee72c-f5e9-4839-98bb-1126cdbf9146 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:21.522514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ee72c-f5e9-4839-98bb-1126cdbf9146 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:21.524679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ee72c-f5e9-4839-98bb-1126cdbf9146 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:21.543643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 623/1218] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:17:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:21.553872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bc47d-7595-4e30-b030-d8098f0fd6f5 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:21.686142 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bc47d-7595-4e30-b030-d8098f0fd6f5 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:21.726242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888c866-9582-4b1b-907f-44df85f6c76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:21.727131 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888c866-9582-4b1b-907f-44df85f6c76e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:21.727425 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888c866-9582-4b1b-907f-44df85f6c76e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:21.727792 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888c866-9582-4b1b-907f-44df85f6c76e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:21.728673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888c866-9582-4b1b-907f-44df85f6c76e None admin] RBAC: Adding query filter params (role.id=fd14ccb80b45427381dd82c06ef844b4, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=a4dc7b58c8a04b359a4a9bbab9e7b219) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:21.729169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888c866-9582-4b1b-907f-44df85f6c76e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:21.730863 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888c866-9582-4b1b-907f-44df85f6c76e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:21.738300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 596/1219] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:17:21 2022] GET /identity/v3/role_assignments?user.id=a4dc7b58c8a04b359a4a9bbab9e7b219&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=fd14ccb80b45427381dd82c06ef844b4 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:24.065699 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a158e-22a0-4ad9-915c-52e0c2cc8c01 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:24.066269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a158e-22a0-4ad9-915c-52e0c2cc8c01 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:24.066376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a158e-22a0-4ad9-915c-52e0c2cc8c01 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:24.069024 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 624/1220] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:17:24.073415 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa0abb-7bb0-4a66-95ea-1007ab3c15a8 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:24.073838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa0abb-7bb0-4a66-95ea-1007ab3c15a8 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:24.073991 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa0abb-7bb0-4a66-95ea-1007ab3c15a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:24.091112 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-cbfa0abb-7bb0-4a66-95ea-1007ab3c15a8 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:17:24.092325 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-cbfa0abb-7bb0-4a66-95ea-1007ab3c15a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:17:24.168409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 597/1221] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:17:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:17:24.191527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a158e-22a0-4ad9-915c-52e0c2cc8c01 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:24.313417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a158e-22a0-4ad9-915c-52e0c2cc8c01 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:24.354459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bf4cd-2236-421b-922a-a921187e006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:24.355313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bf4cd-2236-421b-922a-a921187e006f None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:24.355611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bf4cd-2236-421b-922a-a921187e006f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:24.355916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bf4cd-2236-421b-922a-a921187e006f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:24.368608 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bf4cd-2236-421b-922a-a921187e006f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-d90bf4cd-2236-421b-922a-a921187e006f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:17:24.376753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:24.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:24.380090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:24.380090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:24.380090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:24.380090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:24.380090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:17:24.380090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:17:24.380090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:17:24.380090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:17:24.380090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:17:24.380090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:17:24.380090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:17:24.380090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:24.388098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 625/1222] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:17:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:24.388321 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa0abb-7bb0-4a66-95ea-1007ab3c15a8 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:24.501021 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa0abb-7bb0-4a66-95ea-1007ab3c15a8 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:24.536411 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af3225-570c-4cc3-b2f4-f3c780528317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:24.537187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af3225-570c-4cc3-b2f4-f3c780528317 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:24.537616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af3225-570c-4cc3-b2f4-f3c780528317 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:24.537777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af3225-570c-4cc3-b2f4-f3c780528317 None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:24.538574 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af3225-570c-4cc3-b2f4-f3c780528317 None admin] RBAC: Adding query filter params (name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:24.538930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af3225-570c-4cc3-b2f4-f3c780528317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:24.540372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af3225-570c-4cc3-b2f4-f3c780528317 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:24.549746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 598/1223] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:17:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:24.555618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bf4cd-2236-421b-922a-a921187e006f None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:24.661309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bf4cd-2236-421b-922a-a921187e006f None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:24.696401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32131942-180d-4d5b-bc8e-6b94c1981a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:24.697237 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32131942-180d-4d5b-bc8e-6b94c1981a9c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:24.697517 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32131942-180d-4d5b-bc8e-6b94c1981a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:24.697788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32131942-180d-4d5b-bc8e-6b94c1981a9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:24.707904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32131942-180d-4d5b-bc8e-6b94c1981a9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:24.709417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32131942-180d-4d5b-bc8e-6b94c1981a9c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-32131942-180d-4d5b-bc8e-6b94c1981a9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:17:24.729106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:24.730293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:24.731589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:17:24.731589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:17:24.731589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:24.731589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:24.731589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 626/1224] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:24.737153 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af3225-570c-4cc3-b2f4-f3c780528317 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:24.842131 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af3225-570c-4cc3-b2f4-f3c780528317 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:24.876434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3945d6-df03-4634-8312-93841ba40c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:24.877131 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3945d6-df03-4634-8312-93841ba40c7b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:24.877413 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3945d6-df03-4634-8312-93841ba40c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:24.877682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3945d6-df03-4634-8312-93841ba40c7b None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:24.878401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3945d6-df03-4634-8312-93841ba40c7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:24.878709 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3945d6-df03-4634-8312-93841ba40c7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:24.880075 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3945d6-df03-4634-8312-93841ba40c7b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:24.892000 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 599/1225] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:24.898199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32131942-180d-4d5b-bc8e-6b94c1981a9c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:25.011037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32131942-180d-4d5b-bc8e-6b94c1981a9c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:25.046810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da875b7b-bbc1-48e9-8067-310299298884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:25.047713 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da875b7b-bbc1-48e9-8067-310299298884 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:25.048064 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da875b7b-bbc1-48e9-8067-310299298884 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:25.048370 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da875b7b-bbc1-48e9-8067-310299298884 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:25.056874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da875b7b-bbc1-48e9-8067-310299298884 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:25.058476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da875b7b-bbc1-48e9-8067-310299298884 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-da875b7b-bbc1-48e9-8067-310299298884 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:17:25.073267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:25.074764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:25.075733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:25.075733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:25.075733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:17:25.075733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:17:25.075733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:17:25.075733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:17:25.075733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:17:25.075733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:17:25.075733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 20:17:25.075733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:25.075733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 627/1226] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:17:25.080352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3945d6-df03-4634-8312-93841ba40c7b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:25.180456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3945d6-df03-4634-8312-93841ba40c7b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:25.218525 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ebb2e-afcd-4132-9726-a6abe9497df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:25.219257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ebb2e-afcd-4132-9726-a6abe9497df8 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:25.219591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ebb2e-afcd-4132-9726-a6abe9497df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:25.219927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ebb2e-afcd-4132-9726-a6abe9497df8 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:25.221594 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ebb2e-afcd-4132-9726-a6abe9497df8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:25.221974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ebb2e-afcd-4132-9726-a6abe9497df8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:25.223594 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ebb2e-afcd-4132-9726-a6abe9497df8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:25.242436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 600/1227] 10.222.0.61 () {56 vars in 1143 bytes} [Tue May 10 20:17:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:25.248244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da875b7b-bbc1-48e9-8067-310299298884 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:25.352423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da875b7b-bbc1-48e9-8067-310299298884 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:25.388602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f575a-5732-4817-b3c6-000881f09d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:25.389424 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f575a-5732-4817-b3c6-000881f09d64 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:25.389705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f575a-5732-4817-b3c6-000881f09d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:25.389979 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f575a-5732-4817-b3c6-000881f09d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:25.401140 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f575a-5732-4817-b3c6-000881f09d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:25.402661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f575a-5732-4817-b3c6-000881f09d64 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-254f575a-5732-4817-b3c6-000881f09d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:17:25.421661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:25.422877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:25.423937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:17:25.423937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:17:25.423937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:25.423937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:25.423937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 628/1228] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:25.428618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ebb2e-afcd-4132-9726-a6abe9497df8 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:25.536830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ebb2e-afcd-4132-9726-a6abe9497df8 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:25.571742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472cc49-0916-4b24-ab61-5b98794314a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:25.572427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472cc49-0916-4b24-ab61-5b98794314a8 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:25.572707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472cc49-0916-4b24-ab61-5b98794314a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:25.573007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472cc49-0916-4b24-ab61-5b98794314a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:25.573738 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472cc49-0916-4b24-ab61-5b98794314a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:25.574040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472cc49-0916-4b24-ab61-5b98794314a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:25.575406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472cc49-0916-4b24-ab61-5b98794314a8 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:25.587002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 601/1229] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:25.596057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f575a-5732-4817-b3c6-000881f09d64 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:25.703443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f575a-5732-4817-b3c6-000881f09d64 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:25.740198 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d641e-4fcc-4db9-85f4-0e940dde4fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:25.741047 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d641e-4fcc-4db9-85f4-0e940dde4fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:25.741326 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d641e-4fcc-4db9-85f4-0e940dde4fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:25.741680 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d641e-4fcc-4db9-85f4-0e940dde4fb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:25.748687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d641e-4fcc-4db9-85f4-0e940dde4fb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:25.750273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d641e-4fcc-4db9-85f4-0e940dde4fb4 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-0f5d641e-4fcc-4db9-85f4-0e940dde4fb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:17:25.764910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:25.766009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:25.767050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:17:25.767050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:17:25.767050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:17:25.767050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:17:25.767050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:17:25.767050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:17:25.767050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:17:25.767050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:25.767050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 629/1230] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:17:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:25.773068 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472cc49-0916-4b24-ab61-5b98794314a8 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:25.872907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472cc49-0916-4b24-ab61-5b98794314a8 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:25.906450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6c451-9e30-41c0-aa8f-e447831dc1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:25.907143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c451-9e30-41c0-aa8f-e447831dc1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:25.907409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c451-9e30-41c0-aa8f-e447831dc1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:25.907708 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c451-9e30-41c0-aa8f-e447831dc1c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:25.908499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6c451-9e30-41c0-aa8f-e447831dc1c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:25.908809 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6c451-9e30-41c0-aa8f-e447831dc1c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:25.910279 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6c451-9e30-41c0-aa8f-e447831dc1c6 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:25.923923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 602/1231] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:17:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:25.929752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d641e-4fcc-4db9-85f4-0e940dde4fb4 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:26.031327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d641e-4fcc-4db9-85f4-0e940dde4fb4 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:26.065620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396b59b-687d-42a9-ba6d-ad7d51f36c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:26.066518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396b59b-687d-42a9-ba6d-ad7d51f36c3a None admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:26.066781 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396b59b-687d-42a9-ba6d-ad7d51f36c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:26.067051 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396b59b-687d-42a9-ba6d-ad7d51f36c3a None admin] PATH_INFO: `/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/a4dc7b58c8a04b359a4a9bbab9e7b219/roles/fd14ccb80b45427381dd82c06ef844b4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:26.082963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396b59b-687d-42a9-ba6d-ad7d51f36c3a None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b37547e1bf4906b65ac39aad3a608c, user_id=a4dc7b58c8a04b359a4a9bbab9e7b219, role_id=fd14ccb80b45427381dd82c06ef844b4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:26.084532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396b59b-687d-42a9-ba6d-ad7d51f36c3a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:26.097849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 630/1232] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:17:25 2022] PUT /identity/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/a4dc7b58c8a04b359a4a9bbab9e7b219/roles/fd14ccb80b45427381dd82c06ef844b4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:17:28.365260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849a4ae-c0fc-48c2-988a-56c380b5038b None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:28.365837 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849a4ae-c0fc-48c2-988a-56c380b5038b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:28.365837 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849a4ae-c0fc-48c2-988a-56c380b5038b None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:28.367100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 603/1233] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:17:28.373904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e146c0-b37e-4378-893f-c0a61409c465 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:28.374314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e146c0-b37e-4378-893f-c0a61409c465 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:28.374441 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e146c0-b37e-4378-893f-c0a61409c465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:28.391632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-84e146c0-b37e-4378-893f-c0a61409c465 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:17:28.393402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-84e146c0-b37e-4378-893f-c0a61409c465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:17:28.464469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 631/1234] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:17:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:17:28.493141 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849a4ae-c0fc-48c2-988a-56c380b5038b None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:28.608819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849a4ae-c0fc-48c2-988a-56c380b5038b None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:28.648376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b23c6-fa88-4c7a-a272-033acb94839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:28.649206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b23c6-fa88-4c7a-a272-033acb94839c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:28.649489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b23c6-fa88-4c7a-a272-033acb94839c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:28.649764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b23c6-fa88-4c7a-a272-033acb94839c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:28.661537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b23c6-fa88-4c7a-a272-033acb94839c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-411b23c6-fa88-4c7a-a272-033acb94839c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:17:28.670144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:28.671586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:28.672756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:28.672756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:28.672756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:28.672756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:28.672756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:17:28.672756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:17:28.672756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:17:28.672756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:17:28.672756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:17:28.672756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:17:28.672756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:17:28.672756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:28.672756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 604/1235] 10.222.0.61 () {56 vars in 1102 bytes} [Tue May 10 20:17:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:28.678511 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e146c0-b37e-4378-893f-c0a61409c465 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:28.781665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e146c0-b37e-4378-893f-c0a61409c465 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:28.816941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93a776-8826-41a8-9147-b16204a0ad9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:28.817698 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93a776-8826-41a8-9147-b16204a0ad9b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:28.818057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93a776-8826-41a8-9147-b16204a0ad9b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:28.818542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93a776-8826-41a8-9147-b16204a0ad9b None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:28.819617 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93a776-8826-41a8-9147-b16204a0ad9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:28.819991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93a776-8826-41a8-9147-b16204a0ad9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:28.821599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93a776-8826-41a8-9147-b16204a0ad9b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:28.831809 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 632/1236] 10.222.0.61 () {56 vars in 1103 bytes} [Tue May 10 20:17:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:17:28.838021 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b23c6-fa88-4c7a-a272-033acb94839c None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:28.953282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b23c6-fa88-4c7a-a272-033acb94839c None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:28.995807 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232d163-af04-4a26-83a7-c9d636e678fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:28.996714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232d163-af04-4a26-83a7-c9d636e678fb None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:28.997155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232d163-af04-4a26-83a7-c9d636e678fb None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:28.997450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232d163-af04-4a26-83a7-c9d636e678fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:29.010350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232d163-af04-4a26-83a7-c9d636e678fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:29.012025 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232d163-af04-4a26-83a7-c9d636e678fb None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-a232d163-af04-4a26-83a7-c9d636e678fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:17:29.029599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:29.030791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:29.032072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:17:29.032072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:17:29.032072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:29.032072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:29.032072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 605/1237] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:29.036840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93a776-8826-41a8-9147-b16204a0ad9b None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:29.140621 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93a776-8826-41a8-9147-b16204a0ad9b None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:29.175030 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c1f8e-bf43-428f-a321-889100b0babd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:29.175635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c1f8e-bf43-428f-a321-889100b0babd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:29.175920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c1f8e-bf43-428f-a321-889100b0babd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:29.176193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c1f8e-bf43-428f-a321-889100b0babd None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:29.176902 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c1f8e-bf43-428f-a321-889100b0babd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:29.177261 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c1f8e-bf43-428f-a321-889100b0babd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:29.178611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c1f8e-bf43-428f-a321-889100b0babd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:29.190712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 633/1238] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:17:29.196794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232d163-af04-4a26-83a7-c9d636e678fb None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:29.309602 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232d163-af04-4a26-83a7-c9d636e678fb None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:29.342489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146956c-3948-40ee-82ce-6cc8fac4fc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:29.343276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146956c-3948-40ee-82ce-6cc8fac4fc79 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:29.343586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146956c-3948-40ee-82ce-6cc8fac4fc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:29.343895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146956c-3948-40ee-82ce-6cc8fac4fc79 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:29.351932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146956c-3948-40ee-82ce-6cc8fac4fc79 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:29.353422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146956c-3948-40ee-82ce-6cc8fac4fc79 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-d146956c-3948-40ee-82ce-6cc8fac4fc79 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:17:29.369590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:29.371092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:29.372132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:29.372132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:29.372132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:17:29.372132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:17:29.372132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:17:29.372132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:17:29.372132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:17:29.372132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:17:29.372132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 20:17:29.372132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:29.372132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 606/1239] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:29.376568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c1f8e-bf43-428f-a321-889100b0babd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:29.490251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c1f8e-bf43-428f-a321-889100b0babd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:29.530241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bab468-807d-4805-8c2a-1217a9310bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:29.531057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bab468-807d-4805-8c2a-1217a9310bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:29.531471 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bab468-807d-4805-8c2a-1217a9310bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:29.531745 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bab468-807d-4805-8c2a-1217a9310bb8 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:29.532574 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bab468-807d-4805-8c2a-1217a9310bb8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:29.532881 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bab468-807d-4805-8c2a-1217a9310bb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:29.534883 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bab468-807d-4805-8c2a-1217a9310bb8 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:29.556631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 634/1240] 10.222.0.61 () {56 vars in 1143 bytes} [Tue May 10 20:17:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:29.557947 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146956c-3948-40ee-82ce-6cc8fac4fc79 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:29.666335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146956c-3948-40ee-82ce-6cc8fac4fc79 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:29.703412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d377940-faf9-4064-a7ce-b7b0b8846960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:29.704058 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d377940-faf9-4064-a7ce-b7b0b8846960 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:29.704342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d377940-faf9-4064-a7ce-b7b0b8846960 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:29.704621 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d377940-faf9-4064-a7ce-b7b0b8846960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:29.782181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d377940-faf9-4064-a7ce-b7b0b8846960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:29.784391 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d377940-faf9-4064-a7ce-b7b0b8846960 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:29.888298 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 607/1241] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:17:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:17:29.895049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bab468-807d-4805-8c2a-1217a9310bb8 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:30.000237 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bab468-807d-4805-8c2a-1217a9310bb8 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:30.036438 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e0325-13d9-47b9-b137-d0d251e2fd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:30.037257 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e0325-13d9-47b9-b137-d0d251e2fd24 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:30.037540 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e0325-13d9-47b9-b137-d0d251e2fd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:30.037815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e0325-13d9-47b9-b137-d0d251e2fd24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:30.048704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e0325-13d9-47b9-b137-d0d251e2fd24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:30.050339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e0325-13d9-47b9-b137-d0d251e2fd24 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-e57e0325-13d9-47b9-b137-d0d251e2fd24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:17:30.068230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:30.069201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:30.070133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:17:30.070133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:17:30.070133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:30.070133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:30.070133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 635/1242] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:30.075147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d377940-faf9-4064-a7ce-b7b0b8846960 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:30.182529 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d377940-faf9-4064-a7ce-b7b0b8846960 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:30.220171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c504b4-0d38-4bbe-8384-3112ed4b3595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:30.220869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c504b4-0d38-4bbe-8384-3112ed4b3595 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:30.221177 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c504b4-0d38-4bbe-8384-3112ed4b3595 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:30.221451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c504b4-0d38-4bbe-8384-3112ed4b3595 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:30.222162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c504b4-0d38-4bbe-8384-3112ed4b3595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:30.222465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c504b4-0d38-4bbe-8384-3112ed4b3595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:30.223808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c504b4-0d38-4bbe-8384-3112ed4b3595 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:30.236401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 608/1243] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:30.242133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e0325-13d9-47b9-b137-d0d251e2fd24 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:30.346566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e0325-13d9-47b9-b137-d0d251e2fd24 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:30.381023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700493-3563-49e5-b710-4668875d2633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:30.381818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700493-3563-49e5-b710-4668875d2633 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:30.382099 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700493-3563-49e5-b710-4668875d2633 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:30.382373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700493-3563-49e5-b710-4668875d2633 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:30.389777 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94700493-3563-49e5-b710-4668875d2633 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:30.391249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94700493-3563-49e5-b710-4668875d2633 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-94700493-3563-49e5-b710-4668875d2633 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:17:30.410333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:30.411480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:30.417802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:17:30.417802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:17:30.417802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:17:30.417802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:17:30.417802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:17:30.417802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:17:30.417802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:17:30.417802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:30.417802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 636/1244] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:17:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:30.418779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c504b4-0d38-4bbe-8384-3112ed4b3595 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:30.528987 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c504b4-0d38-4bbe-8384-3112ed4b3595 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:30.567175 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e29cb-daf9-4ff9-9a4a-9dabbb925fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:30.568598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e29cb-daf9-4ff9-9a4a-9dabbb925fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:30.568915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e29cb-daf9-4ff9-9a4a-9dabbb925fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:30.569315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e29cb-daf9-4ff9-9a4a-9dabbb925fd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:30.570476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e29cb-daf9-4ff9-9a4a-9dabbb925fd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:30.570974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e29cb-daf9-4ff9-9a4a-9dabbb925fd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:30.572938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e29cb-daf9-4ff9-9a4a-9dabbb925fd7 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:30.587358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 609/1245] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:17:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:30.593465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700493-3563-49e5-b710-4668875d2633 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:30.701188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700493-3563-49e5-b710-4668875d2633 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:30.744156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a8364-6d84-4c0f-b5f2-ba39b7154959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:30.744818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a8364-6d84-4c0f-b5f2-ba39b7154959 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:30.745132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a8364-6d84-4c0f-b5f2-ba39b7154959 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:30.745409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a8364-6d84-4c0f-b5f2-ba39b7154959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:30.746869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a8364-6d84-4c0f-b5f2-ba39b7154959 None admin] RBAC: Adding query filter params (role.id=fd14ccb80b45427381dd82c06ef844b4, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=a4dc7b58c8a04b359a4a9bbab9e7b219) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:30.747400 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a8364-6d84-4c0f-b5f2-ba39b7154959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:30.749909 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a8364-6d84-4c0f-b5f2-ba39b7154959 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:30.758138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 637/1246] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:17:30 2022] GET /identity/v3/role_assignments?user.id=a4dc7b58c8a04b359a4a9bbab9e7b219&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=fd14ccb80b45427381dd82c06ef844b4 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:33.145767 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83f7c4-4b08-40ba-865c-0ddf60deb154 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:33.146324 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83f7c4-4b08-40ba-865c-0ddf60deb154 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:33.146324 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83f7c4-4b08-40ba-865c-0ddf60deb154 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:33.147690 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 610/1247] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:17:33.152912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d2e7e-2f90-40cc-941e-78a17393a2b0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:33.153342 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d2e7e-2f90-40cc-941e-78a17393a2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:33.153523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d2e7e-2f90-40cc-941e-78a17393a2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:33.169733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c03d2e7e-2f90-40cc-941e-78a17393a2b0 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:17:33.170913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c03d2e7e-2f90-40cc-941e-78a17393a2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:17:33.235345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 638/1248] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:17:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:17:33.259928 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83f7c4-4b08-40ba-865c-0ddf60deb154 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:33.370146 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83f7c4-4b08-40ba-865c-0ddf60deb154 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:33.405749 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf11f8-325a-4986-8011-067382dac463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:33.406532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf11f8-325a-4986-8011-067382dac463 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:33.406810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf11f8-325a-4986-8011-067382dac463 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:33.407077 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf11f8-325a-4986-8011-067382dac463 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:33.416890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf11f8-325a-4986-8011-067382dac463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-2faf11f8-325a-4986-8011-067382dac463 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:17:33.424309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:33.425497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:33.426532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:33.426532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:33.426532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:33.426532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:33.426532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:17:33.426532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:17:33.426532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:17:33.426532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:17:33.426532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:17:33.426532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:17:33.426532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:17:33.426532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:33.426532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 611/1249] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:17:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:33.431549 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d2e7e-2f90-40cc-941e-78a17393a2b0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:33.544817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d2e7e-2f90-40cc-941e-78a17393a2b0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:33.578183 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22422c64-5523-4edd-b621-4642301130fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:33.578849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22422c64-5523-4edd-b621-4642301130fd None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:33.579138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22422c64-5523-4edd-b621-4642301130fd None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:33.579408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22422c64-5523-4edd-b621-4642301130fd None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:33.580679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22422c64-5523-4edd-b621-4642301130fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:33.580995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22422c64-5523-4edd-b621-4642301130fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:33.582370 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22422c64-5523-4edd-b621-4642301130fd None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:33.590525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 639/1250] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:17:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:17:33.596815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf11f8-325a-4986-8011-067382dac463 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:33.694735 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf11f8-325a-4986-8011-067382dac463 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:33.729184 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d903c4f-7338-42a2-bd10-dcbf1c9edd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:33.729972 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d903c4f-7338-42a2-bd10-dcbf1c9edd37 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:33.730292 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d903c4f-7338-42a2-bd10-dcbf1c9edd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:33.730545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d903c4f-7338-42a2-bd10-dcbf1c9edd37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:33.742126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d903c4f-7338-42a2-bd10-dcbf1c9edd37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:33.744021 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d903c4f-7338-42a2-bd10-dcbf1c9edd37 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-1d903c4f-7338-42a2-bd10-dcbf1c9edd37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:17:33.762975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:33.764093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:33.765238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:17:33.765238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:17:33.765238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:33.765238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:33.765238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 612/1251] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:17:33.772396 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22422c64-5523-4edd-b621-4642301130fd None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:33.871718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22422c64-5523-4edd-b621-4642301130fd None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:33.906248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8db2a9-331a-43ba-a1bc-82efc53fab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:33.906896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8db2a9-331a-43ba-a1bc-82efc53fab64 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:33.907204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8db2a9-331a-43ba-a1bc-82efc53fab64 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:33.907484 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8db2a9-331a-43ba-a1bc-82efc53fab64 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:33.908202 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8db2a9-331a-43ba-a1bc-82efc53fab64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:33.908515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8db2a9-331a-43ba-a1bc-82efc53fab64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:33.909922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8db2a9-331a-43ba-a1bc-82efc53fab64 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:33.926915 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 640/1252] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:33.928105 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d903c4f-7338-42a2-bd10-dcbf1c9edd37 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:34.034232 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d903c4f-7338-42a2-bd10-dcbf1c9edd37 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:34.069978 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f5119-aaa5-4d13-b7fb-d671a6531b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:34.070774 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f5119-aaa5-4d13-b7fb-d671a6531b68 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:34.071057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f5119-aaa5-4d13-b7fb-d671a6531b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:34.071332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f5119-aaa5-4d13-b7fb-d671a6531b68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:34.080763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f5119-aaa5-4d13-b7fb-d671a6531b68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:34.082354 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f5119-aaa5-4d13-b7fb-d671a6531b68 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-529f5119-aaa5-4d13-b7fb-d671a6531b68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:17:34.096886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:34.098061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:34.103794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:34.103794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:34.103794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:17:34.103794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:17:34.103794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:17:34.103794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:17:34.103794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:17:34.103794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:17:34.103794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 20:17:34.103794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:34.103794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 613/1253] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:34.104432 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8db2a9-331a-43ba-a1bc-82efc53fab64 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:34.207179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8db2a9-331a-43ba-a1bc-82efc53fab64 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:34.243319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cac6d-3e8a-4679-8cb1-6a3ebc12af00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:34.243955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cac6d-3e8a-4679-8cb1-6a3ebc12af00 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:34.244234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cac6d-3e8a-4679-8cb1-6a3ebc12af00 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:34.244559 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cac6d-3e8a-4679-8cb1-6a3ebc12af00 None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:34.245591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cac6d-3e8a-4679-8cb1-6a3ebc12af00 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:34.245911 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cac6d-3e8a-4679-8cb1-6a3ebc12af00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:34.247390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cac6d-3e8a-4679-8cb1-6a3ebc12af00 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:34.267197 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 641/1254] 10.222.0.61 () {56 vars in 1143 bytes} [Tue May 10 20:17:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:34.273554 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f5119-aaa5-4d13-b7fb-d671a6531b68 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:34.373923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f5119-aaa5-4d13-b7fb-d671a6531b68 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:34.408076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9c48a-9204-4cd0-b7bf-80516ae562fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:34.408716 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9c48a-9204-4cd0-b7bf-80516ae562fe None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:34.409019 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9c48a-9204-4cd0-b7bf-80516ae562fe None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:34.409295 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9c48a-9204-4cd0-b7bf-80516ae562fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:34.487035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9c48a-9204-4cd0-b7bf-80516ae562fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:34.488692 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9c48a-9204-4cd0-b7bf-80516ae562fe None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:34.591638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 614/1255] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:17:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:17:34.601967 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cac6d-3e8a-4679-8cb1-6a3ebc12af00 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:34.701897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cac6d-3e8a-4679-8cb1-6a3ebc12af00 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:34.735147 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4d7ef-adc3-42e5-973d-7fe4c910f052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:34.735953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4d7ef-adc3-42e5-973d-7fe4c910f052 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:34.736768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4d7ef-adc3-42e5-973d-7fe4c910f052 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:34.737116 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4d7ef-adc3-42e5-973d-7fe4c910f052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:34.746796 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4d7ef-adc3-42e5-973d-7fe4c910f052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:34.748229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4d7ef-adc3-42e5-973d-7fe4c910f052 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-e8e4d7ef-adc3-42e5-973d-7fe4c910f052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:17:34.765352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:34.766569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:34.767698 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:17:34.767698 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:17:34.767698 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:34.767698 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:34.767698 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 642/1256] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:34.772466 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9c48a-9204-4cd0-b7bf-80516ae562fe None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:34.867863 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9c48a-9204-4cd0-b7bf-80516ae562fe None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:34.898933 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd41424-b96d-40c6-9242-b29e8a2c43df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:34.899576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd41424-b96d-40c6-9242-b29e8a2c43df None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:34.899854 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd41424-b96d-40c6-9242-b29e8a2c43df None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:34.900130 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd41424-b96d-40c6-9242-b29e8a2c43df None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:34.900834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd41424-b96d-40c6-9242-b29e8a2c43df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:34.901162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd41424-b96d-40c6-9242-b29e8a2c43df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:34.902495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd41424-b96d-40c6-9242-b29e8a2c43df None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:34.913488 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 615/1257] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:34.919174 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4d7ef-adc3-42e5-973d-7fe4c910f052 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:35.013043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4d7ef-adc3-42e5-973d-7fe4c910f052 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:35.048716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f118c-18f6-49ea-8bfd-3260ba5c6845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:35.049533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f118c-18f6-49ea-8bfd-3260ba5c6845 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:35.049815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f118c-18f6-49ea-8bfd-3260ba5c6845 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:35.050088 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f118c-18f6-49ea-8bfd-3260ba5c6845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:35.056540 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f118c-18f6-49ea-8bfd-3260ba5c6845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:35.058009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f118c-18f6-49ea-8bfd-3260ba5c6845 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-692f118c-18f6-49ea-8bfd-3260ba5c6845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:17:35.071149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:35.072241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:35.073586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:17:35.073586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:17:35.073586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:17:35.073586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:17:35.073586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:17:35.073586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:17:35.073586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:17:35.073586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:35.073586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 643/1258] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:17:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:35.078253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd41424-b96d-40c6-9242-b29e8a2c43df None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:35.170812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd41424-b96d-40c6-9242-b29e8a2c43df None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:35.201065 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f8981-6b23-4f86-a22b-b9d7fb78587d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:35.201708 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8981-6b23-4f86-a22b-b9d7fb78587d None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:35.201988 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8981-6b23-4f86-a22b-b9d7fb78587d None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:35.202260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f8981-6b23-4f86-a22b-b9d7fb78587d None admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:35.203031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f8981-6b23-4f86-a22b-b9d7fb78587d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:35.203338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f8981-6b23-4f86-a22b-b9d7fb78587d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:35.205266 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f8981-6b23-4f86-a22b-b9d7fb78587d None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:35.216346 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 616/1259] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:17:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:35.222587 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f118c-18f6-49ea-8bfd-3260ba5c6845 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:35.316917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f118c-18f6-49ea-8bfd-3260ba5c6845 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:35.349922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1741d6-9031-409a-8bca-0a2b6a29b911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:35.350567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1741d6-9031-409a-8bca-0a2b6a29b911 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:35.350849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1741d6-9031-409a-8bca-0a2b6a29b911 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:35.351123 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1741d6-9031-409a-8bca-0a2b6a29b911 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:35.351943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1741d6-9031-409a-8bca-0a2b6a29b911 None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=a4dc7b58c8a04b359a4a9bbab9e7b219) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:35.352252 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1741d6-9031-409a-8bca-0a2b6a29b911 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:35.353703 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1741d6-9031-409a-8bca-0a2b6a29b911 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:35.358898 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 644/1260] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:17:35 2022] GET /identity/v3/role_assignments?user.id=a4dc7b58c8a04b359a4a9bbab9e7b219&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:37.500499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6e359-db33-4b61-91df-41bcc7e154fa None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:37.501061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6e359-db33-4b61-91df-41bcc7e154fa None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:37.501061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6e359-db33-4b61-91df-41bcc7e154fa None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:37.503007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 617/1261] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:17:37.508479 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188982b4-2263-4823-a651-1bc0ffb47fe9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:37.508906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188982b4-2263-4823-a651-1bc0ffb47fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:37.509057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188982b4-2263-4823-a651-1bc0ffb47fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:37.525511 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-188982b4-2263-4823-a651-1bc0ffb47fe9 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:17:37.526681 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-188982b4-2263-4823-a651-1bc0ffb47fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:17:37.589475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 645/1262] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:17:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:17:37.612062 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6e359-db33-4b61-91df-41bcc7e154fa None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:37.705669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6e359-db33-4b61-91df-41bcc7e154fa None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:37.737713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10cf9-4e0a-419c-b427-ff02b6bb0440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:37.738482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10cf9-4e0a-419c-b427-ff02b6bb0440 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:37.738758 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10cf9-4e0a-419c-b427-ff02b6bb0440 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:37.739025 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10cf9-4e0a-419c-b427-ff02b6bb0440 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:37.748494 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f10cf9-4e0a-419c-b427-ff02b6bb0440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-f4f10cf9-4e0a-419c-b427-ff02b6bb0440 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:17:37.756002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:37.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:37.758171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:37.758171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:37.758171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:37.758171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:37.758171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:17:37.758171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:17:37.758171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:17:37.758171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:17:37.758171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:17:37.758171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:17:37.758171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:17:37.758171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:37.758171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 618/1263] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:17:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:37.763121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188982b4-2263-4823-a651-1bc0ffb47fe9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:37.854490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188982b4-2263-4823-a651-1bc0ffb47fe9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:37.885976 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ee64d-0d5e-438b-b136-ce5c3371691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:37.886625 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee64d-0d5e-438b-b136-ce5c3371691d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:37.886910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee64d-0d5e-438b-b136-ce5c3371691d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:37.887188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ee64d-0d5e-438b-b136-ce5c3371691d None admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:37.887920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ee64d-0d5e-438b-b136-ce5c3371691d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:37.888229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ee64d-0d5e-438b-b136-ce5c3371691d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:37.889620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ee64d-0d5e-438b-b136-ce5c3371691d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:37.898360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 646/1264] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:17:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:37.903955 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10cf9-4e0a-419c-b427-ff02b6bb0440 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:37.997309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10cf9-4e0a-419c-b427-ff02b6bb0440 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:38.028764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179a2e5-bedb-4ee2-9e6b-d7b3fbdaf601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:38.029520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a2e5-bedb-4ee2-9e6b-d7b3fbdaf601 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:38.029804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a2e5-bedb-4ee2-9e6b-d7b3fbdaf601 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:38.030079 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179a2e5-bedb-4ee2-9e6b-d7b3fbdaf601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:38.040540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179a2e5-bedb-4ee2-9e6b-d7b3fbdaf601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:38.041987 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179a2e5-bedb-4ee2-9e6b-d7b3fbdaf601 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-2179a2e5-bedb-4ee2-9e6b-d7b3fbdaf601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:17:38.058138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:38.059172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:38.060227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:17:38.060227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:17:38.060227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:38.060227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:38.060227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 619/1265] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:38.065073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ee64d-0d5e-438b-b136-ce5c3371691d None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:38.156684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ee64d-0d5e-438b-b136-ce5c3371691d None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:38.187509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c605ab8-2763-42fc-9dcc-533226dbd159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:38.188149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c605ab8-2763-42fc-9dcc-533226dbd159 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:38.188430 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c605ab8-2763-42fc-9dcc-533226dbd159 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:38.188701 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c605ab8-2763-42fc-9dcc-533226dbd159 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:38.189480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c605ab8-2763-42fc-9dcc-533226dbd159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:38.189785 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c605ab8-2763-42fc-9dcc-533226dbd159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:38.191141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c605ab8-2763-42fc-9dcc-533226dbd159 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:38.202645 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 647/1266] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:38.208747 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179a2e5-bedb-4ee2-9e6b-d7b3fbdaf601 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:38.302496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179a2e5-bedb-4ee2-9e6b-d7b3fbdaf601 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:38.333713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454d8cf-7490-4a41-bc72-8dc557534808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:38.334475 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454d8cf-7490-4a41-bc72-8dc557534808 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:38.334750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454d8cf-7490-4a41-bc72-8dc557534808 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:38.335020 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454d8cf-7490-4a41-bc72-8dc557534808 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:38.341915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454d8cf-7490-4a41-bc72-8dc557534808 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:38.343339 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454d8cf-7490-4a41-bc72-8dc557534808 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-b454d8cf-7490-4a41-bc72-8dc557534808 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:17:38.356777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:38.357932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:38.359236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:38.359236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:38.359236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:17:38.359236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:17:38.359236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:17:38.359236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:17:38.359236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:17:38.359236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:17:38.359236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 20:17:38.359236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:38.359236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 620/1267] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:38.363427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c605ab8-2763-42fc-9dcc-533226dbd159 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:38.459040 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c605ab8-2763-42fc-9dcc-533226dbd159 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:38.495445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd279-7d48-420c-9f66-ea98d4970a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:38.496339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd279-7d48-420c-9f66-ea98d4970a7c None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:38.496827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd279-7d48-420c-9f66-ea98d4970a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:38.497344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd279-7d48-420c-9f66-ea98d4970a7c None admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:38.498477 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd279-7d48-420c-9f66-ea98d4970a7c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:38.499005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd279-7d48-420c-9f66-ea98d4970a7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:38.500950 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd279-7d48-420c-9f66-ea98d4970a7c None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:38.522016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 648/1268] 10.222.0.61 () {56 vars in 1143 bytes} [Tue May 10 20:17:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:38.527575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454d8cf-7490-4a41-bc72-8dc557534808 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:38.620007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454d8cf-7490-4a41-bc72-8dc557534808 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:38.651562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a3880-dd85-4508-94db-dd1c57a24d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:38.652340 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a3880-dd85-4508-94db-dd1c57a24d2a None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:38.652619 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a3880-dd85-4508-94db-dd1c57a24d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:38.652890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a3880-dd85-4508-94db-dd1c57a24d2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:38.662709 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a3880-dd85-4508-94db-dd1c57a24d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:38.664132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a3880-dd85-4508-94db-dd1c57a24d2a None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-743a3880-dd85-4508-94db-dd1c57a24d2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:17:38.680235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:38.681297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:38.682358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:17:38.682358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:17:38.682358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:38.682358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:38.682358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 621/1269] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:38.687296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd279-7d48-420c-9f66-ea98d4970a7c None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:38.780893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd279-7d48-420c-9f66-ea98d4970a7c None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:38.812506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dadb7-84aa-47eb-894c-43e249c32528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:38.813198 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dadb7-84aa-47eb-894c-43e249c32528 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:38.813482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dadb7-84aa-47eb-894c-43e249c32528 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:38.813757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dadb7-84aa-47eb-894c-43e249c32528 None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:38.815109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dadb7-84aa-47eb-894c-43e249c32528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:38.815419 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dadb7-84aa-47eb-894c-43e249c32528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:38.816776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dadb7-84aa-47eb-894c-43e249c32528 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:38.827456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 649/1270] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:38.832952 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a3880-dd85-4508-94db-dd1c57a24d2a None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:38.925969 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a3880-dd85-4508-94db-dd1c57a24d2a None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:38.957257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a7b12-05ef-449a-9759-637d51fee4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:38.958031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a7b12-05ef-449a-9759-637d51fee4fa None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:38.958314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a7b12-05ef-449a-9759-637d51fee4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:38.958590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a7b12-05ef-449a-9759-637d51fee4fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:38.964923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a7b12-05ef-449a-9759-637d51fee4fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:38.966383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a7b12-05ef-449a-9759-637d51fee4fa None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-839a7b12-05ef-449a-9759-637d51fee4fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:17:38.980330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:38.981252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:38.982161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:17:38.982161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:17:38.982161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:17:38.982161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:17:38.982161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:17:38.982161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:17:38.982161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:17:38.982161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:38.983296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 622/1271] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:17:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:38.988798 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dadb7-84aa-47eb-894c-43e249c32528 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:39.084491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dadb7-84aa-47eb-894c-43e249c32528 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:39.116944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521c339-05a3-40a1-bdf6-aebd4ba80c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:39.117622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521c339-05a3-40a1-bdf6-aebd4ba80c48 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:39.117903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521c339-05a3-40a1-bdf6-aebd4ba80c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:39.118178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521c339-05a3-40a1-bdf6-aebd4ba80c48 None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:39.118949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521c339-05a3-40a1-bdf6-aebd4ba80c48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:39.119258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521c339-05a3-40a1-bdf6-aebd4ba80c48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:39.120694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521c339-05a3-40a1-bdf6-aebd4ba80c48 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:39.132008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 650/1272] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:17:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:39.137922 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a7b12-05ef-449a-9759-637d51fee4fa None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:39.230479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a7b12-05ef-449a-9759-637d51fee4fa None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:39.262172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e3a75-0531-4de9-ad66-106f4462b269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:39.263035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e3a75-0531-4de9-ad66-106f4462b269 None admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:39.263317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e3a75-0531-4de9-ad66-106f4462b269 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:39.263590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e3a75-0531-4de9-ad66-106f4462b269 None admin] PATH_INFO: `/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/a4dc7b58c8a04b359a4a9bbab9e7b219/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:39.265523 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e3a75-0531-4de9-ad66-106f4462b269 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b37547e1bf4906b65ac39aad3a608c, user_id=a4dc7b58c8a04b359a4a9bbab9e7b219, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:39.266945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e3a75-0531-4de9-ad66-106f4462b269 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:39.280194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 623/1273] 10.222.0.61 () {58 vars in 1439 bytes} [Tue May 10 20:17:39 2022] PUT /identity/v3/projects/b7b37547e1bf4906b65ac39aad3a608c/users/a4dc7b58c8a04b359a4a9bbab9e7b219/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:17:41.441853 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec35a0d-93f5-4a85-8b75-7fac058bf44f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:41.442643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec35a0d-93f5-4a85-8b75-7fac058bf44f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:41.442643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec35a0d-93f5-4a85-8b75-7fac058bf44f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:41.443767 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 651/1274] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:17:41.449087 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f4b27-4f86-4ee5-a3d8-83e9be9d701d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:41.449490 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f4b27-4f86-4ee5-a3d8-83e9be9d701d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:41.449641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f4b27-4f86-4ee5-a3d8-83e9be9d701d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:41.467360 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-618f4b27-4f86-4ee5-a3d8-83e9be9d701d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:17:41.468535 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-618f4b27-4f86-4ee5-a3d8-83e9be9d701d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:17:41.531035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 624/1275] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:17:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:17:41.554742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec35a0d-93f5-4a85-8b75-7fac058bf44f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:41.648437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec35a0d-93f5-4a85-8b75-7fac058bf44f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:41.683664 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d017887-e14e-4b38-9dac-98e5db157508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:41.684840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d017887-e14e-4b38-9dac-98e5db157508 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:41.685379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d017887-e14e-4b38-9dac-98e5db157508 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:41.685888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d017887-e14e-4b38-9dac-98e5db157508 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:41.696242 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d017887-e14e-4b38-9dac-98e5db157508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-0d017887-e14e-4b38-9dac-98e5db157508 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:17:41.703638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:41.705251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:41.706404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:41.706404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:41.706404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:41.706404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:41.706404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:17:41.706404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:17:41.706404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:17:41.706404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:17:41.706404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:17:41.706404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:17:41.706404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:17:41.706404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:41.706404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 652/1276] 10.222.0.61 () {56 vars in 1096 bytes} [Tue May 10 20:17:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:41.711623 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f4b27-4f86-4ee5-a3d8-83e9be9d701d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:41.805617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f4b27-4f86-4ee5-a3d8-83e9be9d701d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:41.836906 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502f76f-f528-44ac-bace-8549ccdd944b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:41.837575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f76f-f528-44ac-bace-8549ccdd944b None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:41.837850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f76f-f528-44ac-bace-8549ccdd944b None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:41.838116 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502f76f-f528-44ac-bace-8549ccdd944b None admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:41.838843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502f76f-f528-44ac-bace-8549ccdd944b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:41.839143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502f76f-f528-44ac-bace-8549ccdd944b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:41.840478 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502f76f-f528-44ac-bace-8549ccdd944b None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:41.848542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 625/1277] 10.222.0.61 () {56 vars in 1099 bytes} [Tue May 10 20:17:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:17:41.854142 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d017887-e14e-4b38-9dac-98e5db157508 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:41.948744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d017887-e14e-4b38-9dac-98e5db157508 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:41.980977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb08ab-7952-47e0-bf20-76514cd31d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:41.981920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb08ab-7952-47e0-bf20-76514cd31d23 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:41.982042 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb08ab-7952-47e0-bf20-76514cd31d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:41.982314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afb08ab-7952-47e0-bf20-76514cd31d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:41.991953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb08ab-7952-47e0-bf20-76514cd31d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:41.993595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afb08ab-7952-47e0-bf20-76514cd31d23 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-1afb08ab-7952-47e0-bf20-76514cd31d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:17:42.010341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:42.011357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:42.012443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:17:42.012443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:17:42.012443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:42.012443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:42.012443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 653/1278] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:42.023521 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502f76f-f528-44ac-bace-8549ccdd944b None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:42.117528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502f76f-f528-44ac-bace-8549ccdd944b None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:42.149538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba45f01-1854-4cdf-addb-6e1e75ff4b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:42.150174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45f01-1854-4cdf-addb-6e1e75ff4b31 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:42.150452 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45f01-1854-4cdf-addb-6e1e75ff4b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:42.150720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45f01-1854-4cdf-addb-6e1e75ff4b31 None admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:42.151420 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba45f01-1854-4cdf-addb-6e1e75ff4b31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:42.151720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba45f01-1854-4cdf-addb-6e1e75ff4b31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:42.153072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba45f01-1854-4cdf-addb-6e1e75ff4b31 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:42.163944 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 626/1279] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:42.169669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb08ab-7952-47e0-bf20-76514cd31d23 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:42.263033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afb08ab-7952-47e0-bf20-76514cd31d23 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:42.294692 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73cb3f-516a-4898-865b-ff1e8eac2d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:42.295475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73cb3f-516a-4898-865b-ff1e8eac2d25 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:42.295757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73cb3f-516a-4898-865b-ff1e8eac2d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:42.296034 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73cb3f-516a-4898-865b-ff1e8eac2d25 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:42.302635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73cb3f-516a-4898-865b-ff1e8eac2d25 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:42.304050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73cb3f-516a-4898-865b-ff1e8eac2d25 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-4f73cb3f-516a-4898-865b-ff1e8eac2d25 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:17:42.319227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:42.320353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:42.321580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:42.321580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:42.321580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:17:42.321580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:17:42.321580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:17:42.321580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:17:42.321580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:17:42.321580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:17:42.321580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 20:17:42.321580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:42.321580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 654/1280] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:42.326165 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba45f01-1854-4cdf-addb-6e1e75ff4b31 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:42.419507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba45f01-1854-4cdf-addb-6e1e75ff4b31 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:42.457223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25a0e5-8112-40e6-99a1-6236350937b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:42.457986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25a0e5-8112-40e6-99a1-6236350937b2 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:42.458324 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25a0e5-8112-40e6-99a1-6236350937b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:42.458633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25a0e5-8112-40e6-99a1-6236350937b2 None admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:42.459538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25a0e5-8112-40e6-99a1-6236350937b2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:42.459848 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25a0e5-8112-40e6-99a1-6236350937b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:42.461443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25a0e5-8112-40e6-99a1-6236350937b2 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:42.479126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 627/1281] 10.222.0.61 () {56 vars in 1143 bytes} [Tue May 10 20:17:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:42.484870 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73cb3f-516a-4898-865b-ff1e8eac2d25 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:42.577249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73cb3f-516a-4898-865b-ff1e8eac2d25 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:42.609416 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d97a32-87aa-452f-81c3-ea9125afacd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:42.610037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d97a32-87aa-452f-81c3-ea9125afacd7 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:42.610321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d97a32-87aa-452f-81c3-ea9125afacd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:42.610624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d97a32-87aa-452f-81c3-ea9125afacd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:42.673500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d97a32-87aa-452f-81c3-ea9125afacd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:42.674930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d97a32-87aa-452f-81c3-ea9125afacd7 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:42.765582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 655/1282] 10.222.0.61 () {58 vars in 1282 bytes} [Tue May 10 20:17:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:17:42.772135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25a0e5-8112-40e6-99a1-6236350937b2 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:42.863166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25a0e5-8112-40e6-99a1-6236350937b2 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:42.895169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570942c2-60ab-4581-b03f-cee65827df63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:42.895940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570942c2-60ab-4581-b03f-cee65827df63 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:42.896216 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570942c2-60ab-4581-b03f-cee65827df63 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:42.896488 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570942c2-60ab-4581-b03f-cee65827df63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:42.905779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570942c2-60ab-4581-b03f-cee65827df63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:42.907216 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570942c2-60ab-4581-b03f-cee65827df63 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-570942c2-60ab-4581-b03f-cee65827df63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:17:42.923581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:42.924631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:42.925642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:17:42.925642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:17:42.925642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:17:42.925642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:42.925642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 628/1283] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:42.930187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d97a32-87aa-452f-81c3-ea9125afacd7 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:43.023129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d97a32-87aa-452f-81c3-ea9125afacd7 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:43.054954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3dca1-4079-419a-9a13-793f38ac96ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:43.055608 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3dca1-4079-419a-9a13-793f38ac96ef None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:43.055893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3dca1-4079-419a-9a13-793f38ac96ef None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:43.056174 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3dca1-4079-419a-9a13-793f38ac96ef None admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:43.056885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3dca1-4079-419a-9a13-793f38ac96ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:43.057223 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3dca1-4079-419a-9a13-793f38ac96ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:43.058590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3dca1-4079-419a-9a13-793f38ac96ef None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:43.069724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 656/1284] 10.222.0.61 () {56 vars in 1109 bytes} [Tue May 10 20:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:43.075209 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570942c2-60ab-4581-b03f-cee65827df63 None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:43.168496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570942c2-60ab-4581-b03f-cee65827df63 None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:43.200929 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344fc65-2dd5-42aa-aac6-740247c3483c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:43.201728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344fc65-2dd5-42aa-aac6-740247c3483c None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:43.202003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344fc65-2dd5-42aa-aac6-740247c3483c None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:43.202272 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344fc65-2dd5-42aa-aac6-740247c3483c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:43.209185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344fc65-2dd5-42aa-aac6-740247c3483c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:43.210611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344fc65-2dd5-42aa-aac6-740247c3483c None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application [None req-2344fc65-2dd5-42aa-aac6-740247c3483c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:17:43.223598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application with Lock( May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:43.224715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:43.225822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:17:43.225822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:17:43.225822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:17:43.225822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:17:43.225822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:17:43.225822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:17:43.225822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:17:43.225822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: ERROR keystone.server.flask.application May 10 20:17:43.225822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 629/1285] 10.222.0.61 () {56 vars in 1111 bytes} [Tue May 10 20:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:43.230687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3dca1-4079-419a-9a13-793f38ac96ef None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:43.329437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3dca1-4079-419a-9a13-793f38ac96ef None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:43.361911 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39342482-ee74-47c5-a97b-e735e687ce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:43.362561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342482-ee74-47c5-a97b-e735e687ce4b None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:43.362845 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342482-ee74-47c5-a97b-e735e687ce4b None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:43.363119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39342482-ee74-47c5-a97b-e735e687ce4b None admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:43.363899 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39342482-ee74-47c5-a97b-e735e687ce4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:43.364210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39342482-ee74-47c5-a97b-e735e687ce4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:43.365661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39342482-ee74-47c5-a97b-e735e687ce4b None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:43.377714 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 657/1286] 10.222.0.61 () {56 vars in 1148 bytes} [Tue May 10 20:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:43.383775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344fc65-2dd5-42aa-aac6-740247c3483c None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:43.478983 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344fc65-2dd5-42aa-aac6-740247c3483c None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:43.510609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6209fd-ce15-49bb-af21-02a731ca201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:43.511253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6209fd-ce15-49bb-af21-02a731ca201e None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:43.511533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6209fd-ce15-49bb-af21-02a731ca201e None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:43.511808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6209fd-ce15-49bb-af21-02a731ca201e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:43.512624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6209fd-ce15-49bb-af21-02a731ca201e None admin] RBAC: Adding query filter params (role.id=958d8d89cd184e3ca4581a2e65fdc08e, scope.project.id=b7b37547e1bf4906b65ac39aad3a608c, user.id=a4dc7b58c8a04b359a4a9bbab9e7b219) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:43.512939 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6209fd-ce15-49bb-af21-02a731ca201e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:43.514378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6209fd-ce15-49bb-af21-02a731ca201e None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:43.520128 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 630/1287] 10.222.0.61 () {56 vars in 1374 bytes} [Tue May 10 20:17:43 2022] GET /identity/v3/role_assignments?user.id=a4dc7b58c8a04b359a4a9bbab9e7b219&scope.project.id=b7b37547e1bf4906b65ac39aad3a608c&role.id=958d8d89cd184e3ca4581a2e65fdc08e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:45.708875 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ec942-0a91-46d6-a8af-03bb1cbef67b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:45.709461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ec942-0a91-46d6-a8af-03bb1cbef67b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:45.709461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ec942-0a91-46d6-a8af-03bb1cbef67b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:45.710833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 658/1288] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:17:45.716047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eba74c-e352-401e-9121-4e347e2307d0 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:45.716434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eba74c-e352-401e-9121-4e347e2307d0 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:45.716600 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eba74c-e352-401e-9121-4e347e2307d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:45.733352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-a6eba74c-e352-401e-9121-4e347e2307d0 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:17:45.734513 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a6eba74c-e352-401e-9121-4e347e2307d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:17:45.796373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 631/1289] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:17:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:17:45.818060 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ec942-0a91-46d6-a8af-03bb1cbef67b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:45.913014 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ec942-0a91-46d6-a8af-03bb1cbef67b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:45.944350 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d778801-0ecd-434e-aac9-10a96e56b96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:45.945180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d778801-0ecd-434e-aac9-10a96e56b96a None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:45.945466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d778801-0ecd-434e-aac9-10a96e56b96a None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:45.945743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d778801-0ecd-434e-aac9-10a96e56b96a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:45.946388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d778801-0ecd-434e-aac9-10a96e56b96a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:45.947783 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d778801-0ecd-434e-aac9-10a96e56b96a None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-3d778801-0ecd-434e-aac9-10a96e56b96a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:45.960687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:45.961906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:45.962977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 659/1290] 10.222.0.61 () {56 vars in 1117 bytes} [Tue May 10 20:17:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:45.967884 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eba74c-e352-401e-9121-4e347e2307d0 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:46.061457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eba74c-e352-401e-9121-4e347e2307d0 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:46.093593 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aa6dd-301e-4a36-ac18-bef102912c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:46.094275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aa6dd-301e-4a36-ac18-bef102912c10 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:46.094562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aa6dd-301e-4a36-ac18-bef102912c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:46.094840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aa6dd-301e-4a36-ac18-bef102912c10 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:46.095550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85aa6dd-301e-4a36-ac18-bef102912c10 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:46.095859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85aa6dd-301e-4a36-ac18-bef102912c10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:46.097358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85aa6dd-301e-4a36-ac18-bef102912c10 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:46.102061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 632/1291] 10.222.0.61 () {56 vars in 1116 bytes} [Tue May 10 20:17:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:46.107600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d778801-0ecd-434e-aac9-10a96e56b96a None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:46.200587 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d778801-0ecd-434e-aac9-10a96e56b96a None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:46.231789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3aac9-05bb-4c13-9036-6b839710d305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:46.232369 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3aac9-05bb-4c13-9036-6b839710d305 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:46.232655 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3aac9-05bb-4c13-9036-6b839710d305 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:46.232933 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3aac9-05bb-4c13-9036-6b839710d305 None admin] PATH_INFO: `/v3/services` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:46.233657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3aac9-05bb-4c13-9036-6b839710d305 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:46.233966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3aac9-05bb-4c13-9036-6b839710d305 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:46.235312 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3aac9-05bb-4c13-9036-6b839710d305 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:46.241522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 660/1292] 10.222.0.61 () {56 vars in 1116 bytes} [Tue May 10 20:17:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:48.399557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cb821-ce83-4cc2-ba19-22b6e0d801c9 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:48.400079 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cb821-ce83-4cc2-ba19-22b6e0d801c9 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:48.400079 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cb821-ce83-4cc2-ba19-22b6e0d801c9 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:48.401498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 633/1293] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:17:48.406723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be5b72-d928-463c-9503-d51a641d35ee None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:48.407110 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be5b72-d928-463c-9503-d51a641d35ee None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:48.407279 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be5b72-d928-463c-9503-d51a641d35ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:48.424870 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d3be5b72-d928-463c-9503-d51a641d35ee None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:17:48.426066 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d3be5b72-d928-463c-9503-d51a641d35ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:17:48.503622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 661/1294] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:17:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:17:48.526300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cb821-ce83-4cc2-ba19-22b6e0d801c9 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:48.619672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cb821-ce83-4cc2-ba19-22b6e0d801c9 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:48.651162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10b902-1823-4030-896b-ce827fcf7fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:48.651749 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10b902-1823-4030-896b-ce827fcf7fe1 None admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:48.652028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10b902-1823-4030-896b-ce827fcf7fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:48.652298 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10b902-1823-4030-896b-ce827fcf7fe1 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:48.653041 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10b902-1823-4030-896b-ce827fcf7fe1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:48.654387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10b902-1823-4030-896b-ce827fcf7fe1 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:48.666812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 634/1295] 10.222.0.61 () {60 vars in 1141 bytes} [Tue May 10 20:17:48 2022] POST /identity/v3/services => generated 246 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:17:50.875184 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966e7f-2f7f-4115-8561-c032dc6d49e3 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:50.875715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966e7f-2f7f-4115-8561-c032dc6d49e3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:50.875715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966e7f-2f7f-4115-8561-c032dc6d49e3 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:50.877821 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 662/1296] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:17:50.883189 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8a59-2293-4cb1-bb77-b3d7829c6d55 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:50.883611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8a59-2293-4cb1-bb77-b3d7829c6d55 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:50.883749 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe8a59-2293-4cb1-bb77-b3d7829c6d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:50.900183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-59fe8a59-2293-4cb1-bb77-b3d7829c6d55 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:17:50.901396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-59fe8a59-2293-4cb1-bb77-b3d7829c6d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:17:50.969314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 635/1297] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:17:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:17:50.991877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f966e7f-2f7f-4115-8561-c032dc6d49e3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:51.087211 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f966e7f-2f7f-4115-8561-c032dc6d49e3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:51.117910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6f80b-4034-424b-a7c9-ca2f8d78a2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:51.118689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6f80b-4034-424b-a7c9-ca2f8d78a2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:51.118967 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6f80b-4034-424b-a7c9-ca2f8d78a2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:51.119234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6f80b-4034-424b-a7c9-ca2f8d78a2e9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:51.119866 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6f80b-4034-424b-a7c9-ca2f8d78a2e9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:51.121256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6f80b-4034-424b-a7c9-ca2f8d78a2e9 None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-61a6f80b-4034-424b-a7c9-ca2f8d78a2e9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:51.132960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:51.134127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:51.135269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 663/1298] 10.222.0.61 () {56 vars in 1117 bytes} [Tue May 10 20:17:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:51.140173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8a59-2293-4cb1-bb77-b3d7829c6d55 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:51.234353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe8a59-2293-4cb1-bb77-b3d7829c6d55 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:51.269519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e83fd-a637-4ec9-b113-508aec1f19bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:51.270173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e83fd-a637-4ec9-b113-508aec1f19bc None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:51.270457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e83fd-a637-4ec9-b113-508aec1f19bc None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:51.270732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e83fd-a637-4ec9-b113-508aec1f19bc None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:51.271432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e83fd-a637-4ec9-b113-508aec1f19bc None admin] RBAC: Adding query filter params (name=placement) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:51.271740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e83fd-a637-4ec9-b113-508aec1f19bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:51.273119 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e83fd-a637-4ec9-b113-508aec1f19bc None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:51.278031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 636/1299] 10.222.0.61 () {56 vars in 1116 bytes} [Tue May 10 20:17:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:51.283919 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6f80b-4034-424b-a7c9-ca2f8d78a2e9 None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:51.377697 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6f80b-4034-424b-a7c9-ca2f8d78a2e9 None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:51.409455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a8945-78c9-4685-b149-7a713308e67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:51.410037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a8945-78c9-4685-b149-7a713308e67d None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:51.410319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a8945-78c9-4685-b149-7a713308e67d None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:51.410594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a8945-78c9-4685-b149-7a713308e67d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:51.411369 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a8945-78c9-4685-b149-7a713308e67d None admin] RBAC: Adding query filter params (interface=public, service_id=e30742ee43bc40fab3ed52639977e2ef, region_id=RegionOne) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:51.411682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a8945-78c9-4685-b149-7a713308e67d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:51.413048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a8945-78c9-4685-b149-7a713308e67d None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:51.417748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 664/1300] 10.222.0.61 () {56 vars in 1251 bytes} [Tue May 10 20:17:51 2022] GET /identity/v3/endpoints?service_id=e30742ee43bc40fab3ed52639977e2ef&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:51.423157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e83fd-a637-4ec9-b113-508aec1f19bc None admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:51.527702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e83fd-a637-4ec9-b113-508aec1f19bc None admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:51.558722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec54a20f-ec88-4297-94d8-e857ea248133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:51.559372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54a20f-ec88-4297-94d8-e857ea248133 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:51.559650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54a20f-ec88-4297-94d8-e857ea248133 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:51.559921 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec54a20f-ec88-4297-94d8-e857ea248133 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:51.560591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54a20f-ec88-4297-94d8-e857ea248133 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:51.561958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec54a20f-ec88-4297-94d8-e857ea248133 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:51.568933 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 637/1301] 10.222.0.61 () {56 vars in 1087 bytes} [Tue May 10 20:17:51 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:17:53.776051 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237d8fc-a432-4895-81f8-048b9c9e55c7 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:53.776607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237d8fc-a432-4895-81f8-048b9c9e55c7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:53.776607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237d8fc-a432-4895-81f8-048b9c9e55c7 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:53.777983 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 665/1302] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:17:53.784410 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efe4dd-4659-4821-b0a6-ce65f320eb32 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:53.784837 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efe4dd-4659-4821-b0a6-ce65f320eb32 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:53.785222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efe4dd-4659-4821-b0a6-ce65f320eb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:53.801683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-d6efe4dd-4659-4821-b0a6-ce65f320eb32 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:17:53.802844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d6efe4dd-4659-4821-b0a6-ce65f320eb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:17:53.864905 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 638/1303] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:17:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:17:53.887473 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237d8fc-a432-4895-81f8-048b9c9e55c7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:53.982216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237d8fc-a432-4895-81f8-048b9c9e55c7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:54.015004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ab110-f9f2-4e77-99c4-3801580270da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:54.015793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab110-f9f2-4e77-99c4-3801580270da None admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:54.016076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab110-f9f2-4e77-99c4-3801580270da None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:54.016349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab110-f9f2-4e77-99c4-3801580270da None admin] PATH_INFO: `/v3/services/placement` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:54.017022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ab110-f9f2-4e77-99c4-3801580270da None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:54.018638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ab110-f9f2-4e77-99c4-3801580270da None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application [None req-3c2ab110-f9f2-4e77-99c4-3801580270da None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:17:54.031054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:17:54.036991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application with Lock( May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self._enter() May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application return self.creator() May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application created_value = creator( May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: ERROR keystone.server.flask.application May 10 20:17:54.038097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 666/1304] 10.222.0.61 () {56 vars in 1117 bytes} [Tue May 10 20:17:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:17:54.039078 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efe4dd-4659-4821-b0a6-ce65f320eb32 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:54.129461 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efe4dd-4659-4821-b0a6-ce65f320eb32 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:54.160756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee281d7-2275-47a5-a9d6-7ef89513c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:54.161421 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee281d7-2275-47a5-a9d6-7ef89513c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:54.161702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee281d7-2275-47a5-a9d6-7ef89513c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:54.161973 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee281d7-2275-47a5-a9d6-7ef89513c4a1 None admin] PATH_INFO: `/v3/services` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:54.162666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee281d7-2275-47a5-a9d6-7ef89513c4a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:17:54.162968 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee281d7-2275-47a5-a9d6-7ef89513c4a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:54.164305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee281d7-2275-47a5-a9d6-7ef89513c4a1 None admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:54.169129 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 639/1305] 10.222.0.61 () {56 vars in 1116 bytes} [Tue May 10 20:17:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:17:54.175150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ab110-f9f2-4e77-99c4-3801580270da None admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:17:54.265735 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ab110-f9f2-4e77-99c4-3801580270da None admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:17:54.296624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db8118-0dfc-4a68-9abb-f2f9ff53ba7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:17:54.297222 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db8118-0dfc-4a68-9abb-f2f9ff53ba7f None admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:17:54.297556 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db8118-0dfc-4a68-9abb-f2f9ff53ba7f None admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:17:54.298330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db8118-0dfc-4a68-9abb-f2f9ff53ba7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:17:54.299049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db8118-0dfc-4a68-9abb-f2f9ff53ba7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:17:54.300386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db8118-0dfc-4a68-9abb-f2f9ff53ba7f None admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:17:54.317184 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 667/1306] 10.222.0.61 () {60 vars in 1144 bytes} [Tue May 10 20:17:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:18:57.325501 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5cc70-ac46-4704-a1fc-4ba1ed949b26 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:18:57.327039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5cc70-ac46-4704-a1fc-4ba1ed949b26 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:18:57.327520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5cc70-ac46-4704-a1fc-4ba1ed949b26 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:18:57.334453 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5ec03-fa07-482e-92b0-74eb6634bf0c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:18:57.335302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5ec03-fa07-482e-92b0-74eb6634bf0c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:18:57.335798 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5ec03-fa07-482e-92b0-74eb6634bf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:18:57.339372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 640/1307] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:18:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:18:57.406989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-afa5ec03-fa07-482e-92b0-74eb6634bf0c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:18:57.408545 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-afa5ec03-fa07-482e-92b0-74eb6634bf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:18:57.525475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 668/1308] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:18:57.565625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26d0a-dd03-4cd8-bc48-bb576a0dbd43 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:18:57.566269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26d0a-dd03-4cd8-bc48-bb576a0dbd43 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:18:57.566770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae26d0a-dd03-4cd8-bc48-bb576a0dbd43 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:18:57.568359 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 641/1309] 10.222.0.61 () {54 vars in 964 bytes} [Tue May 10 20:18:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:18:57.574682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611f78c-60a1-4bae-9b22-041930f47a7c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:18:57.575227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611f78c-60a1-4bae-9b22-041930f47a7c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:18:57.575822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611f78c-60a1-4bae-9b22-041930f47a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:18:57.662109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3611f78c-60a1-4bae-9b22-041930f47a7c None None] MFA Rules not processed for user `e31558db83834034b7183223bbd0f84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:18:57.663329 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3611f78c-60a1-4bae-9b22-041930f47a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:18:57.747616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae26d0a-dd03-4cd8-bc48-bb576a0dbd43 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:18:57.749876 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7ae26d0a-dd03-4cd8-bc48-bb576a0dbd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:18:57.753646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 669/1310] 10.222.0.61 () {58 vars in 1061 bytes} [Tue May 10 20:18:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:18:57.908793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae26d0a-dd03-4cd8-bc48-bb576a0dbd43 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:18:58.009614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9fa49-9221-4354-a52b-3667b7697abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:18:58.010277 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9fa49-9221-4354-a52b-3667b7697abd service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:18:58.010557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9fa49-9221-4354-a52b-3667b7697abd service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:18:58.010835 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9fa49-9221-4354-a52b-3667b7697abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:18:58.012499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-49c9fa49-9221-4354-a52b-3667b7697abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:18:58.123263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9fa49-9221-4354-a52b-3667b7697abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:18:58.124608 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9fa49-9221-4354-a52b-3667b7697abd service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:18:58.145632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 642/1311] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:19:00.670183 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb0076-c6d3-4caf-bc82-8cf5fbbd10d8 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:00.671394 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb0076-c6d3-4caf-bc82-8cf5fbbd10d8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:00.671680 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb0076-c6d3-4caf-bc82-8cf5fbbd10d8 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:00.673269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 670/1312] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:00.678720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f02fb-fad2-4b17-80d8-bbf8039b2364 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:00.679144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f02fb-fad2-4b17-80d8-bbf8039b2364 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:00.679265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f02fb-fad2-4b17-80d8-bbf8039b2364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:00.763861 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-502f02fb-fad2-4b17-80d8-bbf8039b2364 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:00.765073 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-502f02fb-fad2-4b17-80d8-bbf8039b2364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:00.861635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 643/1313] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:00.898990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb0076-c6d3-4caf-bc82-8cf5fbbd10d8 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:00.900651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b9fb0076-c6d3-4caf-bc82-8cf5fbbd10d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:01.004745 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb0076-c6d3-4caf-bc82-8cf5fbbd10d8 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:01.075631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dedd64d-1f2d-479f-9fd1-22dc97533540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:01.076201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedd64d-1f2d-479f-9fd1-22dc97533540 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:01.076480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedd64d-1f2d-479f-9fd1-22dc97533540 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:01.076758 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dedd64d-1f2d-479f-9fd1-22dc97533540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:01.078409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4dedd64d-1f2d-479f-9fd1-22dc97533540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:01.183959 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedd64d-1f2d-479f-9fd1-22dc97533540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:01.185476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dedd64d-1f2d-479f-9fd1-22dc97533540 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:01.204552 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 671/1314] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:19:03.736990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5863-e6e2-4db6-9fc3-c52cbc3cb4ad None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:03.737517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5863-e6e2-4db6-9fc3-c52cbc3cb4ad None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:03.737633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5863-e6e2-4db6-9fc3-c52cbc3cb4ad None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:03.738935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 644/1315] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:03.744428 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29899bc6-64b3-45a2-aad8-ae5c99235ed1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:03.744847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29899bc6-64b3-45a2-aad8-ae5c99235ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:03.744994 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29899bc6-64b3-45a2-aad8-ae5c99235ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:03.809209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-29899bc6-64b3-45a2-aad8-ae5c99235ed1 None None] MFA Rules not processed for user `ffeaef636d2b4715ba81d22ce7c0cc52`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:03.810997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-29899bc6-64b3-45a2-aad8-ae5c99235ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:03.902653 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 672/1316] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:03.942368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd5863-e6e2-4db6-9fc3-c52cbc3cb4ad None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:03.943923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fbbd5863-e6e2-4db6-9fc3-c52cbc3cb4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:04.046168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd5863-e6e2-4db6-9fc3-c52cbc3cb4ad None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:04.129158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59334492-c5b5-400f-a5cd-ff0b3655a9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:04.129811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59334492-c5b5-400f-a5cd-ff0b3655a9dc service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:04.130090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59334492-c5b5-400f-a5cd-ff0b3655a9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:04.130362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59334492-c5b5-400f-a5cd-ff0b3655a9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:04.131997 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-59334492-c5b5-400f-a5cd-ff0b3655a9dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:04.235119 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59334492-c5b5-400f-a5cd-ff0b3655a9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:04.236530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59334492-c5b5-400f-a5cd-ff0b3655a9dc service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:04.253343 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 645/1317] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:19:07.046278 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8b293-b723-4205-ab56-2c66f267fafe None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:07.046867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8b293-b723-4205-ab56-2c66f267fafe None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:07.046867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8b293-b723-4205-ab56-2c66f267fafe None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:07.048175 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 673/1318] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:07.053445 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95483759-9982-4dad-b6df-1c1eef893d6b None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:07.053904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95483759-9982-4dad-b6df-1c1eef893d6b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:07.054019 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95483759-9982-4dad-b6df-1c1eef893d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:07.114910 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-95483759-9982-4dad-b6df-1c1eef893d6b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:07.116094 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-95483759-9982-4dad-b6df-1c1eef893d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:07.205990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 646/1319] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:19:07.257373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76518e4a-accf-47fe-b4c8-566f2076fbdf None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:07.257654 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76518e4a-accf-47fe-b4c8-566f2076fbdf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:07.257926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76518e4a-accf-47fe-b4c8-566f2076fbdf None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:07.259322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 674/1320] 10.222.0.61 () {54 vars in 964 bytes} [Tue May 10 20:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:07.265573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195db1e-9530-4fc1-acda-8190fe996ba2 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:07.265860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195db1e-9530-4fc1-acda-8190fe996ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:07.266133 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195db1e-9530-4fc1-acda-8190fe996ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:07.335799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e195db1e-9530-4fc1-acda-8190fe996ba2 None None] MFA Rules not processed for user `e31558db83834034b7183223bbd0f84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:07.337000 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e195db1e-9530-4fc1-acda-8190fe996ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:07.407723 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 647/1321] 10.222.0.61 () {58 vars in 1061 bytes} [Tue May 10 20:19:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:07.416760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76518e4a-accf-47fe-b4c8-566f2076fbdf None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:07.418325 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-76518e4a-accf-47fe-b4c8-566f2076fbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:07.515573 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76518e4a-accf-47fe-b4c8-566f2076fbdf None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:07.583917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5e595-1016-4293-b92d-143e5c4f9f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:07.584554 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e595-1016-4293-b92d-143e5c4f9f66 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:07.584836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e595-1016-4293-b92d-143e5c4f9f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:07.585142 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e595-1016-4293-b92d-143e5c4f9f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:07.586751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-12a5e595-1016-4293-b92d-143e5c4f9f66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:07.688625 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5e595-1016-4293-b92d-143e5c4f9f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:07.690085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5e595-1016-4293-b92d-143e5c4f9f66 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:07.707953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 675/1322] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:19:11.031850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ef326-1439-4bf2-a9da-d54e2c426396 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:11.032384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ef326-1439-4bf2-a9da-d54e2c426396 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:11.032478 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ef326-1439-4bf2-a9da-d54e2c426396 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:11.033816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 648/1323] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:11.039322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a3df4-1bda-4415-912f-944bbbd6c11c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:11.039742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a3df4-1bda-4415-912f-944bbbd6c11c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:11.040043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a3df4-1bda-4415-912f-944bbbd6c11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:11.103298 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-875a3df4-1bda-4415-912f-944bbbd6c11c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:11.104500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-875a3df4-1bda-4415-912f-944bbbd6c11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:11.196635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 676/1324] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:11.232237 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ef326-1439-4bf2-a9da-d54e2c426396 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:11.233819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-766ef326-1439-4bf2-a9da-d54e2c426396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:11.335565 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ef326-1439-4bf2-a9da-d54e2c426396 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:11.406028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ef50e-67f4-4e04-8af2-cb7d2c38e19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:11.406667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef50e-67f4-4e04-8af2-cb7d2c38e19c service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:11.406944 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef50e-67f4-4e04-8af2-cb7d2c38e19c service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:11.407215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ef50e-67f4-4e04-8af2-cb7d2c38e19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:11.408825 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7f2ef50e-67f4-4e04-8af2-cb7d2c38e19c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:11.514352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ef50e-67f4-4e04-8af2-cb7d2c38e19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:11.515698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ef50e-67f4-4e04-8af2-cb7d2c38e19c service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:11.533100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 649/1325] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:19:13.886645 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7470c-fbd1-4b05-8fa7-720b018f94e1 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:13.887221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7470c-fbd1-4b05-8fa7-720b018f94e1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:13.887221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7470c-fbd1-4b05-8fa7-720b018f94e1 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:13.888762 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 677/1326] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:13.894058 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564efb4-c5c2-427b-bb93-ddd4e452796f None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:13.894487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564efb4-c5c2-427b-bb93-ddd4e452796f None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:13.894643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564efb4-c5c2-427b-bb93-ddd4e452796f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:13.956794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e564efb4-c5c2-427b-bb93-ddd4e452796f None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:13.958002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e564efb4-c5c2-427b-bb93-ddd4e452796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:14.057187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 650/1327] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:14.092516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7470c-fbd1-4b05-8fa7-720b018f94e1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:14.094057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-07f7470c-fbd1-4b05-8fa7-720b018f94e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:14.196095 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7470c-fbd1-4b05-8fa7-720b018f94e1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:14.265387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf715770-229f-4fce-94e0-ee9a4bff8784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:14.266025 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf715770-229f-4fce-94e0-ee9a4bff8784 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:14.266302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf715770-229f-4fce-94e0-ee9a4bff8784 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:14.266831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf715770-229f-4fce-94e0-ee9a4bff8784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:14.268428 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cf715770-229f-4fce-94e0-ee9a4bff8784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:14.377887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf715770-229f-4fce-94e0-ee9a4bff8784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:14.379337 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf715770-229f-4fce-94e0-ee9a4bff8784 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:14.397885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 678/1328] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:19:16.653591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e7e16-79bf-44a2-854e-4e7c50e793ec None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:16.654152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e7e16-79bf-44a2-854e-4e7c50e793ec None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:16.654152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e7e16-79bf-44a2-854e-4e7c50e793ec None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:16.655546 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 651/1329] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:16.660800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4f7bc-018a-409c-9d82-297dde26e80c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:16.661252 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4f7bc-018a-409c-9d82-297dde26e80c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:16.661391 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4f7bc-018a-409c-9d82-297dde26e80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:16.725487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-66e4f7bc-018a-409c-9d82-297dde26e80c None None] MFA Rules not processed for user `ffeaef636d2b4715ba81d22ce7c0cc52`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:16.726655 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-66e4f7bc-018a-409c-9d82-297dde26e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:16.818090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 679/1330] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:16.854722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e7e16-79bf-44a2-854e-4e7c50e793ec None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:16.856249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a29e7e16-79bf-44a2-854e-4e7c50e793ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:16.956062 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e7e16-79bf-44a2-854e-4e7c50e793ec None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:17.027035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1287a-f04a-471d-84be-72d55cb21e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:17.027708 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1287a-f04a-471d-84be-72d55cb21e88 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:17.027990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1287a-f04a-471d-84be-72d55cb21e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:17.028264 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1287a-f04a-471d-84be-72d55cb21e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:17.030003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-43f1287a-f04a-471d-84be-72d55cb21e88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:17.134732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1287a-f04a-471d-84be-72d55cb21e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:17.136165 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1287a-f04a-471d-84be-72d55cb21e88 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:17.153504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 652/1331] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:19:19.607536 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254afb8e-312f-4cc2-ad3d-38476a09ad48 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:19.608072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254afb8e-312f-4cc2-ad3d-38476a09ad48 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:19.608072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254afb8e-312f-4cc2-ad3d-38476a09ad48 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:19.609544 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 680/1332] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:19.615202 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f878f4-2dc4-41ba-9986-aa00ceda67d9 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:19.615684 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f878f4-2dc4-41ba-9986-aa00ceda67d9 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:19.615779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f878f4-2dc4-41ba-9986-aa00ceda67d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:19.684549 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-f0f878f4-2dc4-41ba-9986-aa00ceda67d9 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:19.685713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f0f878f4-2dc4-41ba-9986-aa00ceda67d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:19.778756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 653/1333] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:19.814270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254afb8e-312f-4cc2-ad3d-38476a09ad48 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:19.815830 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-254afb8e-312f-4cc2-ad3d-38476a09ad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:19.916561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254afb8e-312f-4cc2-ad3d-38476a09ad48 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:19.986960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b705b-af29-4937-aeae-e759a5b16bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:19.987598 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b705b-af29-4937-aeae-e759a5b16bcc service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:19.987879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b705b-af29-4937-aeae-e759a5b16bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:19.988152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b705b-af29-4937-aeae-e759a5b16bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:19.989790 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f97b705b-af29-4937-aeae-e759a5b16bcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:20.095478 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b705b-af29-4937-aeae-e759a5b16bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:20.096922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b705b-af29-4937-aeae-e759a5b16bcc service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:20.114652 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 681/1334] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:19:22.388204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce205-9ae0-4ce6-8285-e5594e4645b9 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:22.388648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce205-9ae0-4ce6-8285-e5594e4645b9 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:22.388762 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ce205-9ae0-4ce6-8285-e5594e4645b9 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:22.390164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 654/1335] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:22.395540 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01e97-541d-4c39-94ab-52bbdc4ec98c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:22.395966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01e97-541d-4c39-94ab-52bbdc4ec98c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:22.396110 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01e97-541d-4c39-94ab-52bbdc4ec98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:22.464328 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4ae01e97-541d-4c39-94ab-52bbdc4ec98c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:22.465575 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4ae01e97-541d-4c39-94ab-52bbdc4ec98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:22.557913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 682/1336] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:22.598067 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ce205-9ae0-4ce6-8285-e5594e4645b9 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:22.599566 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e99ce205-9ae0-4ce6-8285-e5594e4645b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:22.696457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ce205-9ae0-4ce6-8285-e5594e4645b9 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:22.766722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ab72b-1620-40fe-a11e-3c72dbfe1dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:22.767382 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ab72b-1620-40fe-a11e-3c72dbfe1dcf service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:22.767661 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ab72b-1620-40fe-a11e-3c72dbfe1dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:22.767933 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ab72b-1620-40fe-a11e-3c72dbfe1dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:22.769557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-536ab72b-1620-40fe-a11e-3c72dbfe1dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:22.872203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ab72b-1620-40fe-a11e-3c72dbfe1dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:22.873655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ab72b-1620-40fe-a11e-3c72dbfe1dcf service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:22.891127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 655/1337] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:19:25.380471 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6b015-628e-4c24-b1c5-0bd8fd2e99d8 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:25.381011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6b015-628e-4c24-b1c5-0bd8fd2e99d8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:25.381139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6b015-628e-4c24-b1c5-0bd8fd2e99d8 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:25.382894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 683/1338] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:25.388629 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090086c-eee2-44dd-b6c1-702e050f04ac None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:25.389042 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090086c-eee2-44dd-b6c1-702e050f04ac None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:25.389265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090086c-eee2-44dd-b6c1-702e050f04ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:25.455402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e090086c-eee2-44dd-b6c1-702e050f04ac None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:25.456612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e090086c-eee2-44dd-b6c1-702e050f04ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:25.547561 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 656/1339] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:25.583073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6b015-628e-4c24-b1c5-0bd8fd2e99d8 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:25.584624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-98b6b015-628e-4c24-b1c5-0bd8fd2e99d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:25.682052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6b015-628e-4c24-b1c5-0bd8fd2e99d8 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:25.758626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bb626-c70e-438b-98b8-0b5cf604feb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:25.759272 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bb626-c70e-438b-98b8-0b5cf604feb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:25.759557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bb626-c70e-438b-98b8-0b5cf604feb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:25.759835 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bb626-c70e-438b-98b8-0b5cf604feb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:25.762073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f98bb626-c70e-438b-98b8-0b5cf604feb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:25.865020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bb626-c70e-438b-98b8-0b5cf604feb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:25.866385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bb626-c70e-438b-98b8-0b5cf604feb7 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:25.884317 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 684/1340] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:19:30.210846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b3794-1001-4c43-827e-03541d7514b6 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:30.211384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b3794-1001-4c43-827e-03541d7514b6 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:30.211384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b3794-1001-4c43-827e-03541d7514b6 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:30.212670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 657/1341] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:30.217802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8855b39-e86b-470a-a7b2-239f0f0359bd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:30.218250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8855b39-e86b-470a-a7b2-239f0f0359bd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:30.218423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8855b39-e86b-470a-a7b2-239f0f0359bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:30.286993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b8855b39-e86b-470a-a7b2-239f0f0359bd None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:30.288157 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b8855b39-e86b-470a-a7b2-239f0f0359bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:30.389724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 685/1342] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:30.428011 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b3794-1001-4c43-827e-03541d7514b6 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:30.430245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c18b3794-1001-4c43-827e-03541d7514b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:30.524691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b3794-1001-4c43-827e-03541d7514b6 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:30.528201 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06486e8-ea65-44ed-8bb5-a55f0c34cf8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:30.528848 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06486e8-ea65-44ed-8bb5-a55f0c34cf8b service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:30.529166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06486e8-ea65-44ed-8bb5-a55f0c34cf8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:30.529453 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06486e8-ea65-44ed-8bb5-a55f0c34cf8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:30.538366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06486e8-ea65-44ed-8bb5-a55f0c34cf8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:30.539787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06486e8-ea65-44ed-8bb5-a55f0c34cf8b service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:30.549719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 658/1343] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:19:33.328850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1357d3-2b29-4501-97bc-0c5d7f50c200 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:33.329388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1357d3-2b29-4501-97bc-0c5d7f50c200 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:33.329388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1357d3-2b29-4501-97bc-0c5d7f50c200 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:33.330804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 686/1344] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:33.336093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907075-3c95-4c3a-bc6f-fb54cc3daf89 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:33.336499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907075-3c95-4c3a-bc6f-fb54cc3daf89 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:33.336764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907075-3c95-4c3a-bc6f-fb54cc3daf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:33.364853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6e907075-3c95-4c3a-bc6f-fb54cc3daf89 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:33.366045 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6e907075-3c95-4c3a-bc6f-fb54cc3daf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:33.438590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 659/1345] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:19:33.481860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1357d3-2b29-4501-97bc-0c5d7f50c200 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:33.492441 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1357d3-2b29-4501-97bc-0c5d7f50c200 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:33.495901 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dae63-2f5e-4e8c-bfa5-5fcdf88712aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:33.496557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dae63-2f5e-4e8c-bfa5-5fcdf88712aa service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:33.496833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dae63-2f5e-4e8c-bfa5-5fcdf88712aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:33.497131 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dae63-2f5e-4e8c-bfa5-5fcdf88712aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:33.505690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dae63-2f5e-4e8c-bfa5-5fcdf88712aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:33.507144 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dae63-2f5e-4e8c-bfa5-5fcdf88712aa service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:33.516902 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 687/1346] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:19:37.834310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f447b-2529-409a-b489-c3bc78649191 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:37.834799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f447b-2529-409a-b489-c3bc78649191 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:37.835007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f447b-2529-409a-b489-c3bc78649191 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:37.836486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 660/1347] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:37.841903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dbfe7-6320-412c-abc7-ae8c31e00fea None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:37.842351 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dbfe7-6320-412c-abc7-ae8c31e00fea None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:37.842453 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020dbfe7-6320-412c-abc7-ae8c31e00fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:37.860270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-020dbfe7-6320-412c-abc7-ae8c31e00fea None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:37.861505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-020dbfe7-6320-412c-abc7-ae8c31e00fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:37.869155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 688/1348] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:37.907049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f447b-2529-409a-b489-c3bc78649191 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:37.917369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f447b-2529-409a-b489-c3bc78649191 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:37.921479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d0ccb-aded-42c3-b886-ebec75e9435e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:37.922113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d0ccb-aded-42c3-b886-ebec75e9435e service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:37.922399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d0ccb-aded-42c3-b886-ebec75e9435e service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:37.922678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d0ccb-aded-42c3-b886-ebec75e9435e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:37.931456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d0ccb-aded-42c3-b886-ebec75e9435e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:37.932870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d0ccb-aded-42c3-b886-ebec75e9435e service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:37.942573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 661/1349] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:19:43.207177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf085b92-ee5c-4599-a9bf-3594adf28689 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:43.207956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf085b92-ee5c-4599-a9bf-3594adf28689 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:43.208391 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf085b92-ee5c-4599-a9bf-3594adf28689 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:43.210184 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 689/1350] 10.222.0.61 () {54 vars in 921 bytes} [Tue May 10 20:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:43.214810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5fd8-08a2-40c8-b60f-fa9e6660f3f6 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:43.215710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5fd8-08a2-40c8-b60f-fa9e6660f3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:43.216048 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5fd8-08a2-40c8-b60f-fa9e6660f3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:43.312781 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-897f5fd8-08a2-40c8-b60f-fa9e6660f3f6 None None] MFA Rules not processed for user `a4dc7b58c8a04b359a4a9bbab9e7b219`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:43.314376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-897f5fd8-08a2-40c8-b60f-fa9e6660f3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:43.540834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 662/1351] 10.222.0.61 () {58 vars in 1018 bytes} [Tue May 10 20:19:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:47.639764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b649416-c0ee-4066-a105-fd8b2adff5ef None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:47.640302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b649416-c0ee-4066-a105-fd8b2adff5ef None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:47.640302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b649416-c0ee-4066-a105-fd8b2adff5ef None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:47.641698 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 690/1352] 10.222.0.61 () {54 vars in 921 bytes} [Tue May 10 20:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:47.646991 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830e91c-22e8-4e57-9b32-58ea95d4bf61 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:47.647385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830e91c-22e8-4e57-9b32-58ea95d4bf61 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:47.647601 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830e91c-22e8-4e57-9b32-58ea95d4bf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:47.665946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b830e91c-22e8-4e57-9b32-58ea95d4bf61 None None] MFA Rules not processed for user `a4dc7b58c8a04b359a4a9bbab9e7b219`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:47.667139 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b830e91c-22e8-4e57-9b32-58ea95d4bf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:47.676380 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 663/1353] 10.222.0.61 () {58 vars in 1018 bytes} [Tue May 10 20:19:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:49.273917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5b9c8-4683-44bc-be01-a3f012b6384e None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:49.274338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5b9c8-4683-44bc-be01-a3f012b6384e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:49.274455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5b9c8-4683-44bc-be01-a3f012b6384e None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:49.275794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 691/1354] 10.222.0.61 () {54 vars in 921 bytes} [Tue May 10 20:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:49.281156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc558ee-e2ec-4028-bf1f-0146c5b17636 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:49.281572 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc558ee-e2ec-4028-bf1f-0146c5b17636 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:49.281822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc558ee-e2ec-4028-bf1f-0146c5b17636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:49.300564 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-ecc558ee-e2ec-4028-bf1f-0146c5b17636 None None] MFA Rules not processed for user `a4dc7b58c8a04b359a4a9bbab9e7b219`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:49.301763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ecc558ee-e2ec-4028-bf1f-0146c5b17636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:49.310381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 664/1355] 10.222.0.61 () {58 vars in 1018 bytes} [Tue May 10 20:19:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:19:53.159755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36950-8b4c-4d0f-ab96-56415ec2e939 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:53.160285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36950-8b4c-4d0f-ab96-56415ec2e939 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:53.160379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa36950-8b4c-4d0f-ab96-56415ec2e939 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:53.161830 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 692/1356] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:53.166761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3740569-8f0e-4b26-adbd-aaa45b5bab81 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:53.167145 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3740569-8f0e-4b26-adbd-aaa45b5bab81 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:53.167310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3740569-8f0e-4b26-adbd-aaa45b5bab81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:53.184383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-c3740569-8f0e-4b26-adbd-aaa45b5bab81 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:53.185583 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c3740569-8f0e-4b26-adbd-aaa45b5bab81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:53.193459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 665/1357] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:53.241829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e364a51-a1e7-49cd-afcc-a554697b4f95 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:53.242364 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e364a51-a1e7-49cd-afcc-a554697b4f95 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:53.242802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e364a51-a1e7-49cd-afcc-a554697b4f95 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:53.244565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 693/1358] 10.222.0.61 () {54 vars in 961 bytes} [Tue May 10 20:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:53.250309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199e41f-995c-4748-be08-129c078189c2 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:53.250767 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199e41f-995c-4748-be08-129c078189c2 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:53.251191 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199e41f-995c-4748-be08-129c078189c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:53.300874 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-f199e41f-995c-4748-be08-129c078189c2 None None] MFA Rules not processed for user `8c3c6fe7e21c4c1ebc01cf91c3c05c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:53.302091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f199e41f-995c-4748-be08-129c078189c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:53.386581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 666/1359] 10.222.0.61 () {58 vars in 1058 bytes} [Tue May 10 20:19:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:19:53.395003 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e364a51-a1e7-49cd-afcc-a554697b4f95 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:53.408698 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e364a51-a1e7-49cd-afcc-a554697b4f95 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:53.414924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49356e-c64d-474f-b476-ae734f330bf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:53.415497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49356e-c64d-474f-b476-ae734f330bf4 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:53.415776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49356e-c64d-474f-b476-ae734f330bf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:53.416048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49356e-c64d-474f-b476-ae734f330bf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:53.424865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49356e-c64d-474f-b476-ae734f330bf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:53.426570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49356e-c64d-474f-b476-ae734f330bf4 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:53.437728 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 694/1360] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:19:55.886152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1a3c9-a9c4-4d84-b41d-837830b75aee None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:55.886748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1a3c9-a9c4-4d84-b41d-837830b75aee None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:55.886748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1a3c9-a9c4-4d84-b41d-837830b75aee None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:55.888614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 667/1361] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:55.894208 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160ce4f-7304-45d3-be9e-4c17381ef809 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:55.895001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160ce4f-7304-45d3-be9e-4c17381ef809 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:55.895283 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160ce4f-7304-45d3-be9e-4c17381ef809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:55.912531 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c160ce4f-7304-45d3-be9e-4c17381ef809 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:55.913651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c160ce4f-7304-45d3-be9e-4c17381ef809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:55.921587 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 695/1362] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:19:55.965248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1a3c9-a9c4-4d84-b41d-837830b75aee None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:55.986414 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1a3c9-a9c4-4d84-b41d-837830b75aee None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:55.992133 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa85e3c-2b71-415c-bf4f-8a0cc3bebfb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:55.992778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85e3c-2b71-415c-bf4f-8a0cc3bebfb2 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:55.993086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85e3c-2b71-415c-bf4f-8a0cc3bebfb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:55.993359 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa85e3c-2b71-415c-bf4f-8a0cc3bebfb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:56.002640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa85e3c-2b71-415c-bf4f-8a0cc3bebfb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:56.004225 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa85e3c-2b71-415c-bf4f-8a0cc3bebfb2 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:56.013782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 668/1363] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:19:58.540766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824cb33-e08d-485d-85e2-e3fe8d8151ec None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:58.541288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824cb33-e08d-485d-85e2-e3fe8d8151ec None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:58.541394 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824cb33-e08d-485d-85e2-e3fe8d8151ec None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:58.542758 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 696/1364] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:58.549034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67066681-0cd5-4af1-a9ad-4f1f95f60d34 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:58.549034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67066681-0cd5-4af1-a9ad-4f1f95f60d34 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:58.549563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67066681-0cd5-4af1-a9ad-4f1f95f60d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:58.567341 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-67066681-0cd5-4af1-a9ad-4f1f95f60d34 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:58.568699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-67066681-0cd5-4af1-a9ad-4f1f95f60d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:58.577235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 669/1365] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:19:58.626105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ec0c2-749c-4308-8552-ea0a448ce3ce None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:58.626394 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ec0c2-749c-4308-8552-ea0a448ce3ce None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:58.626677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ec0c2-749c-4308-8552-ea0a448ce3ce None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:58.628044 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 697/1366] 10.222.0.61 () {54 vars in 961 bytes} [Tue May 10 20:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:19:58.633728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf8b87-e44d-4371-8d44-d272becd242b None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:58.634023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf8b87-e44d-4371-8d44-d272becd242b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:58.634302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf8b87-e44d-4371-8d44-d272becd242b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:58.652962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6bcf8b87-e44d-4371-8d44-d272becd242b None None] MFA Rules not processed for user `8c3c6fe7e21c4c1ebc01cf91c3c05c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:19:58.654159 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6bcf8b87-e44d-4371-8d44-d272becd242b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:19:58.663540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 670/1367] 10.222.0.61 () {58 vars in 1058 bytes} [Tue May 10 20:19:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:19:58.671834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ec0c2-749c-4308-8552-ea0a448ce3ce None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:19:58.689079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ec0c2-749c-4308-8552-ea0a448ce3ce None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:19:58.698335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f65bac-c791-4920-b40b-12bf04236458 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:19:58.699116 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f65bac-c791-4920-b40b-12bf04236458 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:19:58.699498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f65bac-c791-4920-b40b-12bf04236458 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:19:58.699966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f65bac-c791-4920-b40b-12bf04236458 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:19:58.709283 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f65bac-c791-4920-b40b-12bf04236458 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:19:58.710932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f65bac-c791-4920-b40b-12bf04236458 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:19:58.720796 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 698/1368] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:01.053327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d054ef-1ad4-4c7e-8dda-861746b77605 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:01.054392 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d054ef-1ad4-4c7e-8dda-861746b77605 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:01.054973 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d054ef-1ad4-4c7e-8dda-861746b77605 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:01.057205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 671/1369] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:20:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:01.063315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becad26b-b175-4402-bb65-43961393331b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:01.063755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becad26b-b175-4402-bb65-43961393331b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:01.063870 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becad26b-b175-4402-bb65-43961393331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:01.082353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-becad26b-b175-4402-bb65-43961393331b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:01.083526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-becad26b-b175-4402-bb65-43961393331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:01.095023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 699/1370] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:01.143550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d054ef-1ad4-4c7e-8dda-861746b77605 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:01.161835 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d054ef-1ad4-4c7e-8dda-861746b77605 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:01.167652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ddfc8-ad07-48fa-bd6e-425b0a662e41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:01.168827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ddfc8-ad07-48fa-bd6e-425b0a662e41 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:01.169355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ddfc8-ad07-48fa-bd6e-425b0a662e41 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:01.170030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ddfc8-ad07-48fa-bd6e-425b0a662e41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:01.182097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ddfc8-ad07-48fa-bd6e-425b0a662e41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:01.184694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ddfc8-ad07-48fa-bd6e-425b0a662e41 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:01.194801 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 672/1371] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:20:01.314156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941de544-b2ab-451e-b1e9-73fa7f1890d8 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:01.314443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941de544-b2ab-451e-b1e9-73fa7f1890d8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:01.314928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941de544-b2ab-451e-b1e9-73fa7f1890d8 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:01.316532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 700/1372] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:01.322677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f340434-94b2-4a59-a812-79af483980e7 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:01.323094 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f340434-94b2-4a59-a812-79af483980e7 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:01.323447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f340434-94b2-4a59-a812-79af483980e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:01.344261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-0f340434-94b2-4a59-a812-79af483980e7 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:01.345755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0f340434-94b2-4a59-a812-79af483980e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:01.356212 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 673/1373] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:01.666644 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e79e-20af-40c9-8b5f-a9b41b1a4a8a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:01.666938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e79e-20af-40c9-8b5f-a9b41b1a4a8a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:01.667251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b757e79e-20af-40c9-8b5f-a9b41b1a4a8a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:01.669501 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 701/1374] 10.222.0.61 () {54 vars in 963 bytes} [Tue May 10 20:20:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:01.674533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f22e92-aa7b-4aad-a19c-7f4d9b27a750 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:01.674927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f22e92-aa7b-4aad-a19c-7f4d9b27a750 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:01.675302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f22e92-aa7b-4aad-a19c-7f4d9b27a750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:01.726330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-30f22e92-aa7b-4aad-a19c-7f4d9b27a750 None None] MFA Rules not processed for user `f319323b3f3547849d452c1361764005`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:01.727672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-30f22e92-aa7b-4aad-a19c-7f4d9b27a750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:01.789568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 674/1375] 10.222.0.61 () {58 vars in 1060 bytes} [Tue May 10 20:20:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:20:01.797206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757e79e-20af-40c9-8b5f-a9b41b1a4a8a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:01.807647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b757e79e-20af-40c9-8b5f-a9b41b1a4a8a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:01.811817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155506c-1591-49f6-8dd7-14f51495b255 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:01.812659 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155506c-1591-49f6-8dd7-14f51495b255 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:01.812948 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155506c-1591-49f6-8dd7-14f51495b255 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:01.813276 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155506c-1591-49f6-8dd7-14f51495b255 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:01.822833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155506c-1591-49f6-8dd7-14f51495b255 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:01.824370 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155506c-1591-49f6-8dd7-14f51495b255 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:01.834485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 702/1376] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:03.448075 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8338157-4ba0-47ed-b25b-e27d53d52689 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:03.448643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8338157-4ba0-47ed-b25b-e27d53d52689 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:03.448643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8338157-4ba0-47ed-b25b-e27d53d52689 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:03.450628 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 675/1377] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:03.456953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61183b-283b-4832-96e8-4684d86c61c5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:03.457508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61183b-283b-4832-96e8-4684d86c61c5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:03.457642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61183b-283b-4832-96e8-4684d86c61c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:03.476036 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7a61183b-283b-4832-96e8-4684d86c61c5 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:03.477294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7a61183b-283b-4832-96e8-4684d86c61c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:03.485889 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 703/1378] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:03.530991 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8338157-4ba0-47ed-b25b-e27d53d52689 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:03.546091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8338157-4ba0-47ed-b25b-e27d53d52689 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:03.551520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40abcfe-f987-469e-bce7-6ac02c9b4a35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:03.552177 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40abcfe-f987-469e-bce7-6ac02c9b4a35 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:03.552462 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40abcfe-f987-469e-bce7-6ac02c9b4a35 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:03.552739 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40abcfe-f987-469e-bce7-6ac02c9b4a35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:03.562334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40abcfe-f987-469e-bce7-6ac02c9b4a35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:03.564076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40abcfe-f987-469e-bce7-6ac02c9b4a35 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:03.574007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 676/1379] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:05.850195 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26abc92-a214-429c-b543-1304986937af None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:05.850772 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26abc92-a214-429c-b543-1304986937af None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:05.851054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26abc92-a214-429c-b543-1304986937af None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:05.853092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 704/1380] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:20:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:05.857971 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff79c3-fc53-4fa0-a8da-7d117285f315 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:05.858390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff79c3-fc53-4fa0-a8da-7d117285f315 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:05.858534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff79c3-fc53-4fa0-a8da-7d117285f315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:05.876011 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-81ff79c3-fc53-4fa0-a8da-7d117285f315 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:05.877257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-81ff79c3-fc53-4fa0-a8da-7d117285f315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:05.885145 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 677/1381] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:05.929319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26abc92-a214-429c-b543-1304986937af None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:05.945089 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26abc92-a214-429c-b543-1304986937af None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:05.951348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e1abd-f423-4b9e-ac2c-2254ee2c19b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:05.952099 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e1abd-f423-4b9e-ac2c-2254ee2c19b7 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:05.952484 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e1abd-f423-4b9e-ac2c-2254ee2c19b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:05.952857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e1abd-f423-4b9e-ac2c-2254ee2c19b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:05.961633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e1abd-f423-4b9e-ac2c-2254ee2c19b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:05.963368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e1abd-f423-4b9e-ac2c-2254ee2c19b7 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:05.976663 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 705/1382] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:08.254756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926011-ce58-4107-8aaf-1b763e494a8e None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:08.255450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926011-ce58-4107-8aaf-1b763e494a8e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:08.255450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926011-ce58-4107-8aaf-1b763e494a8e None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:08.256767 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 678/1383] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:08.263499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77af52-3055-4570-873c-59d8864e2022 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:08.264105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77af52-3055-4570-873c-59d8864e2022 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:08.264105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77af52-3055-4570-873c-59d8864e2022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:08.283673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7b77af52-3055-4570-873c-59d8864e2022 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:08.285195 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7b77af52-3055-4570-873c-59d8864e2022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:08.293114 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 706/1384] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:08.335524 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b926011-ce58-4107-8aaf-1b763e494a8e None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:08.350555 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b926011-ce58-4107-8aaf-1b763e494a8e None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:08.356459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770069e-e48e-485d-ad23-9d9464d09f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:08.357269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770069e-e48e-485d-ad23-9d9464d09f59 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:08.357655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770069e-e48e-485d-ad23-9d9464d09f59 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:08.358030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770069e-e48e-485d-ad23-9d9464d09f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:08.366840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770069e-e48e-485d-ad23-9d9464d09f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:08.368512 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770069e-e48e-485d-ad23-9d9464d09f59 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:08.378846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 679/1385] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:20:10.617451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d67d8c-1566-4d5b-9c25-0511444af3ac None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:10.618195 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d67d8c-1566-4d5b-9c25-0511444af3ac None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:10.618195 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d67d8c-1566-4d5b-9c25-0511444af3ac None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:10.619383 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 707/1386] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:10.624752 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0afd63-2343-4d46-8a80-60a8b05ad556 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:10.625214 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0afd63-2343-4d46-8a80-60a8b05ad556 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:10.625347 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0afd63-2343-4d46-8a80-60a8b05ad556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:10.643716 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-7f0afd63-2343-4d46-8a80-60a8b05ad556 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:10.644916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7f0afd63-2343-4d46-8a80-60a8b05ad556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:10.653682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 680/1387] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:10.704798 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d67d8c-1566-4d5b-9c25-0511444af3ac None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:10.724071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d67d8c-1566-4d5b-9c25-0511444af3ac None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:10.733392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952785f5-62b2-4ca3-8e3b-1a786dd0aac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:10.734328 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952785f5-62b2-4ca3-8e3b-1a786dd0aac6 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:10.734800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952785f5-62b2-4ca3-8e3b-1a786dd0aac6 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:10.735342 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952785f5-62b2-4ca3-8e3b-1a786dd0aac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:10.748299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952785f5-62b2-4ca3-8e3b-1a786dd0aac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:10.750464 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952785f5-62b2-4ca3-8e3b-1a786dd0aac6 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:10.761789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 708/1388] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:13.227742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1634f-2a3f-49d8-ba53-1b196d7e54f7 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:13.228328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1634f-2a3f-49d8-ba53-1b196d7e54f7 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:13.228478 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1634f-2a3f-49d8-ba53-1b196d7e54f7 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:13.230388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 681/1389] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:13.236187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4a721-b4d7-449a-a31c-4af8ee94c780 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:13.236610 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4a721-b4d7-449a-a31c-4af8ee94c780 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:13.236693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4a721-b4d7-449a-a31c-4af8ee94c780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:13.254471 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0ca4a721-b4d7-449a-a31c-4af8ee94c780 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:13.255653 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0ca4a721-b4d7-449a-a31c-4af8ee94c780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:13.265487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 709/1390] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:13.311430 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1634f-2a3f-49d8-ba53-1b196d7e54f7 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:13.325588 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1634f-2a3f-49d8-ba53-1b196d7e54f7 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:13.330959 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13afe2e-9365-4231-b178-795f1924f6aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:13.331590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13afe2e-9365-4231-b178-795f1924f6aa service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:13.331872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13afe2e-9365-4231-b178-795f1924f6aa service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:13.332144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13afe2e-9365-4231-b178-795f1924f6aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:13.339978 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13afe2e-9365-4231-b178-795f1924f6aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:13.341640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13afe2e-9365-4231-b178-795f1924f6aa service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:13.350670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 682/1391] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:15.604040 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b158e2-9468-4726-a3f9-3cedec95a722 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:15.604595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b158e2-9468-4726-a3f9-3cedec95a722 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:15.604595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b158e2-9468-4726-a3f9-3cedec95a722 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:15.606461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 710/1392] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:20:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:15.611829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d24e0-07f5-4496-a526-b8a3fdb73393 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:15.612263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d24e0-07f5-4496-a526-b8a3fdb73393 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:15.612363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d24e0-07f5-4496-a526-b8a3fdb73393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:15.630111 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-aa9d24e0-07f5-4496-a526-b8a3fdb73393 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:15.631296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-aa9d24e0-07f5-4496-a526-b8a3fdb73393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:15.638998 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 683/1393] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:15.682685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b158e2-9468-4726-a3f9-3cedec95a722 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:15.697410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b158e2-9468-4726-a3f9-3cedec95a722 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:15.702769 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad656d7d-c8fa-4237-a13f-157e0c6d5131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:15.703410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad656d7d-c8fa-4237-a13f-157e0c6d5131 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:15.703692 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad656d7d-c8fa-4237-a13f-157e0c6d5131 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:15.703966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad656d7d-c8fa-4237-a13f-157e0c6d5131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:15.712028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad656d7d-c8fa-4237-a13f-157e0c6d5131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:15.713643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad656d7d-c8fa-4237-a13f-157e0c6d5131 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:15.722887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 711/1394] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:17.565105 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b097d-b84a-4b92-9fcf-9d7a741d63f2 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:17.565616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b097d-b84a-4b92-9fcf-9d7a741d63f2 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:17.565616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b097d-b84a-4b92-9fcf-9d7a741d63f2 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:17.566963 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 684/1395] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:17.572201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521b756-9c11-46ad-9a3f-a5560daa4687 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:17.572642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521b756-9c11-46ad-9a3f-a5560daa4687 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:17.572739 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521b756-9c11-46ad-9a3f-a5560daa4687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:17.590627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1521b756-9c11-46ad-9a3f-a5560daa4687 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:17.591814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1521b756-9c11-46ad-9a3f-a5560daa4687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:17.599529 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 712/1396] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:17.655329 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f975d25-4c60-4247-9a00-24a461296839 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:17.655622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f975d25-4c60-4247-9a00-24a461296839 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:17.655904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f975d25-4c60-4247-9a00-24a461296839 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:17.657304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 685/1397] 10.222.0.61 () {54 vars in 962 bytes} [Tue May 10 20:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:17.662574 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2434f-0b34-486d-9d4c-42b9eef2dbdd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:17.662959 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2434f-0b34-486d-9d4c-42b9eef2dbdd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:17.663333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2434f-0b34-486d-9d4c-42b9eef2dbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:17.710577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5fa2434f-0b34-486d-9d4c-42b9eef2dbdd None None] MFA Rules not processed for user `9f59e7ae8da841dc809355fa8e4be488`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:17.711752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5fa2434f-0b34-486d-9d4c-42b9eef2dbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:17.769071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 713/1398] 10.222.0.61 () {58 vars in 1059 bytes} [Tue May 10 20:20:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:17.776577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f975d25-4c60-4247-9a00-24a461296839 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:17.788592 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f975d25-4c60-4247-9a00-24a461296839 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:17.792226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9e317-da7f-46ee-9188-b6cd7f5c82b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f59e7ae8da841dc809355fa8e4be488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:17.792902 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9e317-da7f-46ee-9188-b6cd7f5c82b1 service glance] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:17.793224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9e317-da7f-46ee-9188-b6cd7f5c82b1 service glance] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:17.793534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9e317-da7f-46ee-9188-b6cd7f5c82b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:17.803446 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9e317-da7f-46ee-9188-b6cd7f5c82b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:17.804903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9e317-da7f-46ee-9188-b6cd7f5c82b1 service glance] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:17.815403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 686/1399] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:17.983636 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63882c7-a9e2-4863-af9a-7c2b21c8a541 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:17.983636 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63882c7-a9e2-4863-af9a-7c2b21c8a541 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:17.983636 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63882c7-a9e2-4863-af9a-7c2b21c8a541 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:17.985212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 714/1400] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:17.990924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca08597-1f33-47b6-b020-baf64ab6b3f6 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:17.991220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca08597-1f33-47b6-b020-baf64ab6b3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:17.991500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca08597-1f33-47b6-b020-baf64ab6b3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:18.013828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6ca08597-1f33-47b6-b020-baf64ab6b3f6 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:18.015040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6ca08597-1f33-47b6-b020-baf64ab6b3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:18.025019 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 687/1401] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:18.071762 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63882c7-a9e2-4863-af9a-7c2b21c8a541 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:18.086841 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63882c7-a9e2-4863-af9a-7c2b21c8a541 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:18.092780 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf9e8f-18bb-4ec7-b483-39ad4a6d74e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:18.093497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf9e8f-18bb-4ec7-b483-39ad4a6d74e9 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:18.093787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf9e8f-18bb-4ec7-b483-39ad4a6d74e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:18.094072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf9e8f-18bb-4ec7-b483-39ad4a6d74e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:18.102769 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf9e8f-18bb-4ec7-b483-39ad4a6d74e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:18.104368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf9e8f-18bb-4ec7-b483-39ad4a6d74e9 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:18.113818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 715/1402] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:18.250231 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a432ef-287e-488e-9780-3023cd0e4d32 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:18.250522 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a432ef-287e-488e-9780-3023cd0e4d32 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:18.250802 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a432ef-287e-488e-9780-3023cd0e4d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:18.301945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-f8a432ef-287e-488e-9780-3023cd0e4d32 None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:18.303180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f8a432ef-287e-488e-9780-3023cd0e4d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:18.368649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 688/1403] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:20:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:18.411074 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60078d10-f1c6-4ade-82f1-fb86c2dd22ea None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:18.411367 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60078d10-f1c6-4ade-82f1-fb86c2dd22ea None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:18.411645 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60078d10-f1c6-4ade-82f1-fb86c2dd22ea None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:18.413054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 716/1404] 10.222.0.61 () {54 vars in 942 bytes} [Tue May 10 20:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:18.419327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526a47c-3f50-46ab-9eec-c5ee6dcdfafe None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:18.419620 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526a47c-3f50-46ab-9eec-c5ee6dcdfafe None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:18.419933 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526a47c-3f50-46ab-9eec-c5ee6dcdfafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:18.473144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-9526a47c-3f50-46ab-9eec-c5ee6dcdfafe None None] MFA Rules not processed for user `6acfba37d6b84bf3a63d40e6e4096f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:18.474931 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9526a47c-3f50-46ab-9eec-c5ee6dcdfafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:18.545946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 689/1405] 10.222.0.61 () {58 vars in 1039 bytes} [Tue May 10 20:20:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:20:18.555673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60078d10-f1c6-4ade-82f1-fb86c2dd22ea None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:18.569570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60078d10-f1c6-4ade-82f1-fb86c2dd22ea None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:18.574539 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a274f-279c-4453-82f4-71ce18d21511 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:18.575273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a274f-279c-4453-82f4-71ce18d21511 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:18.575627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a274f-279c-4453-82f4-71ce18d21511 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:18.575973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a274f-279c-4453-82f4-71ce18d21511 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:18.583859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a274f-279c-4453-82f4-71ce18d21511 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:18.585474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a274f-279c-4453-82f4-71ce18d21511 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:18.593525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 717/1406] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:20:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:20:20.386531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb032c8-cff6-4e62-a54d-8e8bb258931b None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:20.387114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb032c8-cff6-4e62-a54d-8e8bb258931b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:20.387734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb032c8-cff6-4e62-a54d-8e8bb258931b None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:20.389049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 690/1407] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:20.394480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae1c69-a860-454b-b6fa-5188eab9ac79 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:20.394940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae1c69-a860-454b-b6fa-5188eab9ac79 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:20.395173 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae1c69-a860-454b-b6fa-5188eab9ac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:20.413073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a6ae1c69-a860-454b-b6fa-5188eab9ac79 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:20.414348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a6ae1c69-a860-454b-b6fa-5188eab9ac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:20.422599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 718/1408] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:20.467379 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb032c8-cff6-4e62-a54d-8e8bb258931b None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:20.485149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb032c8-cff6-4e62-a54d-8e8bb258931b None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:20.494181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe27a43-5d44-4466-aa07-7ff37bf1966d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:20.495125 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe27a43-5d44-4466-aa07-7ff37bf1966d service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:20.495266 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe27a43-5d44-4466-aa07-7ff37bf1966d service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:20.496346 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe27a43-5d44-4466-aa07-7ff37bf1966d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:20.525782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe27a43-5d44-4466-aa07-7ff37bf1966d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:20.528406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe27a43-5d44-4466-aa07-7ff37bf1966d service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:20.541973 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 691/1409] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:42.221892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dcaa0-7497-4b0d-a787-3a2d33343c7a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:42.222522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dcaa0-7497-4b0d-a787-3a2d33343c7a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:42.222522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dcaa0-7497-4b0d-a787-3a2d33343c7a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:42.223801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 719/1410] 10.222.0.61 () {54 vars in 918 bytes} [Tue May 10 20:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:42.229006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd9631-5ce3-4b01-872f-88bcc8bf7f6b None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:42.229498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd9631-5ce3-4b01-872f-88bcc8bf7f6b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:42.229616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd9631-5ce3-4b01-872f-88bcc8bf7f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:42.247093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-c2fd9631-5ce3-4b01-872f-88bcc8bf7f6b None None] MFA Rules not processed for user `a4dc7b58c8a04b359a4a9bbab9e7b219`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:42.248803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c2fd9631-5ce3-4b01-872f-88bcc8bf7f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:42.257230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 692/1411] 10.222.0.61 () {58 vars in 1015 bytes} [Tue May 10 20:20:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:42.271853 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d773a1-f634-4a4f-b801-de71cfb5a6ee None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:42.272145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d773a1-f634-4a4f-b801-de71cfb5a6ee None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:42.272420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d773a1-f634-4a4f-b801-de71cfb5a6ee None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:42.273773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 720/1412] 10.222.0.61 () {54 vars in 918 bytes} [Tue May 10 20:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:42.278143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494fb07-451a-4d82-9818-f90349f64099 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:42.278503 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494fb07-451a-4d82-9818-f90349f64099 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:42.278786 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494fb07-451a-4d82-9818-f90349f64099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:42.295617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-4494fb07-451a-4d82-9818-f90349f64099 None None] MFA Rules not processed for user `8c3c6fe7e21c4c1ebc01cf91c3c05c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:42.296763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-4494fb07-451a-4d82-9818-f90349f64099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:42.305788 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 693/1413] 10.222.0.61 () {58 vars in 1015 bytes} [Tue May 10 20:20:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:20:44.951222 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7768de-c19c-4b13-860e-c08d3e0165d3 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:44.951793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7768de-c19c-4b13-860e-c08d3e0165d3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:44.951793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7768de-c19c-4b13-860e-c08d3e0165d3 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:44.953157 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 721/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:44.958324 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405e629-5b9a-44b1-ae91-7a04092c0c8a None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:44.958756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405e629-5b9a-44b1-ae91-7a04092c0c8a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:44.958883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405e629-5b9a-44b1-ae91-7a04092c0c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:44.975995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-0405e629-5b9a-44b1-ae91-7a04092c0c8a None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:44.977196 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0405e629-5b9a-44b1-ae91-7a04092c0c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:44.985448 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 694/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:45.026060 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7768de-c19c-4b13-860e-c08d3e0165d3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:45.039936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7768de-c19c-4b13-860e-c08d3e0165d3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:45.045732 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bda96c-65bc-441d-a24c-f323cdf9ef2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:45.046359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bda96c-65bc-441d-a24c-f323cdf9ef2e service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:45.046637 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bda96c-65bc-441d-a24c-f323cdf9ef2e service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:45.046936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bda96c-65bc-441d-a24c-f323cdf9ef2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:45.054715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bda96c-65bc-441d-a24c-f323cdf9ef2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:45.056273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bda96c-65bc-441d-a24c-f323cdf9ef2e service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:45.065884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 722/1416] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:46.049157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6d99d-60a9-4121-b800-116d83b1080e None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:46.049702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6d99d-60a9-4121-b800-116d83b1080e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:46.049702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6d99d-60a9-4121-b800-116d83b1080e None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:46.051088 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 695/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 20:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:46.056092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f2d38-b519-4877-bc02-ca21ffb9c278 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:46.056512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f2d38-b519-4877-bc02-ca21ffb9c278 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:46.056726 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f2d38-b519-4877-bc02-ca21ffb9c278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:46.074661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-957f2d38-b519-4877-bc02-ca21ffb9c278 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:46.076443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-957f2d38-b519-4877-bc02-ca21ffb9c278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:46.084141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 723/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 20:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:46.261155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6d99d-60a9-4121-b800-116d83b1080e None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:46.275579 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6d99d-60a9-4121-b800-116d83b1080e None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:46.280947 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db95386-c6d1-4b68-ae09-ef32dcb2945a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:46.281613 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db95386-c6d1-4b68-ae09-ef32dcb2945a service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:46.281917 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db95386-c6d1-4b68-ae09-ef32dcb2945a service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:46.282180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db95386-c6d1-4b68-ae09-ef32dcb2945a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:46.290055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db95386-c6d1-4b68-ae09-ef32dcb2945a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:46.291628 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db95386-c6d1-4b68-ae09-ef32dcb2945a service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:46.301173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 696/1419] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:47.243450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfa4b4-d6b2-47b1-ab2b-1719ae7d9d1d None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:47.243965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfa4b4-d6b2-47b1-ab2b-1719ae7d9d1d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:47.243965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfa4b4-d6b2-47b1-ab2b-1719ae7d9d1d None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:47.245335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 724/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 20:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:47.251045 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194146e4-ef33-434d-a9aa-3f0bc411964e None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:47.251435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194146e4-ef33-434d-a9aa-3f0bc411964e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:47.251606 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194146e4-ef33-434d-a9aa-3f0bc411964e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:47.269900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-194146e4-ef33-434d-a9aa-3f0bc411964e None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:47.271083 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-194146e4-ef33-434d-a9aa-3f0bc411964e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:47.278753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 697/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 20:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:47.437532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfa4b4-d6b2-47b1-ab2b-1719ae7d9d1d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:47.451418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfa4b4-d6b2-47b1-ab2b-1719ae7d9d1d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:47.457403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4e322-3b94-430a-b649-b2a989f6dbd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:47.458035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e322-3b94-430a-b649-b2a989f6dbd8 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:47.458316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e322-3b94-430a-b649-b2a989f6dbd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:47.458590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e322-3b94-430a-b649-b2a989f6dbd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:47.467266 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4e322-3b94-430a-b649-b2a989f6dbd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:47.468825 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4e322-3b94-430a-b649-b2a989f6dbd8 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:47.478111 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 725/1422] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:48.400266 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41695-d44a-4f39-9d5d-28a22d696fc3 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:48.400786 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41695-d44a-4f39-9d5d-28a22d696fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:48.400913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41695-d44a-4f39-9d5d-28a22d696fc3 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:48.402256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 698/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 20:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:48.407273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba0253-bd20-4bbb-b4cf-d6ab1b5c6765 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:48.407666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba0253-bd20-4bbb-b4cf-d6ab1b5c6765 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:48.407828 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba0253-bd20-4bbb-b4cf-d6ab1b5c6765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:48.426928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-35ba0253-bd20-4bbb-b4cf-d6ab1b5c6765 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:48.428110 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-35ba0253-bd20-4bbb-b4cf-d6ab1b5c6765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:48.436596 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 726/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 20:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:20:48.584997 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea41695-d44a-4f39-9d5d-28a22d696fc3 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:48.599600 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea41695-d44a-4f39-9d5d-28a22d696fc3 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:48.604946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c3c7e-8135-4d54-8f43-94b21f073397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:48.605599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3c7e-8135-4d54-8f43-94b21f073397 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:48.605884 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3c7e-8135-4d54-8f43-94b21f073397 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:48.606157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3c7e-8135-4d54-8f43-94b21f073397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:48.614008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c3c7e-8135-4d54-8f43-94b21f073397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:48.615581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c3c7e-8135-4d54-8f43-94b21f073397 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:48.624733 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 699/1425] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:49.545222 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c12546-37d4-493f-854d-869d0f8fd062 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:49.545754 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c12546-37d4-493f-854d-869d0f8fd062 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:49.545754 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c12546-37d4-493f-854d-869d0f8fd062 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:49.547119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 727/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 20:20:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:49.551968 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d0df1-1d26-48bb-a5ed-1e3e16962fb1 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:49.552350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d0df1-1d26-48bb-a5ed-1e3e16962fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:49.552525 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d0df1-1d26-48bb-a5ed-1e3e16962fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:49.570444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-f27d0df1-1d26-48bb-a5ed-1e3e16962fb1 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:49.571557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f27d0df1-1d26-48bb-a5ed-1e3e16962fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:49.579167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 700/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 20:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:49.728143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c12546-37d4-493f-854d-869d0f8fd062 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:49.741784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c12546-37d4-493f-854d-869d0f8fd062 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:49.746947 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966caad-e606-4271-aed5-4f3ae82abd09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:49.748149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966caad-e606-4271-aed5-4f3ae82abd09 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:49.748424 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966caad-e606-4271-aed5-4f3ae82abd09 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:49.748689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966caad-e606-4271-aed5-4f3ae82abd09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:49.756385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966caad-e606-4271-aed5-4f3ae82abd09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:49.757976 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966caad-e606-4271-aed5-4f3ae82abd09 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:49.767465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 728/1428] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:50.632386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3001bb-0485-4abe-b86d-d4cbcb633e6a None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:50.632957 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3001bb-0485-4abe-b86d-d4cbcb633e6a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:50.632957 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3001bb-0485-4abe-b86d-d4cbcb633e6a None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:50.634367 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 701/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 20:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:20:50.639946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505abe0-eed4-4b17-a340-e7fb86b2fd63 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:50.640336 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505abe0-eed4-4b17-a340-e7fb86b2fd63 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:50.640491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505abe0-eed4-4b17-a340-e7fb86b2fd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:50.657931 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c505abe0-eed4-4b17-a340-e7fb86b2fd63 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:50.659094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c505abe0-eed4-4b17-a340-e7fb86b2fd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:50.666753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 729/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 20:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:50.814343 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3001bb-0485-4abe-b86d-d4cbcb633e6a None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:50.828428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3001bb-0485-4abe-b86d-d4cbcb633e6a None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:50.833882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe4396-6f91-4680-b5c6-6f1562ba7cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:50.834511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe4396-6f91-4680-b5c6-6f1562ba7cd3 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:50.834796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe4396-6f91-4680-b5c6-6f1562ba7cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:50.835074 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe4396-6f91-4680-b5c6-6f1562ba7cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:50.842877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe4396-6f91-4680-b5c6-6f1562ba7cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:50.844439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe4396-6f91-4680-b5c6-6f1562ba7cd3 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:50.853539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 702/1431] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:51.730165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0a88a-fbc6-472e-9876-88d763e880cb None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:51.730706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0a88a-fbc6-472e-9876-88d763e880cb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:51.730706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0a88a-fbc6-472e-9876-88d763e880cb None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:51.732165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 730/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 20:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:51.737125 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a5664-3a70-4ff0-b3f3-c271bb705d76 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:51.737536 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a5664-3a70-4ff0-b3f3-c271bb705d76 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:51.737677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a5664-3a70-4ff0-b3f3-c271bb705d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:51.754836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-033a5664-3a70-4ff0-b3f3-c271bb705d76 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:51.756033 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-033a5664-3a70-4ff0-b3f3-c271bb705d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:51.764058 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 703/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 20:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:51.910454 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0a88a-fbc6-472e-9876-88d763e880cb None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:51.924124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0a88a-fbc6-472e-9876-88d763e880cb None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:51.929301 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e2b84-9f27-4f1f-b3cb-61669cd8bc42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:51.929953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e2b84-9f27-4f1f-b3cb-61669cd8bc42 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:51.930233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e2b84-9f27-4f1f-b3cb-61669cd8bc42 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:51.930506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e2b84-9f27-4f1f-b3cb-61669cd8bc42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:51.938750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e2b84-9f27-4f1f-b3cb-61669cd8bc42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:51.940302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e2b84-9f27-4f1f-b3cb-61669cd8bc42 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:51.949251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 731/1434] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:52.817347 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62267c8-6d32-49bc-ad1a-e28d76746953 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:52.817892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62267c8-6d32-49bc-ad1a-e28d76746953 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:52.817892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62267c8-6d32-49bc-ad1a-e28d76746953 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:52.819284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 704/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 20:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:52.824315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2114244-ae04-483c-8e9f-39246ca42d10 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:52.824768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2114244-ae04-483c-8e9f-39246ca42d10 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:52.824867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2114244-ae04-483c-8e9f-39246ca42d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:52.842669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a2114244-ae04-483c-8e9f-39246ca42d10 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:52.843825 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a2114244-ae04-483c-8e9f-39246ca42d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:52.851358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 732/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 20:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:52.998806 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62267c8-6d32-49bc-ad1a-e28d76746953 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:53.012657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62267c8-6d32-49bc-ad1a-e28d76746953 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:53.018055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2ba26-9b58-4573-a01a-42daa48d3d31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:53.018687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2ba26-9b58-4573-a01a-42daa48d3d31 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:53.018973 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2ba26-9b58-4573-a01a-42daa48d3d31 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:53.019249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2ba26-9b58-4573-a01a-42daa48d3d31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:53.027417 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2ba26-9b58-4573-a01a-42daa48d3d31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:53.029070 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2ba26-9b58-4573-a01a-42daa48d3d31 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:53.038108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 705/1437] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:20:53.918647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749322e4-2f6b-4c86-a774-65da1d3f1d1f None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:53.919229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749322e4-2f6b-4c86-a774-65da1d3f1d1f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:53.919229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749322e4-2f6b-4c86-a774-65da1d3f1d1f None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:53.920609 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 733/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 20:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:53.925737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584341-c0c8-42c7-96a0-87e8731327f4 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:53.926154 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584341-c0c8-42c7-96a0-87e8731327f4 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:53.926297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8584341-c0c8-42c7-96a0-87e8731327f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:53.943716 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b8584341-c0c8-42c7-96a0-87e8731327f4 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:53.944884 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b8584341-c0c8-42c7-96a0-87e8731327f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:53.953104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 706/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 20:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:54.099848 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749322e4-2f6b-4c86-a774-65da1d3f1d1f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:54.113828 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749322e4-2f6b-4c86-a774-65da1d3f1d1f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:54.119155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fcf7f-0fa7-4283-a9ad-6f7e2a1d25bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:54.119787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fcf7f-0fa7-4283-a9ad-6f7e2a1d25bc service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:54.120072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fcf7f-0fa7-4283-a9ad-6f7e2a1d25bc service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:54.120348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fcf7f-0fa7-4283-a9ad-6f7e2a1d25bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:54.128754 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fcf7f-0fa7-4283-a9ad-6f7e2a1d25bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:54.130359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fcf7f-0fa7-4283-a9ad-6f7e2a1d25bc service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:54.139936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 734/1440] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:56.241905 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb19e6-fd4f-4457-b783-9d03a8e0e97c None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:56.242416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb19e6-fd4f-4457-b783-9d03a8e0e97c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:56.242416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb19e6-fd4f-4457-b783-9d03a8e0e97c None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:56.243724 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 707/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:56.248957 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5e03a-4abd-470b-b260-585b912c6a5e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:56.249380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5e03a-4abd-470b-b260-585b912c6a5e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:56.249562 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5e03a-4abd-470b-b260-585b912c6a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:56.267044 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-64b5e03a-4abd-470b-b260-585b912c6a5e None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:56.268244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-64b5e03a-4abd-470b-b260-585b912c6a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:56.276120 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 735/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:56.314616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb19e6-fd4f-4457-b783-9d03a8e0e97c None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:56.324890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb19e6-fd4f-4457-b783-9d03a8e0e97c None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:56.328923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab20690-a15e-47f2-81d5-c418435a1ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:56.329587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab20690-a15e-47f2-81d5-c418435a1ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:56.329869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab20690-a15e-47f2-81d5-c418435a1ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:56.330143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab20690-a15e-47f2-81d5-c418435a1ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:56.338735 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab20690-a15e-47f2-81d5-c418435a1ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:56.340158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab20690-a15e-47f2-81d5-c418435a1ca7 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:56.349238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 708/1443] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:20:58.713788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff305a-7e49-41c6-a5da-4ec6c603df6a None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:58.714330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff305a-7e49-41c6-a5da-4ec6c603df6a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:58.714330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff305a-7e49-41c6-a5da-4ec6c603df6a None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:58.715733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 736/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:20:58.720967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763eea1-a6c2-4703-99bf-a7c943cd7dd7 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:58.721426 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763eea1-a6c2-4703-99bf-a7c943cd7dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:58.721531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763eea1-a6c2-4703-99bf-a7c943cd7dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:58.738783 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-c763eea1-a6c2-4703-99bf-a7c943cd7dd7 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:20:58.739964 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c763eea1-a6c2-4703-99bf-a7c943cd7dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:20:58.749480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 709/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:20:58.788677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff305a-7e49-41c6-a5da-4ec6c603df6a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:20:58.799267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff305a-7e49-41c6-a5da-4ec6c603df6a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:20:58.803009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b32d34-63ea-4e41-b35b-398cafd36c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:20:58.803635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b32d34-63ea-4e41-b35b-398cafd36c5e service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:20:58.803917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b32d34-63ea-4e41-b35b-398cafd36c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:20:58.804190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b32d34-63ea-4e41-b35b-398cafd36c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:20:58.813271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b32d34-63ea-4e41-b35b-398cafd36c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:20:58.814690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b32d34-63ea-4e41-b35b-398cafd36c5e service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:20:58.823657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 737/1446] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:21:01.285169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ee0f2-e0a6-4c7c-875a-bebae755bd06 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:01.285701 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ee0f2-e0a6-4c7c-875a-bebae755bd06 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:01.285701 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ee0f2-e0a6-4c7c-875a-bebae755bd06 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:01.286998 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 710/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:21:01.292454 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5378d-5b9e-497e-be78-6bb04d1c8e29 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:01.292854 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5378d-5b9e-497e-be78-6bb04d1c8e29 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:01.293035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5378d-5b9e-497e-be78-6bb04d1c8e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:01.310556 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-53d5378d-5b9e-497e-be78-6bb04d1c8e29 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:21:01.311728 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-53d5378d-5b9e-497e-be78-6bb04d1c8e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:21:01.319955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 738/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:21:01.356182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ee0f2-e0a6-4c7c-875a-bebae755bd06 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:21:01.367298 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ee0f2-e0a6-4c7c-875a-bebae755bd06 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:21:01.370802 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc0315-af25-473e-9ca8-43b31c5eda5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:21:01.371431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc0315-af25-473e-9ca8-43b31c5eda5f service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:01.371714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc0315-af25-473e-9ca8-43b31c5eda5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:01.371988 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc0315-af25-473e-9ca8-43b31c5eda5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:01.380624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc0315-af25-473e-9ca8-43b31c5eda5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:21:01.382095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc0315-af25-473e-9ca8-43b31c5eda5f service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:21:01.391194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 711/1449] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:21:03.741156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd881a37-42b9-485b-b4f2-72a06c432e60 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:03.741776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd881a37-42b9-485b-b4f2-72a06c432e60 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:03.741776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd881a37-42b9-485b-b4f2-72a06c432e60 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:03.743082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 739/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:21:03.748993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2832d6-6133-447e-94a8-d450e7ca9913 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:03.749427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2832d6-6133-447e-94a8-d450e7ca9913 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:03.749564 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2832d6-6133-447e-94a8-d450e7ca9913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:03.767095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-9a2832d6-6133-447e-94a8-d450e7ca9913 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:21:03.768276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9a2832d6-6133-447e-94a8-d450e7ca9913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:21:03.776243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 712/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:21:03.813190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd881a37-42b9-485b-b4f2-72a06c432e60 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:21:03.823470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd881a37-42b9-485b-b4f2-72a06c432e60 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:21:03.827579 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26143ce-568c-4687-9317-2572d545fcc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:21:03.828216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26143ce-568c-4687-9317-2572d545fcc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:03.828497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26143ce-568c-4687-9317-2572d545fcc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:03.828776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26143ce-568c-4687-9317-2572d545fcc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:03.837569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26143ce-568c-4687-9317-2572d545fcc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:21:03.838993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26143ce-568c-4687-9317-2572d545fcc5 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:21:03.848104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 740/1452] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:21:06.107359 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d04ee-3758-4a92-9a50-3c027e471072 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:06.107961 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d04ee-3758-4a92-9a50-3c027e471072 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:06.107961 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d04ee-3758-4a92-9a50-3c027e471072 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:06.109314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 713/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:21:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:21:06.114596 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0f2ca-f2f0-4a7e-b4a3-da716e0488e6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:06.115061 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0f2ca-f2f0-4a7e-b4a3-da716e0488e6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:06.115177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0f2ca-f2f0-4a7e-b4a3-da716e0488e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:06.132830 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-82b0f2ca-f2f0-4a7e-b4a3-da716e0488e6 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:21:06.134030 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-82b0f2ca-f2f0-4a7e-b4a3-da716e0488e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:21:06.141681 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 741/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:21:06.178840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d04ee-3758-4a92-9a50-3c027e471072 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:21:06.189871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d04ee-3758-4a92-9a50-3c027e471072 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:21:06.193400 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e49b1-cd0c-441e-ae3f-b354fa41b6f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:21:06.194029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e49b1-cd0c-441e-ae3f-b354fa41b6f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:06.194311 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e49b1-cd0c-441e-ae3f-b354fa41b6f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:06.194591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e49b1-cd0c-441e-ae3f-b354fa41b6f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:06.203228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e49b1-cd0c-441e-ae3f-b354fa41b6f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:21:06.204650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e49b1-cd0c-441e-ae3f-b354fa41b6f2 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:21:06.213759 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 714/1455] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:21:08.446093 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636a314-43f7-4b2c-ab70-26fa4604feeb None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:08.446653 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636a314-43f7-4b2c-ab70-26fa4604feeb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:08.446653 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636a314-43f7-4b2c-ab70-26fa4604feeb None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:08.448053 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 742/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:21:08.454141 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98d6d-4bdb-404f-a667-cf9c87c2c0aa None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:08.454571 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98d6d-4bdb-404f-a667-cf9c87c2c0aa None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:08.454706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab98d6d-4bdb-404f-a667-cf9c87c2c0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:08.474232 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-0ab98d6d-4bdb-404f-a667-cf9c87c2c0aa None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:21:08.475423 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0ab98d6d-4bdb-404f-a667-cf9c87c2c0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:21:08.483085 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 715/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:21:08.521332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636a314-43f7-4b2c-ab70-26fa4604feeb None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:21:08.522985 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e636a314-43f7-4b2c-ab70-26fa4604feeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:21:08.536053 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636a314-43f7-4b2c-ab70-26fa4604feeb None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:21:08.539518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd57d4-1c07-441f-aa2c-8a7325d3c0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:21:08.540151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd57d4-1c07-441f-aa2c-8a7325d3c0ea service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:08.540435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd57d4-1c07-441f-aa2c-8a7325d3c0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:08.540711 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd57d4-1c07-441f-aa2c-8a7325d3c0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:08.549433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd57d4-1c07-441f-aa2c-8a7325d3c0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:21:08.550854 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd57d4-1c07-441f-aa2c-8a7325d3c0ea service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:21:08.559914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 743/1458] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:21:10.872300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3def6e8-83ac-4d48-b71d-d769b4399239 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:10.872878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3def6e8-83ac-4d48-b71d-d769b4399239 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:10.872878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3def6e8-83ac-4d48-b71d-d769b4399239 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:10.874254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 716/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:21:10.879581 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df23e-01ac-43a6-b79a-43eb5a0da95c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:10.879978 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df23e-01ac-43a6-b79a-43eb5a0da95c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:10.880150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555df23e-01ac-43a6-b79a-43eb5a0da95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:10.897941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-555df23e-01ac-43a6-b79a-43eb5a0da95c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:21:10.899127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-555df23e-01ac-43a6-b79a-43eb5a0da95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:21:10.907420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 744/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:21:10.943375 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3def6e8-83ac-4d48-b71d-d769b4399239 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:21:10.954379 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3def6e8-83ac-4d48-b71d-d769b4399239 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:21:10.957851 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabceef-9246-415d-b4ac-e485e685468d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:21:10.958478 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabceef-9246-415d-b4ac-e485e685468d service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:10.958759 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabceef-9246-415d-b4ac-e485e685468d service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:10.959030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabceef-9246-415d-b4ac-e485e685468d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:10.968032 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabceef-9246-415d-b4ac-e485e685468d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:21:10.969484 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabceef-9246-415d-b4ac-e485e685468d service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:21:10.979046 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 717/1461] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:21:13.225753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06788-1f6f-4703-b0f9-f1e1da64e6d6 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:13.226315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06788-1f6f-4703-b0f9-f1e1da64e6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:13.226315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06788-1f6f-4703-b0f9-f1e1da64e6d6 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:13.227651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 745/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:21:13.233177 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa604f5-0b47-4087-85b5-895b4e570c83 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:13.233615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa604f5-0b47-4087-85b5-895b4e570c83 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:13.233735 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa604f5-0b47-4087-85b5-895b4e570c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:13.251460 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-1aa604f5-0b47-4087-85b5-895b4e570c83 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:21:13.252644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-1aa604f5-0b47-4087-85b5-895b4e570c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:21:13.260542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 718/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:21:13.296921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb06788-1f6f-4703-b0f9-f1e1da64e6d6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:21:13.307120 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb06788-1f6f-4703-b0f9-f1e1da64e6d6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:21:13.311081 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1657632-b325-4a70-bbf8-409f805f5699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:21:13.311706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1657632-b325-4a70-bbf8-409f805f5699 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:13.311984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1657632-b325-4a70-bbf8-409f805f5699 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:13.312254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1657632-b325-4a70-bbf8-409f805f5699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:13.320919 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1657632-b325-4a70-bbf8-409f805f5699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:21:13.322385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1657632-b325-4a70-bbf8-409f805f5699 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:21:13.332128 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 746/1464] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:21:15.600677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0156a9-4819-4c7f-826a-f51775c361ae None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:15.601208 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0156a9-4819-4c7f-826a-f51775c361ae None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:15.601208 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0156a9-4819-4c7f-826a-f51775c361ae None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:15.602526 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 719/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:21:15.608462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1016c6-1832-460d-b26c-6980f75ac49b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:15.608873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1016c6-1832-460d-b26c-6980f75ac49b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:15.609056 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1016c6-1832-460d-b26c-6980f75ac49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:15.627735 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fe1016c6-1832-460d-b26c-6980f75ac49b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:21:15.628910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fe1016c6-1832-460d-b26c-6980f75ac49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:21:15.636506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 747/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:21:15.673094 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0156a9-4819-4c7f-826a-f51775c361ae None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:21:15.683424 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0156a9-4819-4c7f-826a-f51775c361ae None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:21:15.687162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bf644-b4d9-4fbe-98ff-5855c3d4d63f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:21:15.687788 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bf644-b4d9-4fbe-98ff-5855c3d4d63f service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:15.688068 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bf644-b4d9-4fbe-98ff-5855c3d4d63f service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:15.688339 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bf644-b4d9-4fbe-98ff-5855c3d4d63f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:15.696868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bf644-b4d9-4fbe-98ff-5855c3d4d63f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:21:15.698301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bf644-b4d9-4fbe-98ff-5855c3d4d63f service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:21:15.707289 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 720/1467] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:21:17.901972 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b407ef-e0f0-46b8-8f26-fd781b72bb92 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:17.902538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b407ef-e0f0-46b8-8f26-fd781b72bb92 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:17.902538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b407ef-e0f0-46b8-8f26-fd781b72bb92 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:17.904397 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 748/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:21:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:21:17.909709 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4a55-11f5-45fb-a88c-1dcf3989fcee None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:17.910122 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4a55-11f5-45fb-a88c-1dcf3989fcee None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:17.910297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4a55-11f5-45fb-a88c-1dcf3989fcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:17.928286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-379b4a55-11f5-45fb-a88c-1dcf3989fcee None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:21:17.929510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-379b4a55-11f5-45fb-a88c-1dcf3989fcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:21:17.937294 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 721/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:21:17.972864 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b407ef-e0f0-46b8-8f26-fd781b72bb92 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:21:17.984034 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b407ef-e0f0-46b8-8f26-fd781b72bb92 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:21:17.987500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc84e8-d94c-4ce7-a555-9b77cd509dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:21:17.988130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc84e8-d94c-4ce7-a555-9b77cd509dda service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:17.988408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc84e8-d94c-4ce7-a555-9b77cd509dda service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:17.988679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc84e8-d94c-4ce7-a555-9b77cd509dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:17.997285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc84e8-d94c-4ce7-a555-9b77cd509dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:21:17.998695 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc84e8-d94c-4ce7-a555-9b77cd509dda service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:21:18.007666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 749/1470] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:21:51.866500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eae2f3-1e6d-473d-b51f-6a0e25f52f57 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:51.867107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eae2f3-1e6d-473d-b51f-6a0e25f52f57 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:51.867107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eae2f3-1e6d-473d-b51f-6a0e25f52f57 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:51.868408 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 722/1471] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:21:51.874159 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2c4da-aabc-4e91-a17d-82a5325074fc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:51.874626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2c4da-aabc-4e91-a17d-82a5325074fc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:51.874733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2c4da-aabc-4e91-a17d-82a5325074fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:51.891705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7ed2c4da-aabc-4e91-a17d-82a5325074fc None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:21:51.892880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7ed2c4da-aabc-4e91-a17d-82a5325074fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:21:51.900778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 750/1472] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:21:51.946896 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1a932-acb5-42fe-a484-1b04f0c5d274 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:51.947181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1a932-acb5-42fe-a484-1b04f0c5d274 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:51.947463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1a932-acb5-42fe-a484-1b04f0c5d274 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:51.948798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 723/1473] 10.222.0.61 () {54 vars in 962 bytes} [Tue May 10 20:21:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:21:51.953583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ff783-c57b-4deb-9e6c-c6e7846a6c7b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:51.953880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ff783-c57b-4deb-9e6c-c6e7846a6c7b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:51.954162 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ff783-c57b-4deb-9e6c-c6e7846a6c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:51.971491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-750ff783-c57b-4deb-9e6c-c6e7846a6c7b None None] MFA Rules not processed for user `9f59e7ae8da841dc809355fa8e4be488`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:21:51.972668 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-750ff783-c57b-4deb-9e6c-c6e7846a6c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:21:51.979072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 751/1474] 10.222.0.61 () {58 vars in 1059 bytes} [Tue May 10 20:21:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:21:51.986792 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1a932-acb5-42fe-a484-1b04f0c5d274 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:21:51.996966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1a932-acb5-42fe-a484-1b04f0c5d274 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:21:52.000922 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742969b5-2b1b-4146-be51-2b16df48b3a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f59e7ae8da841dc809355fa8e4be488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:21:52.001580 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742969b5-2b1b-4146-be51-2b16df48b3a2 service glance] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:52.001860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742969b5-2b1b-4146-be51-2b16df48b3a2 service glance] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:52.002133 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742969b5-2b1b-4146-be51-2b16df48b3a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:52.010592 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742969b5-2b1b-4146-be51-2b16df48b3a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:21:52.012033 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742969b5-2b1b-4146-be51-2b16df48b3a2 service glance] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:21:52.021120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 724/1475] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:21:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:21:54.325423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b8d9-a16f-4770-9da1-a8320eaeef41 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:54.325967 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b8d9-a16f-4770-9da1-a8320eaeef41 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:54.325967 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b8d9-a16f-4770-9da1-a8320eaeef41 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:54.327229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 752/1476] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:21:54.332335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6013f0a-0e1e-4377-85f4-e1531ebfae0a None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:54.332724 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6013f0a-0e1e-4377-85f4-e1531ebfae0a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:54.332886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6013f0a-0e1e-4377-85f4-e1531ebfae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:54.349897 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-d6013f0a-0e1e-4377-85f4-e1531ebfae0a None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:21:54.351060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d6013f0a-0e1e-4377-85f4-e1531ebfae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:21:54.359087 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 725/1477] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:21:54.381774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8b8d9-a16f-4770-9da1-a8320eaeef41 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:21:54.394099 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8b8d9-a16f-4770-9da1-a8320eaeef41 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:21:54.398823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f4384-74f0-4634-9ae6-bf3dc1565107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:21:54.399475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4384-74f0-4634-9ae6-bf3dc1565107 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:54.399758 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4384-74f0-4634-9ae6-bf3dc1565107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:54.400033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f4384-74f0-4634-9ae6-bf3dc1565107 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:54.400759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f4384-74f0-4634-9ae6-bf3dc1565107 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:21:54.402559 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-560f4384-74f0-4634-9ae6-bf3dc1565107 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 20:21:54.402559 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 10 20:21:54.402559 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: May 10 20:21:54.403737 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f4384-74f0-4634-9ae6-bf3dc1565107 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:21:54.423863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 753/1478] 10.222.0.61 () {56 vars in 1108 bytes} [Tue May 10 20:21:54 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:21:56.659422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944cfcc-50d3-43b9-822f-002871bc2935 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:56.659956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944cfcc-50d3-43b9-822f-002871bc2935 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:56.660051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944cfcc-50d3-43b9-822f-002871bc2935 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:56.661415 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 726/1479] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:21:56.666801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00773187-6997-437c-b684-45f02b20b61e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:56.667234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00773187-6997-437c-b684-45f02b20b61e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:56.667347 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00773187-6997-437c-b684-45f02b20b61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:56.686024 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-00773187-6997-437c-b684-45f02b20b61e None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:21:56.687233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-00773187-6997-437c-b684-45f02b20b61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:21:56.695535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 754/1480] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:21:56.737473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944cfcc-50d3-43b9-822f-002871bc2935 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:21:56.751440 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944cfcc-50d3-43b9-822f-002871bc2935 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:21:56.756884 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fc124-d231-4ec8-947f-aea9472408ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:21:56.757563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fc124-d231-4ec8-947f-aea9472408ae service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:56.757843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fc124-d231-4ec8-947f-aea9472408ae service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:56.758113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fc124-d231-4ec8-947f-aea9472408ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:56.765993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fc124-d231-4ec8-947f-aea9472408ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:21:56.767572 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fc124-d231-4ec8-947f-aea9472408ae service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:21:56.776744 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 727/1481] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:21:59.155835 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974763b2-c417-44e6-82a2-b930cf07f197 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:59.156413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974763b2-c417-44e6-82a2-b930cf07f197 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:59.156413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974763b2-c417-44e6-82a2-b930cf07f197 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:59.157820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 755/1482] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:21:59.162893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8970a-1682-4899-a92b-684dfc49c79b None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:59.163316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8970a-1682-4899-a92b-684dfc49c79b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:59.163447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8970a-1682-4899-a92b-684dfc49c79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:59.181108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-8aa8970a-1682-4899-a92b-684dfc49c79b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:21:59.182266 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-8aa8970a-1682-4899-a92b-684dfc49c79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:21:59.189926 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 728/1483] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:21:59.224754 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974763b2-c417-44e6-82a2-b930cf07f197 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:21:59.235827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974763b2-c417-44e6-82a2-b930cf07f197 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:21:59.239344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec980f84-e0de-4633-a818-42d0ebcd5f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:21:59.239972 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec980f84-e0de-4633-a818-42d0ebcd5f5b service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:21:59.240254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec980f84-e0de-4633-a818-42d0ebcd5f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:21:59.240529 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec980f84-e0de-4633-a818-42d0ebcd5f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:21:59.249102 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec980f84-e0de-4633-a818-42d0ebcd5f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:21:59.250518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec980f84-e0de-4633-a818-42d0ebcd5f5b service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:21:59.259825 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 756/1484] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:22:01.513985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7a726-7c4a-4151-a725-f6fa34d4bf06 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:22:01.514562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7a726-7c4a-4151-a725-f6fa34d4bf06 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:22:01.514562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7a726-7c4a-4151-a725-f6fa34d4bf06 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:22:01.515909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 729/1485] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:22:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:22:01.521053 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063d31c-1547-484c-b816-0069cfa4a191 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:22:01.522090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063d31c-1547-484c-b816-0069cfa4a191 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:22:01.522384 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063d31c-1547-484c-b816-0069cfa4a191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:22:01.540312 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c063d31c-1547-484c-b816-0069cfa4a191 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:22:01.541509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c063d31c-1547-484c-b816-0069cfa4a191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:22:01.549022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 757/1486] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:22:01.586284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7a726-7c4a-4151-a725-f6fa34d4bf06 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:22:01.596862 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7a726-7c4a-4151-a725-f6fa34d4bf06 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:22:01.600328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5f662-3790-4727-8ceb-36039c653e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:22:01.600964 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5f662-3790-4727-8ceb-36039c653e29 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:22:01.601273 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5f662-3790-4727-8ceb-36039c653e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:22:01.601553 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5f662-3790-4727-8ceb-36039c653e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:22:01.610807 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5f662-3790-4727-8ceb-36039c653e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:22:01.612233 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5f662-3790-4727-8ceb-36039c653e29 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:22:01.621355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 730/1487] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:22:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:22:04.001634 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962022-afcf-4573-be70-d8dc5f76cf93 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:22:04.002111 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962022-afcf-4573-be70-d8dc5f76cf93 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:22:04.002234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962022-afcf-4573-be70-d8dc5f76cf93 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:22:04.003538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 758/1488] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:22:04.008689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2accc1-fd82-4409-b874-d8556b3321a9 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:22:04.009161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2accc1-fd82-4409-b874-d8556b3321a9 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:22:04.009263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2accc1-fd82-4409-b874-d8556b3321a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:22:04.027360 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6d2accc1-fd82-4409-b874-d8556b3321a9 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:22:04.028609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6d2accc1-fd82-4409-b874-d8556b3321a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:22:04.036382 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 731/1489] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:22:04.076058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962022-afcf-4573-be70-d8dc5f76cf93 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:22:04.086532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962022-afcf-4573-be70-d8dc5f76cf93 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:22:04.089991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbccbf-8260-4cce-b488-3736fa4447f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:22:04.090617 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbccbf-8260-4cce-b488-3736fa4447f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:22:04.090899 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbccbf-8260-4cce-b488-3736fa4447f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:22:04.091171 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbccbf-8260-4cce-b488-3736fa4447f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:22:04.099712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbccbf-8260-4cce-b488-3736fa4447f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:22:04.101193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbccbf-8260-4cce-b488-3736fa4447f7 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:22:04.110708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 759/1490] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:22:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:22:06.512924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e6bf1-278b-43fe-a87b-fd4f68fd031f None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:22:06.513515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e6bf1-278b-43fe-a87b-fd4f68fd031f None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:22:06.513515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e6bf1-278b-43fe-a87b-fd4f68fd031f None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:22:06.514842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 732/1491] 10.222.0.61 () {54 vars in 926 bytes} [Tue May 10 20:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:22:06.519919 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aae88-d175-4d85-9558-b262ed84470b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:22:06.520339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aae88-d175-4d85-9558-b262ed84470b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:22:06.520473 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aae88-d175-4d85-9558-b262ed84470b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:22:06.538565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-164aae88-d175-4d85-9558-b262ed84470b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:22:06.539743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-164aae88-d175-4d85-9558-b262ed84470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:22:06.548025 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 760/1492] 10.222.0.61 () {58 vars in 1023 bytes} [Tue May 10 20:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:22:06.585240 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e6bf1-278b-43fe-a87b-fd4f68fd031f None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:22:06.596279 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e6bf1-278b-43fe-a87b-fd4f68fd031f None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:22:06.599718 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbcc2d-029b-41ef-9c40-9533dd1f7fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:22:06.600343 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbcc2d-029b-41ef-9c40-9533dd1f7fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:22:06.600619 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbcc2d-029b-41ef-9c40-9533dd1f7fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:22:06.600896 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbcc2d-029b-41ef-9c40-9533dd1f7fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:22:06.610018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbcc2d-029b-41ef-9c40-9533dd1f7fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:22:06.611422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbcc2d-029b-41ef-9c40-9533dd1f7fbd service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:22:06.620325 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 733/1493] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:22:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:23:33.206240 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d36b00-7f3e-4b61-9b9c-937b5a80b714 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:33.206819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d36b00-7f3e-4b61-9b9c-937b5a80b714 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:33.206819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d36b00-7f3e-4b61-9b9c-937b5a80b714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:33.225879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c4d36b00-7f3e-4b61-9b9c-937b5a80b714 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:23:33.227076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c4d36b00-7f3e-4b61-9b9c-937b5a80b714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:23:33.234928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 761/1494] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:23:33.243943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc195-c034-4a1e-92d1-dae597d03679 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:33.244437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc195-c034-4a1e-92d1-dae597d03679 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:33.244534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbc195-c034-4a1e-92d1-dae597d03679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:33.263345 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-a9cbc195-c034-4a1e-92d1-dae597d03679 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:23:33.264511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a9cbc195-c034-4a1e-92d1-dae597d03679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:23:33.272279 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 734/1495] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:23:33.277527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d36b00-7f3e-4b61-9b9c-937b5a80b714 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:23:33.286952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d36b00-7f3e-4b61-9b9c-937b5a80b714 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:23:33.291315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6966358-39f5-4ea8-ba7d-8791e2a6138f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:23:33.291957 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6966358-39f5-4ea8-ba7d-8791e2a6138f admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:33.292239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6966358-39f5-4ea8-ba7d-8791e2a6138f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:33.292514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6966358-39f5-4ea8-ba7d-8791e2a6138f admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:33.293262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6966358-39f5-4ea8-ba7d-8791e2a6138f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:23:33.293572 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6966358-39f5-4ea8-ba7d-8791e2a6138f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:23:33.294590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-e6966358-39f5-4ea8-ba7d-8791e2a6138f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:23:33.294590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 10 20:23:33.294590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: May 10 20:23:33.295475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6966358-39f5-4ea8-ba7d-8791e2a6138f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:23:33.306536 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 762/1496] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:23:33.314345 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbc195-c034-4a1e-92d1-dae597d03679 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:23:33.323035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbc195-c034-4a1e-92d1-dae597d03679 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:23:33.328049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def2040-1923-45c7-af7b-b7367d28167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:23:33.328683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def2040-1923-45c7-af7b-b7367d28167f admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:33.328964 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def2040-1923-45c7-af7b-b7367d28167f admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:33.329265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def2040-1923-45c7-af7b-b7367d28167f admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:33.329949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def2040-1923-45c7-af7b-b7367d28167f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:23:33.331725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: WARNING py.warnings [None req-9def2040-1923-45c7-af7b-b7367d28167f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 20:23:33.331725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: warnings.warn(msg) May 10 20:23:33.331725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: May 10 20:23:33.332912 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def2040-1923-45c7-af7b-b7367d28167f admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:23:33.369018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 735/1497] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:23:33 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:23:33.371672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6966358-39f5-4ea8-ba7d-8791e2a6138f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:23:33.381471 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6966358-39f5-4ea8-ba7d-8791e2a6138f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:23:33.436098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50b063-4703-42ed-9b3c-6167045fd563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:23:33.436760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b063-4703-42ed-9b3c-6167045fd563 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:33.437082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b063-4703-42ed-9b3c-6167045fd563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:33.437367 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b063-4703-42ed-9b3c-6167045fd563 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:33.438058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50b063-4703-42ed-9b3c-6167045fd563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:23:33.439106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-fe50b063-4703-42ed-9b3c-6167045fd563 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 20:23:33.439106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 10 20:23:33.439106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: May 10 20:23:33.440299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50b063-4703-42ed-9b3c-6167045fd563 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:23:33.460408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 763/1498] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:23:33 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:23:33.464644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def2040-1923-45c7-af7b-b7367d28167f admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:23:33.476937 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def2040-1923-45c7-af7b-b7367d28167f admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:23:33.481633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e2159-0193-42c5-8612-efa6f6d07ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:23:33.482291 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e2159-0193-42c5-8612-efa6f6d07ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:33.482573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e2159-0193-42c5-8612-efa6f6d07ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:33.482844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e2159-0193-42c5-8612-efa6f6d07ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:33.483564 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e2159-0193-42c5-8612-efa6f6d07ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:23:33.484591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: WARNING py.warnings [None req-7a1e2159-0193-42c5-8612-efa6f6d07ad9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:23:33.484591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: warnings.warn(msg) May 10 20:23:33.484591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: May 10 20:23:33.485549 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e2159-0193-42c5-8612-efa6f6d07ad9 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:23:33.498326 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 736/1499] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:23:33.502295 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50b063-4703-42ed-9b3c-6167045fd563 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:23:33.512484 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50b063-4703-42ed-9b3c-6167045fd563 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:23:33.517004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94e774-439a-4abe-8d33-6ab8a4df69b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:23:33.517666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94e774-439a-4abe-8d33-6ab8a4df69b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:33.517950 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94e774-439a-4abe-8d33-6ab8a4df69b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:33.518228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94e774-439a-4abe-8d33-6ab8a4df69b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:33.518950 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94e774-439a-4abe-8d33-6ab8a4df69b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:23:33.519960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-cb94e774-439a-4abe-8d33-6ab8a4df69b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:23:33.519960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 10 20:23:33.519960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: May 10 20:23:33.520830 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94e774-439a-4abe-8d33-6ab8a4df69b9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:23:33.533964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 764/1500] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:23:33.537848 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e2159-0193-42c5-8612-efa6f6d07ad9 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:23:33.547243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e2159-0193-42c5-8612-efa6f6d07ad9 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:23:33.551763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038a443-b460-4b72-990b-8a370fd068f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:23:33.552629 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a443-b460-4b72-990b-8a370fd068f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:33.552909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a443-b460-4b72-990b-8a370fd068f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:33.553222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a443-b460-4b72-990b-8a370fd068f4 admin admin] PATH_INFO: `/v3/projects/780cad3975d54c8cbf3703da07785257/users/258fb06445fb43238d9261fe956424d7/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:33.567685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038a443-b460-4b72-990b-8a370fd068f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=780cad3975d54c8cbf3703da07785257, user_id=258fb06445fb43238d9261fe956424d7, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:23:33.568653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: WARNING py.warnings [None req-d038a443-b460-4b72-990b-8a370fd068f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 20:23:33.568653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: warnings.warn(msg) May 10 20:23:33.568653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: May 10 20:23:33.570583 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038a443-b460-4b72-990b-8a370fd068f4 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:23:33.584297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 737/1501] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:23:33 2022] PUT /identity/v3/projects/780cad3975d54c8cbf3703da07785257/users/258fb06445fb43238d9261fe956424d7/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:23:33.595595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e4e4a-7611-4fd8-a82f-1b13beeab4ac None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:33.595889 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e4e4a-7611-4fd8-a82f-1b13beeab4ac None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:33.596201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e4e4a-7611-4fd8-a82f-1b13beeab4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:33.622120 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-387e4e4a-7611-4fd8-a82f-1b13beeab4ac None None] MFA Rules not processed for user `258fb06445fb43238d9261fe956424d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:23:33.623292 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-387e4e4a-7611-4fd8-a82f-1b13beeab4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:23:33.683597 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 765/1502] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:23:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:23:33.696896 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46553eff-84ba-4910-aa27-56d7d254bffb None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:33.697226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46553eff-84ba-4910-aa27-56d7d254bffb None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:33.697507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46553eff-84ba-4910-aa27-56d7d254bffb None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:33.699495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 738/1503] 10.222.0.61 () {54 vars in 963 bytes} [Tue May 10 20:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:23:33.704364 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c71e2-8829-4572-a670-aa1be9e6e294 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:33.704657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c71e2-8829-4572-a670-aa1be9e6e294 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:33.704936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c71e2-8829-4572-a670-aa1be9e6e294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:33.722152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ae3c71e2-8829-4572-a670-aa1be9e6e294 None None] MFA Rules not processed for user `f319323b3f3547849d452c1361764005`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:23:33.723351 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ae3c71e2-8829-4572-a670-aa1be9e6e294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:23:33.771636 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 766/1504] 10.222.0.61 () {58 vars in 1060 bytes} [Tue May 10 20:23:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:23:33.779113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46553eff-84ba-4910-aa27-56d7d254bffb None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:23:33.789447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46553eff-84ba-4910-aa27-56d7d254bffb None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:23:33.792951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06b828-e304-4ed5-8866-129789f0a74d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:23:33.793603 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06b828-e304-4ed5-8866-129789f0a74d service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:33.793888 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06b828-e304-4ed5-8866-129789f0a74d service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:33.794166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06b828-e304-4ed5-8866-129789f0a74d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:33.802174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06b828-e304-4ed5-8866-129789f0a74d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:23:33.803588 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06b828-e304-4ed5-8866-129789f0a74d service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:23:33.812575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 739/1505] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:23:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:23:33.853792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef62683-6d2e-43cb-b274-28f38a18e268 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:33.854088 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef62683-6d2e-43cb-b274-28f38a18e268 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:33.854386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef62683-6d2e-43cb-b274-28f38a18e268 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:33.856170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 767/1506] 10.222.0.61 () {52 vars in 829 bytes} [Tue May 10 20:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:23:33.859902 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06b828-e304-4ed5-8866-129789f0a74d service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:23:33.919043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06b828-e304-4ed5-8866-129789f0a74d service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:23:33.923458 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:23:33.924309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:33.924588 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:33.924885 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] PATH_INFO: `/v3/users/258fb06445fb43238d9261fe956424d7` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:33.926089 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=258fb06445fb43238d9261fe956424d7)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:23:33.927086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: WARNING py.warnings [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 20:23:33.927086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: warnings.warn(msg) May 10 20:23:33.927086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: May 10 20:23:33.928260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:23:33.988521 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '258fb06445fb43238d9261fe956424d7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:23:33.989200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '258fb06445fb43238d9261fe956424d7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:23:34.007730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '258fb06445fb43238d9261fe956424d7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:23:34.019560 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '258fb06445fb43238d9261fe956424d7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:23:34.029348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '258fb06445fb43238d9261fe956424d7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:23:34.035436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 740/1507] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:23:33 2022] DELETE /identity/v3/users/258fb06445fb43238d9261fe956424d7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:23:34.039695 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546d442-8584-4632-a89a-64f3a7008fe6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:34.039968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546d442-8584-4632-a89a-64f3a7008fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:34.040242 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546d442-8584-4632-a89a-64f3a7008fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:34.057493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8546d442-8584-4632-a89a-64f3a7008fe6 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:23:34.059200 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8546d442-8584-4632-a89a-64f3a7008fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:23:34.114712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 768/1508] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:23:34.124743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:23:34.126160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:23:34.180612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fec13-e8b7-40af-bcf4-ab373b9cd980 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:23:34.184764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64bb51-c081-4688-9f24-f6c5ea90ae24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:23:34.185431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bb51-c081-4688-9f24-f6c5ea90ae24 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:34.185720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bb51-c081-4688-9f24-f6c5ea90ae24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:34.186000 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64bb51-c081-4688-9f24-f6c5ea90ae24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:34.194711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64bb51-c081-4688-9f24-f6c5ea90ae24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:23:34.196138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64bb51-c081-4688-9f24-f6c5ea90ae24 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:23:34.205289 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 741/1509] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:23:34.545466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546d442-8584-4632-a89a-64f3a7008fe6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:23:34.546991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8546d442-8584-4632-a89a-64f3a7008fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:23:34.558383 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546d442-8584-4632-a89a-64f3a7008fe6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:23:34.568451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:23:34.568451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:23:34.568451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:23:34.568451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9 admin admin] PATH_INFO: `/v3/projects/780cad3975d54c8cbf3703da07785257` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:23:34.569672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=780cad3975d54c8cbf3703da07785257)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:23:34.569672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 20:23:34.569672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 10 20:23:34.569672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: May 10 20:23:34.570527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:23:34.631001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780cad3975d54c8cbf3703da07785257', 'request_id': 'req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:23:34.637261 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780cad3975d54c8cbf3703da07785257', 'request_id': 'req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:23:34.650343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780cad3975d54c8cbf3703da07785257', 'request_id': 'req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:23:34.664678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9 admin admin] The token cache is being invalidate because project 780cad3975d54c8cbf3703da07785257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:23:34.664964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:23:34.665605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9f72abe8-37ad-4713-a5d0-1b6d7f5c97b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:23:34.667217 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 769/1510] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:23:34 2022] DELETE /identity/v3/projects/780cad3975d54c8cbf3703da07785257 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:25:14.232574 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d81f5-a231-4126-9c97-71461db84e8e None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:14.233194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d81f5-a231-4126-9c97-71461db84e8e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:14.233194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d81f5-a231-4126-9c97-71461db84e8e None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:14.234478 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 742/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 20:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:25:14.239454 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4cfa0-8ec9-4e3f-8fdb-55da867e22bd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:14.239894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4cfa0-8ec9-4e3f-8fdb-55da867e22bd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:14.239996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4cfa0-8ec9-4e3f-8fdb-55da867e22bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:14.257858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6bb4cfa0-8ec9-4e3f-8fdb-55da867e22bd None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:25:14.259055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6bb4cfa0-8ec9-4e3f-8fdb-55da867e22bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:25:14.314794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 770/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 20:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:25:14.488886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d81f5-a231-4126-9c97-71461db84e8e None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:25:14.490676 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-184d81f5-a231-4126-9c97-71461db84e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:25:14.565557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d81f5-a231-4126-9c97-71461db84e8e None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:25:14.570929 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d95bef-42a3-424e-b650-c9631ae9a012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:25:14.571578 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d95bef-42a3-424e-b650-c9631ae9a012 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:14.571859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d95bef-42a3-424e-b650-c9631ae9a012 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:14.572136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d95bef-42a3-424e-b650-c9631ae9a012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:14.579965 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d95bef-42a3-424e-b650-c9631ae9a012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:25:14.581582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d95bef-42a3-424e-b650-c9631ae9a012 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:25:14.590641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 743/1513] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:25:15.113876 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce3191-314b-4ca9-b215-7ef927215a65 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:15.114274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce3191-314b-4ca9-b215-7ef927215a65 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:15.114559 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce3191-314b-4ca9-b215-7ef927215a65 None None] PATH_INFO: `/v3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:15.115932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 771/1514] 10.222.0.69 () {54 vars in 925 bytes} [Tue May 10 20:25:15 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:25:15.121793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f0926-c117-4028-877b-4d283fba89e5 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:15.122105 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f0926-c117-4028-877b-4d283fba89e5 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:15.122393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f0926-c117-4028-877b-4d283fba89e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:15.140728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-c67f0926-c117-4028-877b-4d283fba89e5 None None] MFA Rules not processed for user `a4dc7b58c8a04b359a4a9bbab9e7b219`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:25:15.141935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c67f0926-c117-4028-877b-4d283fba89e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:25:15.204278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 744/1515] 10.222.0.69 () {58 vars in 1015 bytes} [Tue May 10 20:25:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:25:15.480908 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27efe8d-85a9-45f9-91bb-e852619834e9 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:15.481427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27efe8d-85a9-45f9-91bb-e852619834e9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:15.481427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27efe8d-85a9-45f9-91bb-e852619834e9 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:15.482791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 772/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 20:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:25:15.487553 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625713a2-e38b-4c55-9aa0-8254ab679f46 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:15.488002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625713a2-e38b-4c55-9aa0-8254ab679f46 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:15.488105 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625713a2-e38b-4c55-9aa0-8254ab679f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:15.506265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-625713a2-e38b-4c55-9aa0-8254ab679f46 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:25:15.507446 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-625713a2-e38b-4c55-9aa0-8254ab679f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:25:15.515549 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 745/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 20:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:25:15.663485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27efe8d-85a9-45f9-91bb-e852619834e9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:25:15.677543 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27efe8d-85a9-45f9-91bb-e852619834e9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:25:15.683504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ffc4f-2a8b-400e-bf1b-4e77a4f84de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:25:15.684140 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ffc4f-2a8b-400e-bf1b-4e77a4f84de7 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:15.684432 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ffc4f-2a8b-400e-bf1b-4e77a4f84de7 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:15.684710 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ffc4f-2a8b-400e-bf1b-4e77a4f84de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:15.692623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ffc4f-2a8b-400e-bf1b-4e77a4f84de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:25:15.694264 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ffc4f-2a8b-400e-bf1b-4e77a4f84de7 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:25:15.704831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 773/1518] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:25:19.121428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f734e-a809-428f-b6f4-168c6e2df25b None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:19.121954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f734e-a809-428f-b6f4-168c6e2df25b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:19.122089 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f734e-a809-428f-b6f4-168c6e2df25b None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:19.123381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 746/1519] 10.222.0.61 () {54 vars in 960 bytes} [Tue May 10 20:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:25:19.128262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2c266-965a-4ab6-8972-e557965c4a0d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:19.128711 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2c266-965a-4ab6-8972-e557965c4a0d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:19.128815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2c266-965a-4ab6-8972-e557965c4a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:19.150366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-14d2c266-965a-4ab6-8972-e557965c4a0d None None] MFA Rules not processed for user `a4dc7b58c8a04b359a4a9bbab9e7b219`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:25:19.151669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-14d2c266-965a-4ab6-8972-e557965c4a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:25:19.162853 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 774/1520] 10.222.0.61 () {58 vars in 1057 bytes} [Tue May 10 20:25:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:25:19.170663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f734e-a809-428f-b6f4-168c6e2df25b None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:25:19.184339 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f734e-a809-428f-b6f4-168c6e2df25b None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:25:19.189385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bf801-3deb-433f-9d3c-089c6848bde3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4dc7b58c8a04b359a4a9bbab9e7b219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:25:19.190017 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bf801-3deb-433f-9d3c-089c6848bde3 service placement] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:19.190300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bf801-3deb-433f-9d3c-089c6848bde3 service placement] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:19.190568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bf801-3deb-433f-9d3c-089c6848bde3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:19.199474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bf801-3deb-433f-9d3c-089c6848bde3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:25:19.201086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bf801-3deb-433f-9d3c-089c6848bde3 service placement] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:25:19.210743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 747/1521] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:25:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:25:27.016805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388b2d0-637c-47df-afb3-6e4bf4980d15 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:27.017295 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388b2d0-637c-47df-afb3-6e4bf4980d15 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:27.017413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388b2d0-637c-47df-afb3-6e4bf4980d15 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:27.018806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 775/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 20:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:25:27.023862 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28644912-274d-4c0a-8cd3-e57de9868234 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:27.024261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28644912-274d-4c0a-8cd3-e57de9868234 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:27.024422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28644912-274d-4c0a-8cd3-e57de9868234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:27.042658 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-28644912-274d-4c0a-8cd3-e57de9868234 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:25:27.043840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-28644912-274d-4c0a-8cd3-e57de9868234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:25:27.051689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 748/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 20:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:25:27.200681 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388b2d0-637c-47df-afb3-6e4bf4980d15 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:25:27.215090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388b2d0-637c-47df-afb3-6e4bf4980d15 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:25:27.220308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ef8cf-851c-48ad-af90-3a7ac265a4f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:25:27.220937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ef8cf-851c-48ad-af90-3a7ac265a4f1 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:27.221250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ef8cf-851c-48ad-af90-3a7ac265a4f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:27.221524 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ef8cf-851c-48ad-af90-3a7ac265a4f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:27.229254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ef8cf-851c-48ad-af90-3a7ac265a4f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:25:27.230831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ef8cf-851c-48ad-af90-3a7ac265a4f1 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:25:27.239762 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 776/1524] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:25:28.128190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a101c-5a72-4d69-8f95-571cc79b390e None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:28.128746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a101c-5a72-4d69-8f95-571cc79b390e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:28.128746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a101c-5a72-4d69-8f95-571cc79b390e None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:28.130158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 749/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 20:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:25:28.134878 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a3b1f-ad9e-4749-bdba-c33a1241ce8b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:28.135829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a3b1f-ad9e-4749-bdba-c33a1241ce8b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:28.135932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a3b1f-ad9e-4749-bdba-c33a1241ce8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:28.154262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4f3a3b1f-ad9e-4749-bdba-c33a1241ce8b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:25:28.155450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4f3a3b1f-ad9e-4749-bdba-c33a1241ce8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:25:28.163154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 777/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 20:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:25:28.312700 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a101c-5a72-4d69-8f95-571cc79b390e None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:25:28.327273 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a101c-5a72-4d69-8f95-571cc79b390e None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:25:28.332573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef3a31-6653-47f0-8675-bbadadff19bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:25:28.333234 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef3a31-6653-47f0-8675-bbadadff19bb service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:28.333516 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef3a31-6653-47f0-8675-bbadadff19bb service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:28.333788 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef3a31-6653-47f0-8675-bbadadff19bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:28.341637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef3a31-6653-47f0-8675-bbadadff19bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:25:28.343203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef3a31-6653-47f0-8675-bbadadff19bb service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:25:28.352285 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 750/1527] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:25:32.485883 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b32617-08be-4ea3-acb0-392d769eb338 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:32.486445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b32617-08be-4ea3-acb0-392d769eb338 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:32.486445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b32617-08be-4ea3-acb0-392d769eb338 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:32.487790 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 778/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:25:32.493011 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611e58e-8eac-4e33-a326-381f9bee9927 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:32.493454 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611e58e-8eac-4e33-a326-381f9bee9927 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:32.493578 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611e58e-8eac-4e33-a326-381f9bee9927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:32.511473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-c611e58e-8eac-4e33-a326-381f9bee9927 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:25:32.512662 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c611e58e-8eac-4e33-a326-381f9bee9927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:25:32.520681 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 751/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:25:32.559577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b32617-08be-4ea3-acb0-392d769eb338 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:25:32.561275 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-79b32617-08be-4ea3-acb0-392d769eb338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:25:32.616392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b32617-08be-4ea3-acb0-392d769eb338 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:25:32.620567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9727441-ccfa-4811-9a20-23cb43918310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:25:32.621256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9727441-ccfa-4811-9a20-23cb43918310 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:32.621538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9727441-ccfa-4811-9a20-23cb43918310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:32.621813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9727441-ccfa-4811-9a20-23cb43918310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:32.630575 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9727441-ccfa-4811-9a20-23cb43918310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:25:32.632016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9727441-ccfa-4811-9a20-23cb43918310 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:25:32.641768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 779/1530] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:25:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:25:34.843132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7374252-6e77-4c7e-a758-1f6fabc54a59 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:34.843724 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7374252-6e77-4c7e-a758-1f6fabc54a59 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:34.843724 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7374252-6e77-4c7e-a758-1f6fabc54a59 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:34.845137 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 752/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:25:34.850309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65449dc5-e673-491d-8ae0-8d843689f369 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:34.850730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65449dc5-e673-491d-8ae0-8d843689f369 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:34.850892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65449dc5-e673-491d-8ae0-8d843689f369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:34.868264 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-65449dc5-e673-491d-8ae0-8d843689f369 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:25:34.869465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-65449dc5-e673-491d-8ae0-8d843689f369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:25:34.878769 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 780/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:25:34.914183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7374252-6e77-4c7e-a758-1f6fabc54a59 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:25:34.925087 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7374252-6e77-4c7e-a758-1f6fabc54a59 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:25:34.928521 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe81d4-b124-444a-bebe-25bd5f02b652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:25:34.929190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe81d4-b124-444a-bebe-25bd5f02b652 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:34.929471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe81d4-b124-444a-bebe-25bd5f02b652 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:34.929742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe81d4-b124-444a-bebe-25bd5f02b652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:34.938954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe81d4-b124-444a-bebe-25bd5f02b652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:25:34.940387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe81d4-b124-444a-bebe-25bd5f02b652 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:25:34.949287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 753/1533] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:25:38.731335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5477e-b5dd-4adb-9d2f-ca8b5eec2df3 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:38.731978 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5477e-b5dd-4adb-9d2f-ca8b5eec2df3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:38.731978 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5477e-b5dd-4adb-9d2f-ca8b5eec2df3 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:38.733277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 781/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:25:38.738714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35277f90-47bb-49cc-b435-2b3f7e5402f0 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:38.739111 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35277f90-47bb-49cc-b435-2b3f7e5402f0 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:38.739272 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35277f90-47bb-49cc-b435-2b3f7e5402f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:38.757245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-35277f90-47bb-49cc-b435-2b3f7e5402f0 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:25:38.758426 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-35277f90-47bb-49cc-b435-2b3f7e5402f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:25:38.766127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 754/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:25:39.042949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5477e-b5dd-4adb-9d2f-ca8b5eec2df3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:25:39.044699 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-25f5477e-b5dd-4adb-9d2f-ca8b5eec2df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:25:39.101413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5477e-b5dd-4adb-9d2f-ca8b5eec2df3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:25:39.105544 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6aeac3-5f0b-452b-b9d5-97a4c5afcf0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:25:39.106185 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aeac3-5f0b-452b-b9d5-97a4c5afcf0f service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:39.106469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aeac3-5f0b-452b-b9d5-97a4c5afcf0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:39.106746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aeac3-5f0b-452b-b9d5-97a4c5afcf0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:39.115410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6aeac3-5f0b-452b-b9d5-97a4c5afcf0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:25:39.116818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6aeac3-5f0b-452b-b9d5-97a4c5afcf0f service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:25:39.126140 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 782/1536] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:25:41.383526 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350a2a2-763e-4086-bccd-c0f8a92246bf None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:41.384066 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350a2a2-763e-4086-bccd-c0f8a92246bf None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:41.384066 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350a2a2-763e-4086-bccd-c0f8a92246bf None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:41.385976 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 755/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 20:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:25:41.391222 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa54f22-2430-45a7-ab94-65eab2513b48 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:41.391630 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa54f22-2430-45a7-ab94-65eab2513b48 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:41.391903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa54f22-2430-45a7-ab94-65eab2513b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:41.410265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1fa54f22-2430-45a7-ab94-65eab2513b48 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:25:41.411434 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1fa54f22-2430-45a7-ab94-65eab2513b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:25:41.419075 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 783/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 20:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:25:41.685780 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350a2a2-763e-4086-bccd-c0f8a92246bf None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:25:41.687427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b350a2a2-763e-4086-bccd-c0f8a92246bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:25:41.700384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350a2a2-763e-4086-bccd-c0f8a92246bf None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:25:41.703952 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22119263-0707-4487-9533-22e1a3f9d29a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:25:41.704576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22119263-0707-4487-9533-22e1a3f9d29a service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:25:41.704855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22119263-0707-4487-9533-22e1a3f9d29a service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:25:41.705166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22119263-0707-4487-9533-22e1a3f9d29a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:25:41.713661 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22119263-0707-4487-9533-22e1a3f9d29a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:25:41.715076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22119263-0707-4487-9533-22e1a3f9d29a service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:25:41.723980 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 756/1539] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:12.021218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5ab3e-a28e-4f15-800d-98762dd0d7aa None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.022375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5ab3e-a28e-4f15-800d-98762dd0d7aa None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.022922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5ab3e-a28e-4f15-800d-98762dd0d7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.050552 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-33e5ab3e-a28e-4f15-800d-98762dd0d7aa None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.051980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-33e5ab3e-a28e-4f15-800d-98762dd0d7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.065988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 784/1540] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:12.077432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a01250-87df-424d-9195-f8c9158b9c58 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.078592 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a01250-87df-424d-9195-f8c9158b9c58 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.079102 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a01250-87df-424d-9195-f8c9158b9c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.103081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-40a01250-87df-424d-9195-f8c9158b9c58 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.104855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-40a01250-87df-424d-9195-f8c9158b9c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.117804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 757/1541] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:12.123096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5ab3e-a28e-4f15-800d-98762dd0d7aa None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:12.138419 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5ab3e-a28e-4f15-800d-98762dd0d7aa None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:12.148575 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d33ba1-51ad-409e-93a9-3e716b34d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:12.149289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d33ba1-51ad-409e-93a9-3e716b34d907 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.149577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d33ba1-51ad-409e-93a9-3e716b34d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.149855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d33ba1-51ad-409e-93a9-3e716b34d907 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.150594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d33ba1-51ad-409e-93a9-3e716b34d907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:12.150902 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d33ba1-51ad-409e-93a9-3e716b34d907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:12.152528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d33ba1-51ad-409e-93a9-3e716b34d907 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:12.174356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 785/1542] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:27:12.183294 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a01250-87df-424d-9195-f8c9158b9c58 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:12.198121 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a01250-87df-424d-9195-f8c9158b9c58 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:12.203229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f9695-0603-492a-90a7-fa76b4854976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:12.204149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f9695-0603-492a-90a7-fa76b4854976 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.204761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f9695-0603-492a-90a7-fa76b4854976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.205409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f9695-0603-492a-90a7-fa76b4854976 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.206389 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f9695-0603-492a-90a7-fa76b4854976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:12.208489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f9695-0603-492a-90a7-fa76b4854976 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:12.249617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 758/1543] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:12.254204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d33ba1-51ad-409e-93a9-3e716b34d907 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:12.266446 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d33ba1-51ad-409e-93a9-3e716b34d907 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:12.345475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a84b3-32cd-4bab-95e5-aa760a91d61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:12.346203 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a84b3-32cd-4bab-95e5-aa760a91d61e admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.346492 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a84b3-32cd-4bab-95e5-aa760a91d61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.346909 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a84b3-32cd-4bab-95e5-aa760a91d61e admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.347761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a84b3-32cd-4bab-95e5-aa760a91d61e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:12.349743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a84b3-32cd-4bab-95e5-aa760a91d61e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:12.382635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 786/1544] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:12.387772 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f9695-0603-492a-90a7-fa76b4854976 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:12.403839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f9695-0603-492a-90a7-fa76b4854976 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:12.411782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171fdb8-1bf8-46d5-b725-04b262f088a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:12.412877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171fdb8-1bf8-46d5-b725-04b262f088a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.414003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171fdb8-1bf8-46d5-b725-04b262f088a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.414511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171fdb8-1bf8-46d5-b725-04b262f088a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.415476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171fdb8-1bf8-46d5-b725-04b262f088a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:12.417418 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171fdb8-1bf8-46d5-b725-04b262f088a4 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:12.431668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 759/1545] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:12.436259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a84b3-32cd-4bab-95e5-aa760a91d61e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:12.451202 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a84b3-32cd-4bab-95e5-aa760a91d61e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:12.456338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e12d9-68cb-495e-915a-9eeae740eb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:12.457083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e12d9-68cb-495e-915a-9eeae740eb00 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.457372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e12d9-68cb-495e-915a-9eeae740eb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.457650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e12d9-68cb-495e-915a-9eeae740eb00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.458418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e12d9-68cb-495e-915a-9eeae740eb00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:12.460729 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e12d9-68cb-495e-915a-9eeae740eb00 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:12.478418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 787/1546] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:12.483408 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171fdb8-1bf8-46d5-b725-04b262f088a4 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:12.484588 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec3b4f-39a9-4bbd-a421-3dc2fa81f2f5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.484914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec3b4f-39a9-4bbd-a421-3dc2fa81f2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.485332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec3b4f-39a9-4bbd-a421-3dc2fa81f2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.499788 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171fdb8-1bf8-46d5-b725-04b262f088a4 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:12.519568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcf955-4994-4ce7-95ce-84d6168788d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:12.521283 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcf955-4994-4ce7-95ce-84d6168788d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.521848 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcf955-4994-4ce7-95ce-84d6168788d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.522341 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcf955-4994-4ce7-95ce-84d6168788d0 admin admin] PATH_INFO: `/v3/projects/0df7bfa294d8474892d9384abea254ba/users/0dc7c04ac6d94347ac1d4ce87b35737b/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.550830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcf955-4994-4ce7-95ce-84d6168788d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df7bfa294d8474892d9384abea254ba, user_id=0dc7c04ac6d94347ac1d4ce87b35737b, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:12.554774 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcf955-4994-4ce7-95ce-84d6168788d0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:12.581921 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 760/1547] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:12 2022] PUT /identity/v3/projects/0df7bfa294d8474892d9384abea254ba/users/0dc7c04ac6d94347ac1d4ce87b35737b/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:12.595101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394bc4a-6cc1-4943-92c2-aabf6e47d25d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.595777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394bc4a-6cc1-4943-92c2-aabf6e47d25d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.596297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394bc4a-6cc1-4943-92c2-aabf6e47d25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.646250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-9394bc4a-6cc1-4943-92c2-aabf6e47d25d None None] MFA Rules not processed for user `0dc7c04ac6d94347ac1d4ce87b35737b`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.648992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9394bc4a-6cc1-4943-92c2-aabf6e47d25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.702307 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e8ec3b4f-39a9-4bbd-a421-3dc2fa81f2f5 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.703550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e8ec3b4f-39a9-4bbd-a421-3dc2fa81f2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.778398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 788/1548] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:12.779912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed97d6-d721-4e63-82bc-1978f8e220b9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.780199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed97d6-d721-4e63-82bc-1978f8e220b9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.780488 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed97d6-d721-4e63-82bc-1978f8e220b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.792294 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 761/1549] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:27:12.794121 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c0b95-2965-4577-95db-2bbfabc8d1ff None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.794633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c0b95-2965-4577-95db-2bbfabc8d1ff None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.795124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c0b95-2965-4577-95db-2bbfabc8d1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.811182 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-32ed97d6-d721-4e63-82bc-1978f8e220b9 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.812374 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-32ed97d6-d721-4e63-82bc-1978f8e220b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.815071 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-f74c0b95-2965-4577-95db-2bbfabc8d1ff None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.816481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f74c0b95-2965-4577-95db-2bbfabc8d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.820445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 789/1550] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:12.821546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a922f37-c94c-4ea8-89c0-92d82fc80ecc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.821889 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a922f37-c94c-4ea8-89c0-92d82fc80ecc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.822166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a922f37-c94c-4ea8-89c0-92d82fc80ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.832800 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 762/1551] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:12.834218 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d682dc-1d8c-4767-b7d1-e26aea4aa0b6 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.834626 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d682dc-1d8c-4767-b7d1-e26aea4aa0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.835815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d682dc-1d8c-4767-b7d1-e26aea4aa0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.842603 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2a922f37-c94c-4ea8-89c0-92d82fc80ecc None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.843946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2a922f37-c94c-4ea8-89c0-92d82fc80ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.852258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 790/1552] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:12.853629 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0335-2b2e-41e6-8e74-c723853cbedf None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.854014 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0335-2b2e-41e6-8e74-c723853cbedf None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.854288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0335-2b2e-41e6-8e74-c723853cbedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.854398 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-77d682dc-1d8c-4767-b7d1-e26aea4aa0b6 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.855589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-77d682dc-1d8c-4767-b7d1-e26aea4aa0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.863656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 763/1553] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:12.864954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a884ba-d976-47f7-b34d-bb061b702235 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.865225 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a884ba-d976-47f7-b34d-bb061b702235 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.865500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a884ba-d976-47f7-b34d-bb061b702235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.873104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9a6b0335-2b2e-41e6-8e74-c723853cbedf None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.874313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9a6b0335-2b2e-41e6-8e74-c723853cbedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.882006 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 791/1554] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:12.884038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b66515-0371-49bf-bf44-ae318ffe8037 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.884038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b66515-0371-49bf-bf44-ae318ffe8037 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.884038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b66515-0371-49bf-bf44-ae318ffe8037 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.885817 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-59a884ba-d976-47f7-b34d-bb061b702235 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.886985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-59a884ba-d976-47f7-b34d-bb061b702235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.889149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 792/1555] 10.222.0.61 () {54 vars in 961 bytes} [Tue May 10 20:27:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:27:12.890641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f667b-53d9-4b4b-a403-1ccf9e51af33 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.890999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f667b-53d9-4b4b-a403-1ccf9e51af33 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.891349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f667b-53d9-4b4b-a403-1ccf9e51af33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.895016 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 764/1556] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:12.896227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55266e-6d05-4d7c-91e0-100f352823ec None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.896516 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55266e-6d05-4d7c-91e0-100f352823ec None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.896789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55266e-6d05-4d7c-91e0-100f352823ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.915481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-ac55266e-6d05-4d7c-91e0-100f352823ec None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.915801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2b4f667b-53d9-4b4b-a403-1ccf9e51af33 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.916643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ac55266e-6d05-4d7c-91e0-100f352823ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.916966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2b4f667b-53d9-4b4b-a403-1ccf9e51af33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.924256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 765/1557] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:12.928366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 793/1558] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:12.928522 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8ebb7-7cdd-405c-8c84-3489e787a744 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.928522 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8ebb7-7cdd-405c-8c84-3489e787a744 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.928716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80b99-642b-44b5-b6e2-e3f46112ac8d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.928841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8ebb7-7cdd-405c-8c84-3489e787a744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.928937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80b99-642b-44b5-b6e2-e3f46112ac8d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.928937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca80b99-642b-44b5-b6e2-e3f46112ac8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.945788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1ca80b99-642b-44b5-b6e2-e3f46112ac8d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.945993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-93a8ebb7-7cdd-405c-8c84-3489e787a744 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.946972 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1ca80b99-642b-44b5-b6e2-e3f46112ac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.947089 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-93a8ebb7-7cdd-405c-8c84-3489e787a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.958145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 794/1559] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:12.958310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 766/1560] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:12.958310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8ebb7-7cdd-405c-8c84-3489e787a744 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:12.958507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62896272-eaa7-466c-9e04-1d89cf2560c8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.958507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62896272-eaa7-466c-9e04-1d89cf2560c8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.958507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62896272-eaa7-466c-9e04-1d89cf2560c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.967591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8ebb7-7cdd-405c-8c84-3489e787a744 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:12.972410 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42900d7-37c3-4890-a509-cf1f5c093c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:12.973103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42900d7-37c3-4890-a509-cf1f5c093c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.973379 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42900d7-37c3-4890-a509-cf1f5c093c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.973649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42900d7-37c3-4890-a509-cf1f5c093c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.974366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42900d7-37c3-4890-a509-cf1f5c093c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:12.974691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42900d7-37c3-4890-a509-cf1f5c093c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:12.975572 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-62896272-eaa7-466c-9e04-1d89cf2560c8 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:12.975704 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: WARNING py.warnings [None req-b42900d7-37c3-4890-a509-cf1f5c093c48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:27:12.975704 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: warnings.warn(msg) May 10 20:27:12.975704 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: May 10 20:27:12.976559 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42900d7-37c3-4890-a509-cf1f5c093c48 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:12.976776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-62896272-eaa7-466c-9e04-1d89cf2560c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:12.986740 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 795/1561] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:12.990302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339111a2-383a-455b-ac87-8e7eed8bda1c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.990407 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 767/1562] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:27:12.990542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339111a2-383a-455b-ac87-8e7eed8bda1c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.990542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339111a2-383a-455b-ac87-8e7eed8bda1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:12.990710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015fc9-9b6e-46aa-bf6d-e77a4098b583 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:12.990710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015fc9-9b6e-46aa-bf6d-e77a4098b583 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:12.990710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015fc9-9b6e-46aa-bf6d-e77a4098b583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.007874 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-9c015fc9-9b6e-46aa-bf6d-e77a4098b583 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:13.008140 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-339111a2-383a-455b-ac87-8e7eed8bda1c None None] MFA Rules not processed for user `8c3c6fe7e21c4c1ebc01cf91c3c05c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:13.009072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9c015fc9-9b6e-46aa-bf6d-e77a4098b583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:13.009317 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-339111a2-383a-455b-ac87-8e7eed8bda1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:13.017421 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 768/1563] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:13.018294 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c015fc9-9b6e-46aa-bf6d-e77a4098b583 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.028623 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c015fc9-9b6e-46aa-bf6d-e77a4098b583 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.033213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d90bb-d03b-40fc-8c78-79a882f91b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.033859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d90bb-d03b-40fc-8c78-79a882f91b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.034148 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d90bb-d03b-40fc-8c78-79a882f91b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.034424 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d90bb-d03b-40fc-8c78-79a882f91b48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.035146 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d90bb-d03b-40fc-8c78-79a882f91b48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:13.035455 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d90bb-d03b-40fc-8c78-79a882f91b48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.037069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d90bb-d03b-40fc-8c78-79a882f91b48 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.048300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 769/1564] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:27:13.049538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92661e-9f59-4053-aa1e-28f602eeb503 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.049827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92661e-9f59-4053-aa1e-28f602eeb503 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.050105 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92661e-9f59-4053-aa1e-28f602eeb503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.068029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-5c92661e-9f59-4053-aa1e-28f602eeb503 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:13.069249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5c92661e-9f59-4053-aa1e-28f602eeb503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:13.077743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 770/1565] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:13.078517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92661e-9f59-4053-aa1e-28f602eeb503 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.081039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 796/1566] 10.222.0.61 () {58 vars in 1058 bytes} [Tue May 10 20:27:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:13.081777 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339111a2-383a-455b-ac87-8e7eed8bda1c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.088451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92661e-9f59-4053-aa1e-28f602eeb503 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.092219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339111a2-383a-455b-ac87-8e7eed8bda1c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.093253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be91ed-c437-40a8-bcda-e6cff2a7b305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.093904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be91ed-c437-40a8-bcda-e6cff2a7b305 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.094188 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be91ed-c437-40a8-bcda-e6cff2a7b305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.094467 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be91ed-c437-40a8-bcda-e6cff2a7b305 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.095190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be91ed-c437-40a8-bcda-e6cff2a7b305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:13.095498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be91ed-c437-40a8-bcda-e6cff2a7b305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.096807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1df12e-18d1-4249-b009-aaae0e0ce613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.097102 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be91ed-c437-40a8-bcda-e6cff2a7b305 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.097525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1df12e-18d1-4249-b009-aaae0e0ce613 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.097812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1df12e-18d1-4249-b009-aaae0e0ce613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.098090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1df12e-18d1-4249-b009-aaae0e0ce613 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.098807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1df12e-18d1-4249-b009-aaae0e0ce613 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:13.099112 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1df12e-18d1-4249-b009-aaae0e0ce613 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.100755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1df12e-18d1-4249-b009-aaae0e0ce613 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.115497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 771/1567] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:27:13.115497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be91ed-c437-40a8-bcda-e6cff2a7b305 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.115777 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 797/1568] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:27:13.115777 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1df12e-18d1-4249-b009-aaae0e0ce613 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.122995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1df12e-18d1-4249-b009-aaae0e0ce613 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.125083 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be91ed-c437-40a8-bcda-e6cff2a7b305 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.127549 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dcb4c-c4b2-4f8f-9072-9e57c49df530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.128199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dcb4c-c4b2-4f8f-9072-9e57c49df530 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.128480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dcb4c-c4b2-4f8f-9072-9e57c49df530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.128756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dcb4c-c4b2-4f8f-9072-9e57c49df530 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.129561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229dcb4c-c4b2-4f8f-9072-9e57c49df530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.129681 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1ea63-483b-4929-822c-66f8c9ff5218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.130305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1ea63-483b-4929-822c-66f8c9ff5218 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.130558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-229dcb4c-c4b2-4f8f-9072-9e57c49df530 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 20:27:13.130558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 10 20:27:13.130558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: May 10 20:27:13.130815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1ea63-483b-4929-822c-66f8c9ff5218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.130945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1ea63-483b-4929-822c-66f8c9ff5218 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.131670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1ea63-483b-4929-822c-66f8c9ff5218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:13.131774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229dcb4c-c4b2-4f8f-9072-9e57c49df530 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.132571 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1ea63-483b-4929-822c-66f8c9ff5218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.134192 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1ea63-483b-4929-822c-66f8c9ff5218 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.146026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 772/1569] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:27:13.146778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1ea63-483b-4929-822c-66f8c9ff5218 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.157319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1ea63-483b-4929-822c-66f8c9ff5218 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.162031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec19106-39a4-4681-b41f-01c3c489b209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.162678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec19106-39a4-4681-b41f-01c3c489b209 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.162963 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec19106-39a4-4681-b41f-01c3c489b209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.163267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec19106-39a4-4681-b41f-01c3c489b209 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.163986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec19106-39a4-4681-b41f-01c3c489b209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:13.164297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec19106-39a4-4681-b41f-01c3c489b209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.168347 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 798/1570] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:13.168498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec19106-39a4-4681-b41f-01c3c489b209 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.168604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dcb4c-c4b2-4f8f-9072-9e57c49df530 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.177484 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 773/1571] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:27:13.178335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec19106-39a4-4681-b41f-01c3c489b209 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.193222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec19106-39a4-4681-b41f-01c3c489b209 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.225410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dcb4c-c4b2-4f8f-9072-9e57c49df530 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.230132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b08ce6-0731-4171-8f53-566fe823ca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.231003 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b08ce6-0731-4171-8f53-566fe823ca29 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.231144 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b08ce6-0731-4171-8f53-566fe823ca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.231334 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b08ce6-0731-4171-8f53-566fe823ca29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.232050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b08ce6-0731-4171-8f53-566fe823ca29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.234398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b08ce6-0731-4171-8f53-566fe823ca29 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.247590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43788c89-5ba3-4cb7-8a8c-2e0eca841fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.248255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43788c89-5ba3-4cb7-8a8c-2e0eca841fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.248535 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43788c89-5ba3-4cb7-8a8c-2e0eca841fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.248810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43788c89-5ba3-4cb7-8a8c-2e0eca841fb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.249573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43788c89-5ba3-4cb7-8a8c-2e0eca841fb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:13.249881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43788c89-5ba3-4cb7-8a8c-2e0eca841fb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.251497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43788c89-5ba3-4cb7-8a8c-2e0eca841fb1 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.261365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 799/1572] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:13.262255 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b08ce6-0731-4171-8f53-566fe823ca29 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.269943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 774/1573] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:27:13.269943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43788c89-5ba3-4cb7-8a8c-2e0eca841fb1 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.279805 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43788c89-5ba3-4cb7-8a8c-2e0eca841fb1 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.332633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce35d2-c0c9-4799-bfe9-07f9ede0a4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.333316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce35d2-c0c9-4799-bfe9-07f9ede0a4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.333597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce35d2-c0c9-4799-bfe9-07f9ede0a4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.333870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce35d2-c0c9-4799-bfe9-07f9ede0a4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.334545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce35d2-c0c9-4799-bfe9-07f9ede0a4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.335869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b08ce6-0731-4171-8f53-566fe823ca29 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.336547 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce35d2-c0c9-4799-bfe9-07f9ede0a4e8 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.341408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4a8de-f41e-438d-9eb7-37167b16deb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.342057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4a8de-f41e-438d-9eb7-37167b16deb3 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.342338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4a8de-f41e-438d-9eb7-37167b16deb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.342615 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4a8de-f41e-438d-9eb7-37167b16deb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.361472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 775/1574] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:13.362527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce35d2-c0c9-4799-bfe9-07f9ede0a4e8 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.396390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4a8de-f41e-438d-9eb7-37167b16deb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.399213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4a8de-f41e-438d-9eb7-37167b16deb3 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.410131 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 800/1575] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:13.416869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4a8de-f41e-438d-9eb7-37167b16deb3 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.426241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce35d2-c0c9-4799-bfe9-07f9ede0a4e8 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.426696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4a8de-f41e-438d-9eb7-37167b16deb3 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.431250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf309c05-bfe0-4ecc-88fc-e84963529399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.431917 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309c05-bfe0-4ecc-88fc-e84963529399 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.432026 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f16825-2bd8-4568-9435-fff4dad50292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.432236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309c05-bfe0-4ecc-88fc-e84963529399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.432486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309c05-bfe0-4ecc-88fc-e84963529399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.432600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16825-2bd8-4568-9435-fff4dad50292 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.432869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16825-2bd8-4568-9435-fff4dad50292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.433210 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf309c05-bfe0-4ecc-88fc-e84963529399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.433314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16825-2bd8-4568-9435-fff4dad50292 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.433920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f16825-2bd8-4568-9435-fff4dad50292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.435402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf309c05-bfe0-4ecc-88fc-e84963529399 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.435818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f16825-2bd8-4568-9435-fff4dad50292 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.462094 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 776/1576] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:13.462417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 801/1577] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:13.463363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f16825-2bd8-4568-9435-fff4dad50292 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.463748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf309c05-bfe0-4ecc-88fc-e84963529399 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.532233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f16825-2bd8-4568-9435-fff4dad50292 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.532434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf309c05-bfe0-4ecc-88fc-e84963529399 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.536760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6392-37c4-4f2b-a579-aced53fa8beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.536998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0495d1-6338-45f5-90b1-ceb42ef8b0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.537444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6392-37c4-4f2b-a579-aced53fa8beb admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.537725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6392-37c4-4f2b-a579-aced53fa8beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.537968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0495d1-6338-45f5-90b1-ceb42ef8b0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.538114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6392-37c4-4f2b-a579-aced53fa8beb admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.538997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0495d1-6338-45f5-90b1-ceb42ef8b0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.539241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d6392-37c4-4f2b-a579-aced53fa8beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.539467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0495d1-6338-45f5-90b1-ceb42ef8b0a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.540263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0495d1-6338-45f5-90b1-ceb42ef8b0a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.541192 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d6392-37c4-4f2b-a579-aced53fa8beb admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.542401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0495d1-6338-45f5-90b1-ceb42ef8b0a8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.562246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 802/1578] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:13.563193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0495d1-6338-45f5-90b1-ceb42ef8b0a8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.570794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 777/1579] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:13.571604 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6392-37c4-4f2b-a579-aced53fa8beb admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.572941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0495d1-6338-45f5-90b1-ceb42ef8b0a8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.628728 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86bce4-76a1-4531-9c77-6d2c0910b70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.629570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86bce4-76a1-4531-9c77-6d2c0910b70b admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.629959 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86bce4-76a1-4531-9c77-6d2c0910b70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.630338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86bce4-76a1-4531-9c77-6d2c0910b70b admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.631129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86bce4-76a1-4531-9c77-6d2c0910b70b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.633219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86bce4-76a1-4531-9c77-6d2c0910b70b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.633359 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6392-37c4-4f2b-a579-aced53fa8beb admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.638763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658c438-fe64-43cf-a578-5b2934f9bcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.639445 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658c438-fe64-43cf-a578-5b2934f9bcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.639722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658c438-fe64-43cf-a578-5b2934f9bcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.639992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658c438-fe64-43cf-a578-5b2934f9bcf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.640678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658c438-fe64-43cf-a578-5b2934f9bcf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.642645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658c438-fe64-43cf-a578-5b2934f9bcf7 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.655044 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 803/1580] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:13.655917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86bce4-76a1-4531-9c77-6d2c0910b70b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.667313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86bce4-76a1-4531-9c77-6d2c0910b70b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.669764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 778/1581] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:13.670490 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658c438-fe64-43cf-a578-5b2934f9bcf7 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.674704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5a9e8-eaf3-472f-8376-d238946d6b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.675371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5a9e8-eaf3-472f-8376-d238946d6b44 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.675656 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5a9e8-eaf3-472f-8376-d238946d6b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.675931 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5a9e8-eaf3-472f-8376-d238946d6b44 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.676827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5a9e8-eaf3-472f-8376-d238946d6b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.678889 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5a9e8-eaf3-472f-8376-d238946d6b44 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.698865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 804/1582] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:13.699903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5a9e8-eaf3-472f-8376-d238946d6b44 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.709647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5a9e8-eaf3-472f-8376-d238946d6b44 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.735892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658c438-fe64-43cf-a578-5b2934f9bcf7 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.740726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734130b-9b49-4c4b-a00a-2fba047b4521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.741468 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734130b-9b49-4c4b-a00a-2fba047b4521 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.741754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734130b-9b49-4c4b-a00a-2fba047b4521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.742031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734130b-9b49-4c4b-a00a-2fba047b4521 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.742734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734130b-9b49-4c4b-a00a-2fba047b4521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.743755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: WARNING py.warnings [None req-1734130b-9b49-4c4b-a00a-2fba047b4521 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 20:27:13.743755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: warnings.warn(msg) May 10 20:27:13.743755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: May 10 20:27:13.744952 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734130b-9b49-4c4b-a00a-2fba047b4521 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.767394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 779/1583] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:13.767394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734130b-9b49-4c4b-a00a-2fba047b4521 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.767705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1723d3-1c38-4d38-9ace-5d2760591b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.767705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1723d3-1c38-4d38-9ace-5d2760591b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.767705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1723d3-1c38-4d38-9ace-5d2760591b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.767705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1723d3-1c38-4d38-9ace-5d2760591b56 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.768059 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1723d3-1c38-4d38-9ace-5d2760591b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.769532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1723d3-1c38-4d38-9ace-5d2760591b56 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.775541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734130b-9b49-4c4b-a00a-2fba047b4521 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.780045 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d97a8-e157-4b51-b427-7d12fcc6afc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.780682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d97a8-e157-4b51-b427-7d12fcc6afc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.780989 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d97a8-e157-4b51-b427-7d12fcc6afc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.781275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d97a8-e157-4b51-b427-7d12fcc6afc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.781988 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d97a8-e157-4b51-b427-7d12fcc6afc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.783631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d97a8-e157-4b51-b427-7d12fcc6afc5 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.793122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 805/1584] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:13.793122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1723d3-1c38-4d38-9ace-5d2760591b56 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.793858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 780/1585] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:13.795151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d23c-0ec4-43bf-9b1f-8f41c763a16f None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.795458 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d23c-0ec4-43bf-9b1f-8f41c763a16f None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.795732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334d23c-0ec4-43bf-9b1f-8f41c763a16f None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.797055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 781/1586] 10.222.0.61 () {54 vars in 912 bytes} [Tue May 10 20:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:27:13.800532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1723d3-1c38-4d38-9ace-5d2760591b56 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.801954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334d23c-0ec4-43bf-9b1f-8f41c763a16f None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.805288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d67a74-cd05-4bab-bc8d-7991d1fd5707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.805944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d67a74-cd05-4bab-bc8d-7991d1fd5707 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.806232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d67a74-cd05-4bab-bc8d-7991d1fd5707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.806510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d67a74-cd05-4bab-bc8d-7991d1fd5707 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.807192 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d67a74-cd05-4bab-bc8d-7991d1fd5707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.809122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d67a74-cd05-4bab-bc8d-7991d1fd5707 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.813950 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334d23c-0ec4-43bf-9b1f-8f41c763a16f None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.818374 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fd696-81f4-4f39-9f83-b16196b56f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.818995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fd696-81f4-4f39-9f83-b16196b56f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.819900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fd696-81f4-4f39-9f83-b16196b56f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.820156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fd696-81f4-4f39-9f83-b16196b56f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.821080 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fd696-81f4-4f39-9f83-b16196b56f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.822909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fd696-81f4-4f39-9f83-b16196b56f5d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.828992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 806/1587] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/users => generated 297 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:13.829832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d67a74-cd05-4bab-bc8d-7991d1fd5707 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.833407 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 782/1588] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:13.834050 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fd696-81f4-4f39-9f83-b16196b56f5d admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.841579 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d67a74-cd05-4bab-bc8d-7991d1fd5707 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.844056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fd696-81f4-4f39-9f83-b16196b56f5d admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.846105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129701d4-c161-4f9f-a398-d443973a96d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.846760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129701d4-c161-4f9f-a398-d443973a96d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.847047 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129701d4-c161-4f9f-a398-d443973a96d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.847326 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129701d4-c161-4f9f-a398-d443973a96d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.848005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129701d4-c161-4f9f-a398-d443973a96d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.848786 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35919530-431b-4de5-b628-1c693faa950a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.849580 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919530-431b-4de5-b628-1c693faa950a admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.849958 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129701d4-c161-4f9f-a398-d443973a96d7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.850065 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919530-431b-4de5-b628-1c693faa950a admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.850242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919530-431b-4de5-b628-1c693faa950a admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.850990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35919530-431b-4de5-b628-1c693faa950a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.852567 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35919530-431b-4de5-b628-1c693faa950a admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.862847 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 783/1589] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:13.863611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35919530-431b-4de5-b628-1c693faa950a admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.869155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 807/1590] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:13.872339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129701d4-c161-4f9f-a398-d443973a96d7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.873512 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35919530-431b-4de5-b628-1c693faa950a admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.878091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f3fd5-dbbd-4697-ab20-96f2adf371d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.878734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3fd5-dbbd-4697-ab20-96f2adf371d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.879019 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3fd5-dbbd-4697-ab20-96f2adf371d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.879295 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f3fd5-dbbd-4697-ab20-96f2adf371d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.880039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f3fd5-dbbd-4697-ab20-96f2adf371d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.880884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129701d4-c161-4f9f-a398-d443973a96d7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.881754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6f3fd5-dbbd-4697-ab20-96f2adf371d9 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.885977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80553b-1dec-4cae-b625-a73ac0608e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.886595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80553b-1dec-4cae-b625-a73ac0608e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.886878 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80553b-1dec-4cae-b625-a73ac0608e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.887155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80553b-1dec-4cae-b625-a73ac0608e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.887873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80553b-1dec-4cae-b625-a73ac0608e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.889492 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80553b-1dec-4cae-b625-a73ac0608e45 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.891844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 784/1591] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:13.892678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f3fd5-dbbd-4697-ab20-96f2adf371d9 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.900162 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 808/1592] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:13.901295 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c6bee-9678-4a73-971e-bd498b21743b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.901583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c6bee-9678-4a73-971e-bd498b21743b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.901859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3c6bee-9678-4a73-971e-bd498b21743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.902895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f3fd5-dbbd-4697-ab20-96f2adf371d9 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.907571 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c3b0b-94f7-4b4a-b1bf-8ec4c62548a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.908207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c3b0b-94f7-4b4a-b1bf-8ec4c62548a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.908489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c3b0b-94f7-4b4a-b1bf-8ec4c62548a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.908768 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c3b0b-94f7-4b4a-b1bf-8ec4c62548a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.909519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c3b0b-94f7-4b4a-b1bf-8ec4c62548a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.911079 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c3b0b-94f7-4b4a-b1bf-8ec4c62548a8 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.918859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ce3c6bee-9678-4a73-971e-bd498b21743b None None] MFA Rules not processed for user `8c3c6fe7e21c4c1ebc01cf91c3c05c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:13.920047 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ce3c6bee-9678-4a73-971e-bd498b21743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:13.921207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 785/1593] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:13.921991 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c3b0b-94f7-4b4a-b1bf-8ec4c62548a8 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.930967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c3b0b-94f7-4b4a-b1bf-8ec4c62548a8 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.935475 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491711d-a52d-4dc4-a9fe-6ea6e75e4c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.936098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491711d-a52d-4dc4-a9fe-6ea6e75e4c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.936380 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491711d-a52d-4dc4-a9fe-6ea6e75e4c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.936654 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491711d-a52d-4dc4-a9fe-6ea6e75e4c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.937387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491711d-a52d-4dc4-a9fe-6ea6e75e4c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.938926 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491711d-a52d-4dc4-a9fe-6ea6e75e4c07 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.949001 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 786/1594] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:13.949861 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491711d-a52d-4dc4-a9fe-6ea6e75e4c07 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.959144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491711d-a52d-4dc4-a9fe-6ea6e75e4c07 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.964296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebb0d8-458b-4465-ab4a-cd7286f3568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.964922 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebb0d8-458b-4465-ab4a-cd7286f3568d admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.965265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebb0d8-458b-4465-ab4a-cd7286f3568d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.965537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebb0d8-458b-4465-ab4a-cd7286f3568d admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.966238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfebb0d8-458b-4465-ab4a-cd7286f3568d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.967824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfebb0d8-458b-4465-ab4a-cd7286f3568d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.978061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 787/1595] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:13.978953 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebb0d8-458b-4465-ab4a-cd7286f3568d admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.988864 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 809/1596] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:27:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:13.989585 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c6bee-9678-4a73-971e-bd498b21743b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:13.990610 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebb0d8-458b-4465-ab4a-cd7286f3568d admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:13.995387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fc5b5-fbe4-4bca-9f2f-34c4fb35b3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:13.996045 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fc5b5-fbe4-4bca-9f2f-34c4fb35b3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:13.996755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fc5b5-fbe4-4bca-9f2f-34c4fb35b3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:13.996755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fc5b5-fbe4-4bca-9f2f-34c4fb35b3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:13.997466 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fc5b5-fbe4-4bca-9f2f-34c4fb35b3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:13.999225 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873fc5b5-fbe4-4bca-9f2f-34c4fb35b3e6 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:13.999435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3c6bee-9678-4a73-971e-bd498b21743b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.004070 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85368249-686a-4662-8ca1-b0110cb3eddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.004721 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85368249-686a-4662-8ca1-b0110cb3eddb admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.005031 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85368249-686a-4662-8ca1-b0110cb3eddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.005310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85368249-686a-4662-8ca1-b0110cb3eddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.006027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85368249-686a-4662-8ca1-b0110cb3eddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.008488 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85368249-686a-4662-8ca1-b0110cb3eddb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.013123 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 788/1597] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:14.013123 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fc5b5-fbe4-4bca-9f2f-34c4fb35b3e6 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.021033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 810/1598] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:14.021033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85368249-686a-4662-8ca1-b0110cb3eddb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.023915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fc5b5-fbe4-4bca-9f2f-34c4fb35b3e6 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.028903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97027a23-8540-4387-8d33-438770b99c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.029604 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97027a23-8540-4387-8d33-438770b99c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.029891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97027a23-8540-4387-8d33-438770b99c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.030185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97027a23-8540-4387-8d33-438770b99c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.030896 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97027a23-8540-4387-8d33-438770b99c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.031150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85368249-686a-4662-8ca1-b0110cb3eddb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.032549 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97027a23-8540-4387-8d33-438770b99c24 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.036671 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542abad-ef04-4ceb-afda-ae13a2fe4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.037348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542abad-ef04-4ceb-afda-ae13a2fe4dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.037827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542abad-ef04-4ceb-afda-ae13a2fe4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.038344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542abad-ef04-4ceb-afda-ae13a2fe4dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.039423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542abad-ef04-4ceb-afda-ae13a2fe4dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.041457 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542abad-ef04-4ceb-afda-ae13a2fe4dc9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.043284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 789/1599] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:14.044100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97027a23-8540-4387-8d33-438770b99c24 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.054491 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97027a23-8540-4387-8d33-438770b99c24 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.054945 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 811/1600] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:14.056688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542abad-ef04-4ceb-afda-ae13a2fe4dc9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.059956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5f7c3-474c-448c-9fa8-f28cb5c5e7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.060839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5f7c3-474c-448c-9fa8-f28cb5c5e7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.061148 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5f7c3-474c-448c-9fa8-f28cb5c5e7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.061429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5f7c3-474c-448c-9fa8-f28cb5c5e7c5 admin admin] PATH_INFO: `/v3/projects/89cf2816f8884e679e6c7e4c3d98f348/users/36c95ddbd4384bb3a63d02698684e29a/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.066557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542abad-ef04-4ceb-afda-ae13a2fe4dc9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.071677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbb474-006d-43b1-8a85-10701e7fc99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.072323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbb474-006d-43b1-8a85-10701e7fc99e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.072608 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbb474-006d-43b1-8a85-10701e7fc99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.072886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbb474-006d-43b1-8a85-10701e7fc99e admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.073638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbb474-006d-43b1-8a85-10701e7fc99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.075223 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbb474-006d-43b1-8a85-10701e7fc99e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.076409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5f7c3-474c-448c-9fa8-f28cb5c5e7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89cf2816f8884e679e6c7e4c3d98f348, user_id=36c95ddbd4384bb3a63d02698684e29a, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.079100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5f7c3-474c-448c-9fa8-f28cb5c5e7c5 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.085723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 812/1601] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:14.086650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbb474-006d-43b1-8a85-10701e7fc99e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.092432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 790/1602] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:14 2022] PUT /identity/v3/projects/89cf2816f8884e679e6c7e4c3d98f348/users/36c95ddbd4384bb3a63d02698684e29a/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:14.093630 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5f7c3-474c-448c-9fa8-f28cb5c5e7c5 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.099768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbb474-006d-43b1-8a85-10701e7fc99e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.145399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5f7c3-474c-448c-9fa8-f28cb5c5e7c5 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.149334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9e737-0b24-4f72-a159-f9f639e31042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.149974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9e737-0b24-4f72-a159-f9f639e31042 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.150260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9e737-0b24-4f72-a159-f9f639e31042 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.150538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9e737-0b24-4f72-a159-f9f639e31042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.153830 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f0301-fdc6-4732-bda2-8bf81721aadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.154712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0301-fdc6-4732-bda2-8bf81721aadc admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.155013 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0301-fdc6-4732-bda2-8bf81721aadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.155272 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0301-fdc6-4732-bda2-8bf81721aadc admin admin] PATH_INFO: `/v3/projects/c86827b1ba384ed9b24e7e6afd65a4d5/users/45ecca878e5d46cabb3471d7ef14c2d0/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.169090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f0301-fdc6-4732-bda2-8bf81721aadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86827b1ba384ed9b24e7e6afd65a4d5, user_id=45ecca878e5d46cabb3471d7ef14c2d0, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.170193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-f66f0301-fdc6-4732-bda2-8bf81721aadc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 20:27:14.170193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 10 20:27:14.170193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: May 10 20:27:14.172259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f0301-fdc6-4732-bda2-8bf81721aadc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.185117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 813/1603] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:14 2022] PUT /identity/v3/projects/c86827b1ba384ed9b24e7e6afd65a4d5/users/45ecca878e5d46cabb3471d7ef14c2d0/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:14.185954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f0301-fdc6-4732-bda2-8bf81721aadc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.215902 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9e737-0b24-4f72-a159-f9f639e31042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.217543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9e737-0b24-4f72-a159-f9f639e31042 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.228175 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 791/1604] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:14.228962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9e737-0b24-4f72-a159-f9f639e31042 service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.238493 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9e737-0b24-4f72-a159-f9f639e31042 service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.244394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c907f-e15b-4d6f-987c-58abfb53b935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.245150 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c907f-e15b-4d6f-987c-58abfb53b935 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.245435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c907f-e15b-4d6f-987c-58abfb53b935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.245662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f0301-fdc6-4732-bda2-8bf81721aadc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.245781 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c907f-e15b-4d6f-987c-58abfb53b935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.246419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c907f-e15b-4d6f-987c-58abfb53b935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.247958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c907f-e15b-4d6f-987c-58abfb53b935 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.250378 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52273430-3bfa-4625-8087-860467b2c236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.251265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52273430-3bfa-4625-8087-860467b2c236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.251542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52273430-3bfa-4625-8087-860467b2c236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.251818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52273430-3bfa-4625-8087-860467b2c236 admin admin] PATH_INFO: `/v3/projects/e3da83e11e724b20bb63ca22111cfcc9/users/3b0856904b7c41728fe70049141eaf5f/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.259156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 792/1605] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:14.260162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c907f-e15b-4d6f-987c-58abfb53b935 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.269216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52273430-3bfa-4625-8087-860467b2c236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3da83e11e724b20bb63ca22111cfcc9, user_id=3b0856904b7c41728fe70049141eaf5f, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.270636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c907f-e15b-4d6f-987c-58abfb53b935 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.272042 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52273430-3bfa-4625-8087-860467b2c236 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.275616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abe656-274a-4311-bf34-e061d2aeeeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.276521 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abe656-274a-4311-bf34-e061d2aeeeb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.276806 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abe656-274a-4311-bf34-e061d2aeeeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.277152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abe656-274a-4311-bf34-e061d2aeeeb4 admin admin] PATH_INFO: `/v3/projects/86ce3a769a2d40999f21c8362774899c/users/bde3e20446d444bd870958eca8baa08e/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.286788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 814/1606] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:14 2022] PUT /identity/v3/projects/e3da83e11e724b20bb63ca22111cfcc9/users/3b0856904b7c41728fe70049141eaf5f/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:14.287845 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52273430-3bfa-4625-8087-860467b2c236 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.304988 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abe656-274a-4311-bf34-e061d2aeeeb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ce3a769a2d40999f21c8362774899c, user_id=bde3e20446d444bd870958eca8baa08e, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.307668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06abe656-274a-4311-bf34-e061d2aeeeb4 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.322471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 793/1607] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:14 2022] PUT /identity/v3/projects/86ce3a769a2d40999f21c8362774899c/users/bde3e20446d444bd870958eca8baa08e/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:14.323537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abe656-274a-4311-bf34-e061d2aeeeb4 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.358192 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52273430-3bfa-4625-8087-860467b2c236 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.395239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abe656-274a-4311-bf34-e061d2aeeeb4 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.400463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f816e-a8f4-44cc-a928-2ef329c56e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.401997 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f816e-a8f4-44cc-a928-2ef329c56e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.401997 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f816e-a8f4-44cc-a928-2ef329c56e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.402201 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f816e-a8f4-44cc-a928-2ef329c56e85 admin admin] PATH_INFO: `/v3/projects/67dae2f388bc4a81bc957f48b1b02e42/users/df3cf8a2f7c54b80aac61d6ca59672b5/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.420384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f816e-a8f4-44cc-a928-2ef329c56e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67dae2f388bc4a81bc957f48b1b02e42, user_id=df3cf8a2f7c54b80aac61d6ca59672b5, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.421658 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782e8d9-e198-4ca4-9a0a-5578a97608f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.422587 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782e8d9-e198-4ca4-9a0a-5578a97608f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.422866 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782e8d9-e198-4ca4-9a0a-5578a97608f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.423138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782e8d9-e198-4ca4-9a0a-5578a97608f4 admin admin] PATH_INFO: `/v3/projects/ef717363cd714bdc9ae9d3a620172ef6/users/02cf24a91fce4cbfb0e041818981fe2c/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.423319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f816e-a8f4-44cc-a928-2ef329c56e85 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.440300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782e8d9-e198-4ca4-9a0a-5578a97608f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef717363cd714bdc9ae9d3a620172ef6, user_id=02cf24a91fce4cbfb0e041818981fe2c, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.444645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 794/1608] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:14 2022] PUT /identity/v3/projects/67dae2f388bc4a81bc957f48b1b02e42/users/df3cf8a2f7c54b80aac61d6ca59672b5/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:14.444645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85fcc-219f-49a7-9c1d-3b3ba5c7da4d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.444645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85fcc-219f-49a7-9c1d-3b3ba5c7da4d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.444645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85fcc-219f-49a7-9c1d-3b3ba5c7da4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.445136 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782e8d9-e198-4ca4-9a0a-5578a97608f4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.464939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 815/1609] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:14 2022] PUT /identity/v3/projects/ef717363cd714bdc9ae9d3a620172ef6/users/02cf24a91fce4cbfb0e041818981fe2c/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:14.464939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e783815-69a2-4b3a-b3aa-118ee71a9f33 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.464939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e783815-69a2-4b3a-b3aa-118ee71a9f33 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.464939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e783815-69a2-4b3a-b3aa-118ee71a9f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.467178 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-5fc85fcc-219f-49a7-9c1d-3b3ba5c7da4d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:14.469147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5fc85fcc-219f-49a7-9c1d-3b3ba5c7da4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:14.483165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7e783815-69a2-4b3a-b3aa-118ee71a9f33 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:14.484563 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7e783815-69a2-4b3a-b3aa-118ee71a9f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:14.532272 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 795/1610] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:14.536307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc85fcc-219f-49a7-9c1d-3b3ba5c7da4d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.544498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 816/1611] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:14.545759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418ad5b-ddf6-4677-90f1-30f9fbd65279 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.546049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418ad5b-ddf6-4677-90f1-30f9fbd65279 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.546330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418ad5b-ddf6-4677-90f1-30f9fbd65279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.549869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc85fcc-219f-49a7-9c1d-3b3ba5c7da4d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.556169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa66e45-ea7c-4f2b-8037-269351f80f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.557096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa66e45-ea7c-4f2b-8037-269351f80f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.557465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa66e45-ea7c-4f2b-8037-269351f80f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.557646 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa66e45-ea7c-4f2b-8037-269351f80f95 admin admin] PATH_INFO: `/v3/projects/638a84064b2244e0b938b063e13cb944/users/e092796100394b63a7304abae7e25f7d/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.574474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0418ad5b-ddf6-4677-90f1-30f9fbd65279 None None] MFA Rules not processed for user `3b0856904b7c41728fe70049141eaf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:14.574832 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa66e45-ea7c-4f2b-8037-269351f80f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638a84064b2244e0b938b063e13cb944, user_id=e092796100394b63a7304abae7e25f7d, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.575874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0418ad5b-ddf6-4677-90f1-30f9fbd65279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:14.577641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa66e45-ea7c-4f2b-8037-269351f80f95 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.591766 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 796/1612] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:14 2022] PUT /identity/v3/projects/638a84064b2244e0b938b063e13cb944/users/e092796100394b63a7304abae7e25f7d/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:14.595728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512b952-4081-4b2c-b06c-101c556fcfa8 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.595728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512b952-4081-4b2c-b06c-101c556fcfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.595728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512b952-4081-4b2c-b06c-101c556fcfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.621321 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-5512b952-4081-4b2c-b06c-101c556fcfa8 None None] MFA Rules not processed for user `bde3e20446d444bd870958eca8baa08e`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:14.622542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5512b952-4081-4b2c-b06c-101c556fcfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:14.643960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 817/1613] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:14.645607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a05c-51c1-49e9-aad8-f05dc1cdd87a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.646121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a05c-51c1-49e9-aad8-f05dc1cdd87a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.646610 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998a05c-51c1-49e9-aad8-f05dc1cdd87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.665070 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7998a05c-51c1-49e9-aad8-f05dc1cdd87a None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:14.666339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7998a05c-51c1-49e9-aad8-f05dc1cdd87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:14.687815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 797/1614] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:14.692669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3383fcc-8dae-431c-8da9-4e7eb11cca2e None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.692959 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3383fcc-8dae-431c-8da9-4e7eb11cca2e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.693259 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3383fcc-8dae-431c-8da9-4e7eb11cca2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.718932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b3383fcc-8dae-431c-8da9-4e7eb11cca2e None None] MFA Rules not processed for user `02cf24a91fce4cbfb0e041818981fe2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:14.720144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b3383fcc-8dae-431c-8da9-4e7eb11cca2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:14.725384 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 818/1615] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:14.726788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998a05c-51c1-49e9-aad8-f05dc1cdd87a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.728692 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7998a05c-51c1-49e9-aad8-f05dc1cdd87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:14.796409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998a05c-51c1-49e9-aad8-f05dc1cdd87a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.804003 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca564b06-17d3-4ddb-83fb-8963ab683dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.804673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca564b06-17d3-4ddb-83fb-8963ab683dad service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.804960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca564b06-17d3-4ddb-83fb-8963ab683dad service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.805957 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca564b06-17d3-4ddb-83fb-8963ab683dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.806042 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 798/1616] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:14.806810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3383fcc-8dae-431c-8da9-4e7eb11cca2e None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.815923 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca564b06-17d3-4ddb-83fb-8963ab683dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.816782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3383fcc-8dae-431c-8da9-4e7eb11cca2e None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.817404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca564b06-17d3-4ddb-83fb-8963ab683dad service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.821164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc34ea-8398-4bd5-8a97-27d49e0985d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.821822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc34ea-8398-4bd5-8a97-27d49e0985d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.822104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc34ea-8398-4bd5-8a97-27d49e0985d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.822380 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc34ea-8398-4bd5-8a97-27d49e0985d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.827692 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 819/1617] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:14.829139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6d518-9661-4d04-81aa-098c067145d7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.829558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6d518-9661-4d04-81aa-098c067145d7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.829846 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6d518-9661-4d04-81aa-098c067145d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.848890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-63c6d518-9661-4d04-81aa-098c067145d7 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:14.849253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc34ea-8398-4bd5-8a97-27d49e0985d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.850261 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-63c6d518-9661-4d04-81aa-098c067145d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:14.851242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc34ea-8398-4bd5-8a97-27d49e0985d2 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.859905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 820/1618] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:14.861455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ab613-45e4-47b2-ac88-825216369612 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.861743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ab613-45e4-47b2-ac88-825216369612 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.862025 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ab613-45e4-47b2-ac88-825216369612 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.863888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 821/1619] 10.222.0.61 () {54 vars in 961 bytes} [Tue May 10 20:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:27:14.864932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ab613-45e4-47b2-ac88-825216369612 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.878817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ab613-45e4-47b2-ac88-825216369612 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.886958 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df349f0-594b-4e0b-86c2-01637dcbe3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.887162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 799/1620] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:14.887706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df349f0-594b-4e0b-86c2-01637dcbe3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.887990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df349f0-594b-4e0b-86c2-01637dcbe3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.888107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc34ea-8398-4bd5-8a97-27d49e0985d2 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.888427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df349f0-594b-4e0b-86c2-01637dcbe3d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.889227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df349f0-594b-4e0b-86c2-01637dcbe3d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.891373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df349f0-594b-4e0b-86c2-01637dcbe3d6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.911525 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc34ea-8398-4bd5-8a97-27d49e0985d2 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:14.916872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f270784-06d2-4558-90e2-127d4200d340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:14.918715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270784-06d2-4558-90e2-127d4200d340 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.919101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270784-06d2-4558-90e2-127d4200d340 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.919544 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f270784-06d2-4558-90e2-127d4200d340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:14.937751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 822/1621] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:14 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:14.937751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df349f0-594b-4e0b-86c2-01637dcbe3d6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:14.952729 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f270784-06d2-4558-90e2-127d4200d340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:14.954392 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f270784-06d2-4558-90e2-127d4200d340 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:14.976224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 800/1622] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:14.977949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad66bf9-a955-4eb6-aa51-5d96ca997064 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:14.978344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad66bf9-a955-4eb6-aa51-5d96ca997064 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:14.978721 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad66bf9-a955-4eb6-aa51-5d96ca997064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.007096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-4ad66bf9-a955-4eb6-aa51-5d96ca997064 None None] MFA Rules not processed for user `8c3c6fe7e21c4c1ebc01cf91c3c05c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:15.008626 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-4ad66bf9-a955-4eb6-aa51-5d96ca997064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:15.059390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df349f0-594b-4e0b-86c2-01637dcbe3d6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:15.065597 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b0e3d-77c9-4938-ba3f-7f1d7b866359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:15.066507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b0e3d-77c9-4938-ba3f-7f1d7b866359 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.067315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b0e3d-77c9-4938-ba3f-7f1d7b866359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.067315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b0e3d-77c9-4938-ba3f-7f1d7b866359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.067995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b0e3d-77c9-4938-ba3f-7f1d7b866359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:15.071096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b0e3d-77c9-4938-ba3f-7f1d7b866359 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:15.107335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 823/1623] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:14 2022] POST /identity/v3/projects => generated 405 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:15.108362 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b0e3d-77c9-4938-ba3f-7f1d7b866359 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:15.137094 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 801/1624] 10.222.0.61 () {58 vars in 1058 bytes} [Tue May 10 20:27:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:15.138905 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad66bf9-a955-4eb6-aa51-5d96ca997064 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:15.153501 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad66bf9-a955-4eb6-aa51-5d96ca997064 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:15.171774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b0e3d-77c9-4938-ba3f-7f1d7b866359 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:15.175723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2b81-d37f-47fa-8c79-ef23fe2c93d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:15.177181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2b81-d37f-47fa-8c79-ef23fe2c93d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.177181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2b81-d37f-47fa-8c79-ef23fe2c93d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.177181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2b81-d37f-47fa-8c79-ef23fe2c93d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.257688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d0a01-b6e5-42ac-9fe0-891411fc8e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:15.258470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d0a01-b6e5-42ac-9fe0-891411fc8e9f admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.259717 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d0a01-b6e5-42ac-9fe0-891411fc8e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.260796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d0a01-b6e5-42ac-9fe0-891411fc8e9f admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.261791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d0a01-b6e5-42ac-9fe0-891411fc8e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:15.263288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be2b81-d37f-47fa-8c79-ef23fe2c93d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:15.264280 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d0a01-b6e5-42ac-9fe0-891411fc8e9f admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:15.266069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be2b81-d37f-47fa-8c79-ef23fe2c93d9 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:15.281775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 824/1625] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:15.283471 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2b81-d37f-47fa-8c79-ef23fe2c93d9 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:15.289871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 802/1626] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:15 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:15.291044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d0a01-b6e5-42ac-9fe0-891411fc8e9f admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:15.294626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2b81-d37f-47fa-8c79-ef23fe2c93d9 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:15.300865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a001f-47b4-4aea-b039-03b689f36dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:15.301918 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a001f-47b4-4aea-b039-03b689f36dfc admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.302292 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a001f-47b4-4aea-b039-03b689f36dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.302676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a001f-47b4-4aea-b039-03b689f36dfc admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.303446 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a001f-47b4-4aea-b039-03b689f36dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:15.306153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a001f-47b4-4aea-b039-03b689f36dfc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:15.347264 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 825/1627] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:15 2022] POST /identity/v3/users => generated 309 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:15.348227 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a001f-47b4-4aea-b039-03b689f36dfc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:15.360543 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a001f-47b4-4aea-b039-03b689f36dfc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:15.366904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6693c-c399-48dd-a4e1-89dd790e8209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:15.367724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6693c-c399-48dd-a4e1-89dd790e8209 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.368188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6693c-c399-48dd-a4e1-89dd790e8209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.368549 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6693c-c399-48dd-a4e1-89dd790e8209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.369757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6693c-c399-48dd-a4e1-89dd790e8209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:15.372249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6693c-c399-48dd-a4e1-89dd790e8209 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:15.380196 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d0a01-b6e5-42ac-9fe0-891411fc8e9f admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:15.385167 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 826/1628] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:15.386781 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6693c-c399-48dd-a4e1-89dd790e8209 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:15.388463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241ce0f-0266-4786-8cc1-96b026242aea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:15.389174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241ce0f-0266-4786-8cc1-96b026242aea service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.389464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241ce0f-0266-4786-8cc1-96b026242aea service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.389746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241ce0f-0266-4786-8cc1-96b026242aea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.399626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6693c-c399-48dd-a4e1-89dd790e8209 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:15.406986 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e0f3f-a9d4-4e73-89ee-8547463e717c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:15.407854 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e0f3f-a9d4-4e73-89ee-8547463e717c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.408201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e0f3f-a9d4-4e73-89ee-8547463e717c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.408487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e0f3f-a9d4-4e73-89ee-8547463e717c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.409631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e0f3f-a9d4-4e73-89ee-8547463e717c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:15.411350 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e0f3f-a9d4-4e73-89ee-8547463e717c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:15.425730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 827/1629] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:15.426659 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e0f3f-a9d4-4e73-89ee-8547463e717c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:15.445548 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e0f3f-a9d4-4e73-89ee-8547463e717c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:15.451195 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8513e35-24f1-46b9-bd84-79a9f6039bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:15.452096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8513e35-24f1-46b9-bd84-79a9f6039bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.452376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8513e35-24f1-46b9-bd84-79a9f6039bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.452652 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8513e35-24f1-46b9-bd84-79a9f6039bfa admin admin] PATH_INFO: `/v3/projects/8a28446b83a6453a8aaca3e78afae4c6/users/2aefc5d5dbb347319d6bf6a9708ba0f1/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.463618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241ce0f-0266-4786-8cc1-96b026242aea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:15.465408 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241ce0f-0266-4786-8cc1-96b026242aea service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:15.474085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8513e35-24f1-46b9-bd84-79a9f6039bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a28446b83a6453a8aaca3e78afae4c6, user_id=2aefc5d5dbb347319d6bf6a9708ba0f1, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:15.476129 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 803/1630] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:15.476640 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8513e35-24f1-46b9-bd84-79a9f6039bfa admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:15.476982 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241ce0f-0266-4786-8cc1-96b026242aea service nova] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:15.488010 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241ce0f-0266-4786-8cc1-96b026242aea service nova] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:15.498224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 828/1631] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:15 2022] PUT /identity/v3/projects/8a28446b83a6453a8aaca3e78afae4c6/users/2aefc5d5dbb347319d6bf6a9708ba0f1/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:15.503031 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8513e35-24f1-46b9-bd84-79a9f6039bfa admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:15.631412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab65a3-c4eb-47d7-960e-559c2b48cf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:15.632636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab65a3-c4eb-47d7-960e-559c2b48cf23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.632923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab65a3-c4eb-47d7-960e-559c2b48cf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.633231 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab65a3-c4eb-47d7-960e-559c2b48cf23 admin admin] PATH_INFO: `/v3/projects/26497346d4ae465498dda3416ab74b94/users/fefa7fb5cdf140e38bc5450a297e0c49/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.657104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8513e35-24f1-46b9-bd84-79a9f6039bfa admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:15.664578 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab65a3-c4eb-47d7-960e-559c2b48cf23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26497346d4ae465498dda3416ab74b94, user_id=fefa7fb5cdf140e38bc5450a297e0c49, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:15.668764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd57ab0-29ce-48c8-972b-b1efc843c33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:15.670610 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd57ab0-29ce-48c8-972b-b1efc843c33f admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.670893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd57ab0-29ce-48c8-972b-b1efc843c33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.671364 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab65a3-c4eb-47d7-960e-559c2b48cf23 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:15.672352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd57ab0-29ce-48c8-972b-b1efc843c33f admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.673134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd57ab0-29ce-48c8-972b-b1efc843c33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:15.676673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd57ab0-29ce-48c8-972b-b1efc843c33f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:15.699505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 804/1632] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:15 2022] PUT /identity/v3/projects/26497346d4ae465498dda3416ab74b94/users/fefa7fb5cdf140e38bc5450a297e0c49/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:15.715909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab65a3-c4eb-47d7-960e-559c2b48cf23 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:15.718574 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 829/1633] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:15.719854 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd57ab0-29ce-48c8-972b-b1efc843c33f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:15.742988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd57ab0-29ce-48c8-972b-b1efc843c33f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:15.833240 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab65a3-c4eb-47d7-960e-559c2b48cf23 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:15.845063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e48a56-977e-4e8c-a7ab-c10600f589d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:15.845546 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e48a56-977e-4e8c-a7ab-c10600f589d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.846184 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e48a56-977e-4e8c-a7ab-c10600f589d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.846184 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e48a56-977e-4e8c-a7ab-c10600f589d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.846828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e48a56-977e-4e8c-a7ab-c10600f589d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:15.848447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e48a56-977e-4e8c-a7ab-c10600f589d0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:15.869930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 805/1634] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:15.871564 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e48a56-977e-4e8c-a7ab-c10600f589d0 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:15.887260 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2a277-9e84-4cff-aa5e-2cc2fcc2fe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:15.888914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2a277-9e84-4cff-aa5e-2cc2fcc2fe8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.889456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2a277-9e84-4cff-aa5e-2cc2fcc2fe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.889972 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2a277-9e84-4cff-aa5e-2cc2fcc2fe8c admin admin] PATH_INFO: `/v3/projects/8a28446b83a6453a8aaca3e78afae4c6/users/2aefc5d5dbb347319d6bf6a9708ba0f1/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.892319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2a277-9e84-4cff-aa5e-2cc2fcc2fe8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a28446b83a6453a8aaca3e78afae4c6, user_id=2aefc5d5dbb347319d6bf6a9708ba0f1, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:15.895409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2a277-9e84-4cff-aa5e-2cc2fcc2fe8c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:15.896608 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e48a56-977e-4e8c-a7ab-c10600f589d0 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:15.906534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78742fac-9278-413b-9cc2-dfb34445059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:15.908898 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78742fac-9278-413b-9cc2-dfb34445059a admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.920255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78742fac-9278-413b-9cc2-dfb34445059a admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.920255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78742fac-9278-413b-9cc2-dfb34445059a admin admin] PATH_INFO: `/v3/projects/26497346d4ae465498dda3416ab74b94/users/fefa7fb5cdf140e38bc5450a297e0c49/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.920660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 830/1635] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:15 2022] PUT /identity/v3/projects/8a28446b83a6453a8aaca3e78afae4c6/users/2aefc5d5dbb347319d6bf6a9708ba0f1/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:15.920660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ca140-f0dd-4a8d-84d9-90b301cb52a0 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.920660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ca140-f0dd-4a8d-84d9-90b301cb52a0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.920660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ca140-f0dd-4a8d-84d9-90b301cb52a0 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.921903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78742fac-9278-413b-9cc2-dfb34445059a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26497346d4ae465498dda3416ab74b94, user_id=fefa7fb5cdf140e38bc5450a297e0c49, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:15.924505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 831/1636] 10.222.0.61 () {54 vars in 912 bytes} [Tue May 10 20:27:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:27:15.929381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03588d8-8218-46bd-b91f-61e9d42684cc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.929814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03588d8-8218-46bd-b91f-61e9d42684cc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.930103 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03588d8-8218-46bd-b91f-61e9d42684cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.930952 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78742fac-9278-413b-9cc2-dfb34445059a admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:15.956855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 806/1637] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:15 2022] PUT /identity/v3/projects/26497346d4ae465498dda3416ab74b94/users/fefa7fb5cdf140e38bc5450a297e0c49/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:15.959287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda13666-3d67-4a90-b432-b92a4b680bea None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:15.959685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda13666-3d67-4a90-b432-b92a4b680bea None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:15.960835 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda13666-3d67-4a90-b432-b92a4b680bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:15.987612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e03588d8-8218-46bd-b91f-61e9d42684cc None None] MFA Rules not processed for user `2aefc5d5dbb347319d6bf6a9708ba0f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:15.998308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e03588d8-8218-46bd-b91f-61e9d42684cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:16.001378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-fda13666-3d67-4a90-b432-b92a4b680bea None None] MFA Rules not processed for user `8c3c6fe7e21c4c1ebc01cf91c3c05c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:16.005795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fda13666-3d67-4a90-b432-b92a4b680bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:16.121852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 832/1638] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:16.123460 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f6acb-d41c-4cbc-a095-5835c6577d81 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:16.124244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f6acb-d41c-4cbc-a095-5835c6577d81 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:16.124845 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f6acb-d41c-4cbc-a095-5835c6577d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:16.169743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-fd3f6acb-d41c-4cbc-a095-5835c6577d81 None None] MFA Rules not processed for user `fefa7fb5cdf140e38bc5450a297e0c49`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:16.171101 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fd3f6acb-d41c-4cbc-a095-5835c6577d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:16.192733 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 807/1639] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:27:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:16.194162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda13666-3d67-4a90-b432-b92a4b680bea None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:16.288476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda13666-3d67-4a90-b432-b92a4b680bea None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:16.292488 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce01637-8977-44fa-92e3-a704db8ed4f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:16.293356 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce01637-8977-44fa-92e3-a704db8ed4f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:16.294755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce01637-8977-44fa-92e3-a704db8ed4f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:16.294755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce01637-8977-44fa-92e3-a704db8ed4f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:16.309317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce01637-8977-44fa-92e3-a704db8ed4f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:16.311481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce01637-8977-44fa-92e3-a704db8ed4f1 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:16.315700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 833/1640] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:16 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:16.317181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc48bd7-5a96-4d03-b4f3-c0317064d814 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:16.317476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc48bd7-5a96-4d03-b4f3-c0317064d814 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:16.317757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc48bd7-5a96-4d03-b4f3-c0317064d814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:16.352435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 808/1641] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:16.384953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9fc48bd7-5a96-4d03-b4f3-c0317064d814 None None] MFA Rules not processed for user `45ecca878e5d46cabb3471d7ef14c2d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:16.386176 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9fc48bd7-5a96-4d03-b4f3-c0317064d814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:16.413480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce01637-8977-44fa-92e3-a704db8ed4f1 service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:16.426689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce01637-8977-44fa-92e3-a704db8ed4f1 service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:16.436269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510758b-804f-462b-84b6-2124e4f0c025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:16.437049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510758b-804f-462b-84b6-2124e4f0c025 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:16.437389 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510758b-804f-462b-84b6-2124e4f0c025 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:16.437730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510758b-804f-462b-84b6-2124e4f0c025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:16.464221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510758b-804f-462b-84b6-2124e4f0c025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:16.466540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510758b-804f-462b-84b6-2124e4f0c025 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:16.488207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 809/1642] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:27:16.543776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 834/1643] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:16.555262 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be4ff1-6148-45c9-8411-2f2810edc4aa None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:16.555576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be4ff1-6148-45c9-8411-2f2810edc4aa None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:16.555853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be4ff1-6148-45c9-8411-2f2810edc4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:16.589724 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-69be4ff1-6148-45c9-8411-2f2810edc4aa None None] MFA Rules not processed for user `45ecca878e5d46cabb3471d7ef14c2d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:16.592331 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-69be4ff1-6148-45c9-8411-2f2810edc4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:16.612502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 810/1644] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:16.782851 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc48bd7-5a96-4d03-b4f3-c0317064d814 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:16.783039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be4ff1-6148-45c9-8411-2f2810edc4aa None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:16.801087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc48bd7-5a96-4d03-b4f3-c0317064d814 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:16.809004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45160a48-9f03-452e-b51c-2431311d2fe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:16.809582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45160a48-9f03-452e-b51c-2431311d2fe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:16.809904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45160a48-9f03-452e-b51c-2431311d2fe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:16.810182 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45160a48-9f03-452e-b51c-2431311d2fe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:16.811198 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be4ff1-6148-45c9-8411-2f2810edc4aa None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:16.839928 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc0c30-012a-40cd-9536-604e43a8f0e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:16.841055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45160a48-9f03-452e-b51c-2431311d2fe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:16.843353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc0c30-012a-40cd-9536-604e43a8f0e5 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:16.844112 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45160a48-9f03-452e-b51c-2431311d2fe5 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:16.844238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc0c30-012a-40cd-9536-604e43a8f0e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:16.844573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc0c30-012a-40cd-9536-604e43a8f0e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:16.875507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc0c30-012a-40cd-9536-604e43a8f0e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:16.879901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc0c30-012a-40cd-9536-604e43a8f0e5 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:16.882283 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 835/1645] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:16 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:16.916491 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 811/1646] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:27:17.252766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45160a48-9f03-452e-b51c-2431311d2fe5 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:17.267342 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45160a48-9f03-452e-b51c-2431311d2fe5 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:17.283141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f87b9-7de7-4c87-af83-f9847657e570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:17.284219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f87b9-7de7-4c87-af83-f9847657e570 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:17.284917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f87b9-7de7-4c87-af83-f9847657e570 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:17.285518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f87b9-7de7-4c87-af83-f9847657e570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:17.361609 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f87b9-7de7-4c87-af83-f9847657e570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:17.363671 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f87b9-7de7-4c87-af83-f9847657e570 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:17.387922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 836/1647] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:17.763469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419abd0-ac0f-4108-8973-2cd1e2222cdb None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:17.764044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419abd0-ac0f-4108-8973-2cd1e2222cdb None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:17.764044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419abd0-ac0f-4108-8973-2cd1e2222cdb None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:17.765796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 812/1648] 10.222.0.61 () {54 vars in 912 bytes} [Tue May 10 20:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:27:17.778505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7471fb9-d4db-45fc-b8cc-34f80db54da3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:17.778904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7471fb9-d4db-45fc-b8cc-34f80db54da3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:17.779277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7471fb9-d4db-45fc-b8cc-34f80db54da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:17.838040 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e7471fb9-d4db-45fc-b8cc-34f80db54da3 None None] MFA Rules not processed for user `e31558db83834034b7183223bbd0f84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:17.839274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e7471fb9-d4db-45fc-b8cc-34f80db54da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:17.950859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 837/1649] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:27:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:17.976941 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419abd0-ac0f-4108-8973-2cd1e2222cdb None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:17.996202 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419abd0-ac0f-4108-8973-2cd1e2222cdb None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:18.003299 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544360b1-56f3-41b1-84bd-8b182bf1b399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:18.005042 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544360b1-56f3-41b1-84bd-8b182bf1b399 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:18.005548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544360b1-56f3-41b1-84bd-8b182bf1b399 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:18.006081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544360b1-56f3-41b1-84bd-8b182bf1b399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:18.021040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544360b1-56f3-41b1-84bd-8b182bf1b399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:18.023244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544360b1-56f3-41b1-84bd-8b182bf1b399 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:18.034600 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 813/1650] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:18.800047 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7471fb9-d4db-45fc-b8cc-34f80db54da3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:18.997130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7471fb9-d4db-45fc-b8cc-34f80db54da3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:19.025220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee134bf-423f-49db-a0cd-872e99f3073c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4dc7b58c8a04b359a4a9bbab9e7b219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:19.026969 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee134bf-423f-49db-a0cd-872e99f3073c service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:19.035546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee134bf-423f-49db-a0cd-872e99f3073c service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:19.036044 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee134bf-423f-49db-a0cd-872e99f3073c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:19.043334 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6ee134bf-423f-49db-a0cd-872e99f3073c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:19.085633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee134bf-423f-49db-a0cd-872e99f3073c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:19.087582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee134bf-423f-49db-a0cd-872e99f3073c service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:19.099469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 838/1651] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:19.914927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544360b1-56f3-41b1-84bd-8b182bf1b399 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:20.145380 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544360b1-56f3-41b1-84bd-8b182bf1b399 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:20.153615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c4d6-0fcc-4fb8-9f5a-609fa672d813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:20.154559 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c4d6-0fcc-4fb8-9f5a-609fa672d813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:20.154898 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c4d6-0fcc-4fb8-9f5a-609fa672d813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:20.155178 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c4d6-0fcc-4fb8-9f5a-609fa672d813 admin admin] PATH_INFO: `/v3/users/02cf24a91fce4cbfb0e041818981fe2c` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:20.156683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53c4d6-0fcc-4fb8-9f5a-609fa672d813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02cf24a91fce4cbfb0e041818981fe2c)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:20.158733 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53c4d6-0fcc-4fb8-9f5a-609fa672d813 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:20.288868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9d53c4d6-0fcc-4fb8-9f5a-609fa672d813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02cf24a91fce4cbfb0e041818981fe2c'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:20.289643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9d53c4d6-0fcc-4fb8-9f5a-609fa672d813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02cf24a91fce4cbfb0e041818981fe2c'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:20.322866 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9d53c4d6-0fcc-4fb8-9f5a-609fa672d813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02cf24a91fce4cbfb0e041818981fe2c'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:20.344832 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9d53c4d6-0fcc-4fb8-9f5a-609fa672d813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02cf24a91fce4cbfb0e041818981fe2c'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:20.360448 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9d53c4d6-0fcc-4fb8-9f5a-609fa672d813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02cf24a91fce4cbfb0e041818981fe2c'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:20.388637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 814/1652] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:27:19 2022] DELETE /identity/v3/users/02cf24a91fce4cbfb0e041818981fe2c => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:20.393980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da16e5-68db-47eb-80f4-7e89215fbaeb None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:20.394592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da16e5-68db-47eb-80f4-7e89215fbaeb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:20.395470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da16e5-68db-47eb-80f4-7e89215fbaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:20.447175 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-64da16e5-68db-47eb-80f4-7e89215fbaeb None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:20.454147 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-64da16e5-68db-47eb-80f4-7e89215fbaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:20.637992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 839/1653] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:20.665708 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c4d6-0fcc-4fb8-9f5a-609fa672d813 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:20.667881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9d53c4d6-0fcc-4fb8-9f5a-609fa672d813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:20.863358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c4d6-0fcc-4fb8-9f5a-609fa672d813 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:20.868916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c817a3-a412-45e7-8609-7bac2c4b6812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:20.869754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c817a3-a412-45e7-8609-7bac2c4b6812 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:20.870043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c817a3-a412-45e7-8609-7bac2c4b6812 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:20.870636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c817a3-a412-45e7-8609-7bac2c4b6812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:20.901097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c817a3-a412-45e7-8609-7bac2c4b6812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:20.905007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c817a3-a412-45e7-8609-7bac2c4b6812 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:20.939842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 815/1654] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:22.718256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a2694-eea6-4906-8c18-be0b3be201cc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:22.718774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a2694-eea6-4906-8c18-be0b3be201cc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:22.718885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a2694-eea6-4906-8c18-be0b3be201cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:22.762991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2b1a2694-eea6-4906-8c18-be0b3be201cc None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:22.796488 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2b1a2694-eea6-4906-8c18-be0b3be201cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:22.922744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 840/1655] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:27:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:23.007346 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c817a3-a412-45e7-8609-7bac2c4b6812 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:23.007826 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-95c817a3-a412-45e7-8609-7bac2c4b6812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:23.031645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c817a3-a412-45e7-8609-7bac2c4b6812 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:23.045222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ee468-5600-440b-a877-eb0f2e174dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:23.046973 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ee468-5600-440b-a877-eb0f2e174dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:23.047436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ee468-5600-440b-a877-eb0f2e174dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:23.050013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ee468-5600-440b-a877-eb0f2e174dfa admin admin] PATH_INFO: `/v3/users/3b0856904b7c41728fe70049141eaf5f` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:23.053972 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ee468-5600-440b-a877-eb0f2e174dfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b0856904b7c41728fe70049141eaf5f)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:23.060438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ee468-5600-440b-a877-eb0f2e174dfa admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:23.159520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-8d4ee468-5600-440b-a877-eb0f2e174dfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b0856904b7c41728fe70049141eaf5f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:23.160691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-8d4ee468-5600-440b-a877-eb0f2e174dfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b0856904b7c41728fe70049141eaf5f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:23.201020 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-8d4ee468-5600-440b-a877-eb0f2e174dfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b0856904b7c41728fe70049141eaf5f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:23.209122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a2694-eea6-4906-8c18-be0b3be201cc None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:23.210665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2b1a2694-eea6-4906-8c18-be0b3be201cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:23.219527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-8d4ee468-5600-440b-a877-eb0f2e174dfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b0856904b7c41728fe70049141eaf5f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:23.243377 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-8d4ee468-5600-440b-a877-eb0f2e174dfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b0856904b7c41728fe70049141eaf5f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:23.252519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 816/1656] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:27:23 2022] DELETE /identity/v3/users/3b0856904b7c41728fe70049141eaf5f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:23.260093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953095c2-2593-4f59-a599-71ecf69302df None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:23.260350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953095c2-2593-4f59-a599-71ecf69302df None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:23.260631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953095c2-2593-4f59-a599-71ecf69302df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:23.304991 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-953095c2-2593-4f59-a599-71ecf69302df None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:23.306210 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-953095c2-2593-4f59-a599-71ecf69302df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:23.410574 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a2694-eea6-4906-8c18-be0b3be201cc None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:23.467959 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 817/1657] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:23.468938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953095c2-2593-4f59-a599-71ecf69302df None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:23.473730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-953095c2-2593-4f59-a599-71ecf69302df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:23.499514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953095c2-2593-4f59-a599-71ecf69302df None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:23.515937 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73f170-ea0e-4862-bf5a-9b1c52d3ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:23.516989 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73f170-ea0e-4862-bf5a-9b1c52d3ea28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:23.517279 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73f170-ea0e-4862-bf5a-9b1c52d3ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:23.517554 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73f170-ea0e-4862-bf5a-9b1c52d3ea28 admin admin] PATH_INFO: `/v3/users/0dc7c04ac6d94347ac1d4ce87b35737b` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:23.523122 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73f170-ea0e-4862-bf5a-9b1c52d3ea28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc7c04ac6d94347ac1d4ce87b35737b)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:23.532332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73f170-ea0e-4862-bf5a-9b1c52d3ea28 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:23.565509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178e355-eca8-4343-a4fb-a684f8e7ec2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:23.568848 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178e355-eca8-4343-a4fb-a684f8e7ec2e service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:23.570840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178e355-eca8-4343-a4fb-a684f8e7ec2e service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:23.573033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178e355-eca8-4343-a4fb-a684f8e7ec2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:23.586545 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8178e355-eca8-4343-a4fb-a684f8e7ec2e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:23.663868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2f73f170-ea0e-4862-bf5a-9b1c52d3ea28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc7c04ac6d94347ac1d4ce87b35737b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:23.666518 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2f73f170-ea0e-4862-bf5a-9b1c52d3ea28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc7c04ac6d94347ac1d4ce87b35737b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:23.719645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2f73f170-ea0e-4862-bf5a-9b1c52d3ea28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc7c04ac6d94347ac1d4ce87b35737b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:23.749930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2f73f170-ea0e-4862-bf5a-9b1c52d3ea28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc7c04ac6d94347ac1d4ce87b35737b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:23.777109 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2f73f170-ea0e-4862-bf5a-9b1c52d3ea28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc7c04ac6d94347ac1d4ce87b35737b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:23.791358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 818/1658] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:27:23 2022] DELETE /identity/v3/users/0dc7c04ac6d94347ac1d4ce87b35737b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:23.803182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73f170-ea0e-4862-bf5a-9b1c52d3ea28 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:23.808215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2f73f170-ea0e-4862-bf5a-9b1c52d3ea28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:23.849966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178e355-eca8-4343-a4fb-a684f8e7ec2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:23.853122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178e355-eca8-4343-a4fb-a684f8e7ec2e service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:23.863189 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 841/1659] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:27:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:27:23.865728 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df0846-bf83-48a5-98e4-5b72c8f41ae6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:23.867468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df0846-bf83-48a5-98e4-5b72c8f41ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:23.867960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df0846-bf83-48a5-98e4-5b72c8f41ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:23.891159 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-18df0846-bf83-48a5-98e4-5b72c8f41ae6 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:23.893048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-18df0846-bf83-48a5-98e4-5b72c8f41ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:23.980664 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 842/1660] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:23.981912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df0846-bf83-48a5-98e4-5b72c8f41ae6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:23.989397 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-18df0846-bf83-48a5-98e4-5b72c8f41ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:24.018919 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73f170-ea0e-4862-bf5a-9b1c52d3ea28 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:24.019586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df0846-bf83-48a5-98e4-5b72c8f41ae6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:24.035462 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921809a-2468-45c2-9f39-bfb10801bc83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:24.035907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:24.037584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:24.037688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921809a-2468-45c2-9f39-bfb10801bc83 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:24.037997 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921809a-2468-45c2-9f39-bfb10801bc83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:24.038275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921809a-2468-45c2-9f39-bfb10801bc83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:24.040813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:24.041491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] PATH_INFO: `/v3/projects/ef717363cd714bdc9ae9d3a620172ef6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:24.044419 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef717363cd714bdc9ae9d3a620172ef6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:24.049299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:24.052709 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0921809a-2468-45c2-9f39-bfb10801bc83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:24.097534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921809a-2468-45c2-9f39-bfb10801bc83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:24.099844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921809a-2468-45c2-9f39-bfb10801bc83 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:24.127463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 819/1661] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:24.130316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921809a-2468-45c2-9f39-bfb10801bc83 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:24.146884 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921809a-2468-45c2-9f39-bfb10801bc83 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:24.161039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef717363cd714bdc9ae9d3a620172ef6', 'request_id': 'req-195df190-5bf9-456b-b960-8e05339e0be2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:24.176868 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef717363cd714bdc9ae9d3a620172ef6', 'request_id': 'req-195df190-5bf9-456b-b960-8e05339e0be2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:24.189593 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef717363cd714bdc9ae9d3a620172ef6', 'request_id': 'req-195df190-5bf9-456b-b960-8e05339e0be2'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:24.216586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] The token cache is being invalidate because project ef717363cd714bdc9ae9d3a620172ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:27:24.216898 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:24.217560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:24.221727 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 843/1662] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:27:23 2022] DELETE /identity/v3/projects/ef717363cd714bdc9ae9d3a620172ef6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:24.226881 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:24.229175 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:24.291478 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bd02b-82b6-4f05-a51a-bd2fb34e0f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:24.294293 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd02b-82b6-4f05-a51a-bd2fb34e0f95 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:24.294611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd02b-82b6-4f05-a51a-bd2fb34e0f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:24.294854 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bd02b-82b6-4f05-a51a-bd2fb34e0f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:24.302000 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-984bd02b-82b6-4f05-a51a-bd2fb34e0f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:24.461811 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195df190-5bf9-456b-b960-8e05339e0be2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:24.487605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87e2c1-1b68-4467-a83c-30cecfcea396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:24.488438 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87e2c1-1b68-4467-a83c-30cecfcea396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:24.488727 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87e2c1-1b68-4467-a83c-30cecfcea396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:24.489027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87e2c1-1b68-4467-a83c-30cecfcea396 admin admin] PATH_INFO: `/v3/users/fefa7fb5cdf140e38bc5450a297e0c49` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:24.499805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87e2c1-1b68-4467-a83c-30cecfcea396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fefa7fb5cdf140e38bc5450a297e0c49)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:24.502239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: WARNING py.warnings [None req-dc87e2c1-1b68-4467-a83c-30cecfcea396 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 20:27:24.502239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: warnings.warn(msg) May 10 20:27:24.502239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: May 10 20:27:24.503507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87e2c1-1b68-4467-a83c-30cecfcea396 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:24.567536 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bd02b-82b6-4f05-a51a-bd2fb34e0f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:24.573417 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bd02b-82b6-4f05-a51a-bd2fb34e0f95 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:24.637712 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 820/1663] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:24.641499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dc87e2c1-1b68-4467-a83c-30cecfcea396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fefa7fb5cdf140e38bc5450a297e0c49'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:24.689905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dc87e2c1-1b68-4467-a83c-30cecfcea396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fefa7fb5cdf140e38bc5450a297e0c49'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:24.717920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dc87e2c1-1b68-4467-a83c-30cecfcea396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fefa7fb5cdf140e38bc5450a297e0c49'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:24.718837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dc87e2c1-1b68-4467-a83c-30cecfcea396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fefa7fb5cdf140e38bc5450a297e0c49'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:24.734648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dc87e2c1-1b68-4467-a83c-30cecfcea396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fefa7fb5cdf140e38bc5450a297e0c49'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:24.754305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 844/1664] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:27:24 2022] DELETE /identity/v3/users/fefa7fb5cdf140e38bc5450a297e0c49 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:27.994399 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bd02b-82b6-4f05-a51a-bd2fb34e0f95 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:28.021514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bd02b-82b6-4f05-a51a-bd2fb34e0f95 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:28.220142 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7a2c5-8734-4125-9e91-14d5527cf5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:28.220142 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7a2c5-8734-4125-9e91-14d5527cf5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:28.220337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7a2c5-8734-4125-9e91-14d5527cf5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:28.220479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7a2c5-8734-4125-9e91-14d5527cf5b1 admin admin] PATH_INFO: `/v3/projects/26497346d4ae465498dda3416ab74b94` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:28.229976 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7a2c5-8734-4125-9e91-14d5527cf5b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26497346d4ae465498dda3416ab74b94)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:28.231705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: WARNING py.warnings [None req-63b7a2c5-8734-4125-9e91-14d5527cf5b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 20:27:28.231705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: warnings.warn(msg) May 10 20:27:28.231705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: May 10 20:27:28.232933 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7a2c5-8734-4125-9e91-14d5527cf5b1 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:28.403031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-63b7a2c5-8734-4125-9e91-14d5527cf5b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26497346d4ae465498dda3416ab74b94', 'request_id': 'req-63b7a2c5-8734-4125-9e91-14d5527cf5b1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:28.427248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-63b7a2c5-8734-4125-9e91-14d5527cf5b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26497346d4ae465498dda3416ab74b94', 'request_id': 'req-63b7a2c5-8734-4125-9e91-14d5527cf5b1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:28.451040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-63b7a2c5-8734-4125-9e91-14d5527cf5b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26497346d4ae465498dda3416ab74b94', 'request_id': 'req-63b7a2c5-8734-4125-9e91-14d5527cf5b1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:28.482094 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-63b7a2c5-8734-4125-9e91-14d5527cf5b1 admin admin] The token cache is being invalidate because project 26497346d4ae465498dda3416ab74b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:27:28.482397 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-63b7a2c5-8734-4125-9e91-14d5527cf5b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:28.483224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-63b7a2c5-8734-4125-9e91-14d5527cf5b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:28.485903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 821/1665] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:27:27 2022] DELETE /identity/v3/projects/26497346d4ae465498dda3416ab74b94 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:28.490477 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124cc9c-e273-4184-b50d-742de33e5c53 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:28.491514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124cc9c-e273-4184-b50d-742de33e5c53 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:28.491839 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124cc9c-e273-4184-b50d-742de33e5c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:28.561600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7124cc9c-e273-4184-b50d-742de33e5c53 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:28.563592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7124cc9c-e273-4184-b50d-742de33e5c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:28.750047 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 845/1666] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:28.758271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b332a9-58f6-4532-8918-5fb0d546d042 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:28.759124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b332a9-58f6-4532-8918-5fb0d546d042 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:28.759769 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b332a9-58f6-4532-8918-5fb0d546d042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:28.821735 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-68b332a9-58f6-4532-8918-5fb0d546d042 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:28.823144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-68b332a9-58f6-4532-8918-5fb0d546d042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:28.861695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 822/1667] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:28.868632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124cc9c-e273-4184-b50d-742de33e5c53 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:28.880667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124cc9c-e273-4184-b50d-742de33e5c53 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:28.896874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccb5ec-93d2-490a-9f22-af1661e70b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:28.898127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccb5ec-93d2-490a-9f22-af1661e70b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:28.898547 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccb5ec-93d2-490a-9f22-af1661e70b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:28.898954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccb5ec-93d2-490a-9f22-af1661e70b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:28.899826 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccb5ec-93d2-490a-9f22-af1661e70b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:28.900277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccb5ec-93d2-490a-9f22-af1661e70b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:28.904032 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccb5ec-93d2-490a-9f22-af1661e70b3d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:28.949989 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b332a9-58f6-4532-8918-5fb0d546d042 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:28.965959 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b332a9-58f6-4532-8918-5fb0d546d042 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:28.966695 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 846/1668] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:27:29.000923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2df4ac-4ad4-4973-a5e4-10429c20c03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:29.001757 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2df4ac-4ad4-4973-a5e4-10429c20c03e admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:29.002045 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2df4ac-4ad4-4973-a5e4-10429c20c03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:29.002327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2df4ac-4ad4-4973-a5e4-10429c20c03e admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:29.008217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2df4ac-4ad4-4973-a5e4-10429c20c03e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:29.010559 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2df4ac-4ad4-4973-a5e4-10429c20c03e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:29.129133 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 823/1669] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:28 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:27:29.133531 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccb5ec-93d2-490a-9f22-af1661e70b3d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:29.147831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccb5ec-93d2-490a-9f22-af1661e70b3d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:29.262388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2df4ac-4ad4-4973-a5e4-10429c20c03e admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:29.264103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-eb2df4ac-4ad4-4973-a5e4-10429c20c03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:29.346938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd23f1-bbe5-4c8e-89dc-ea705910c576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:29.347644 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd23f1-bbe5-4c8e-89dc-ea705910c576 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:29.348134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd23f1-bbe5-4c8e-89dc-ea705910c576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:29.348420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd23f1-bbe5-4c8e-89dc-ea705910c576 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:29.349326 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd23f1-bbe5-4c8e-89dc-ea705910c576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:29.355625 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd23f1-bbe5-4c8e-89dc-ea705910c576 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:29.408651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 847/1670] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:29 2022] POST /identity/v3/users => generated 283 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:27:29.412297 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd23f1-bbe5-4c8e-89dc-ea705910c576 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:29.429057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd23f1-bbe5-4c8e-89dc-ea705910c576 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:29.439643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74634b26-9933-4826-93da-6557e9ac5dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:29.440593 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74634b26-9933-4826-93da-6557e9ac5dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:29.441127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74634b26-9933-4826-93da-6557e9ac5dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:29.441504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74634b26-9933-4826-93da-6557e9ac5dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:29.442512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74634b26-9933-4826-93da-6557e9ac5dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:29.452532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74634b26-9933-4826-93da-6557e9ac5dcf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:29.474922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 848/1671] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:29.479496 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74634b26-9933-4826-93da-6557e9ac5dcf admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:29.495654 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2df4ac-4ad4-4973-a5e4-10429c20c03e admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:29.509251 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:29.510275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:29.511596 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:29.515432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] PATH_INFO: `/v3/projects/e3da83e11e724b20bb63ca22111cfcc9` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:29.518830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3da83e11e724b20bb63ca22111cfcc9)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:29.521083 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:29.539108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74634b26-9933-4826-93da-6557e9ac5dcf admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:29.564821 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3e19b-c614-47af-8cae-e957029cbf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:29.568220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3e19b-c614-47af-8cae-e957029cbf81 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:29.569445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3e19b-c614-47af-8cae-e957029cbf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:29.571360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3e19b-c614-47af-8cae-e957029cbf81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:29.575543 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3e19b-c614-47af-8cae-e957029cbf81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:29.580988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3e19b-c614-47af-8cae-e957029cbf81 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:29.621119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 849/1672] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:29.623599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4c10-6069-4ad1-b05c-bd6932dd1cb8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:29.624048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4c10-6069-4ad1-b05c-bd6932dd1cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:29.624863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4c10-6069-4ad1-b05c-bd6932dd1cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:29.640812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3da83e11e724b20bb63ca22111cfcc9', 'request_id': 'req-f5241fff-d227-4c1c-910b-801aae2b8d43'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:29.660963 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3da83e11e724b20bb63ca22111cfcc9', 'request_id': 'req-f5241fff-d227-4c1c-910b-801aae2b8d43'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:29.671056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3da83e11e724b20bb63ca22111cfcc9', 'request_id': 'req-f5241fff-d227-4c1c-910b-801aae2b8d43'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:29.703097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] The token cache is being invalidate because project e3da83e11e724b20bb63ca22111cfcc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:27:29.703552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:29.705132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:29.709547 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 824/1673] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:27:29 2022] DELETE /identity/v3/projects/e3da83e11e724b20bb63ca22111cfcc9 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:27:29.714813 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:29.721785 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:29.734666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-83ca4c10-6069-4ad1-b05c-bd6932dd1cb8 None None] MFA Rules not processed for user `e092796100394b63a7304abae7e25f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:29.736197 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-83ca4c10-6069-4ad1-b05c-bd6932dd1cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:29.887999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5241fff-d227-4c1c-910b-801aae2b8d43 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:29.900503 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab31a0-829f-4d27-90d6-118a1595179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:29.901645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab31a0-829f-4d27-90d6-118a1595179c admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:29.902032 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab31a0-829f-4d27-90d6-118a1595179c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:29.902567 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab31a0-829f-4d27-90d6-118a1595179c admin admin] PATH_INFO: `/v3/projects/b4e3e05d6c1547499f7279e98b189778/users/465ff9b9bc334956a7601dfb4a4f4cc7/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:29.911755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 850/1674] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:29.913402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804672d-e8c7-4da4-a102-c2318064bb19 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:29.913840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804672d-e8c7-4da4-a102-c2318064bb19 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:29.914283 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804672d-e8c7-4da4-a102-c2318064bb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:29.932196 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab31a0-829f-4d27-90d6-118a1595179c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e3e05d6c1547499f7279e98b189778, user_id=465ff9b9bc334956a7601dfb4a4f4cc7, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:29.935038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab31a0-829f-4d27-90d6-118a1595179c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:29.963581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 825/1675] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:29 2022] PUT /identity/v3/projects/b4e3e05d6c1547499f7279e98b189778/users/465ff9b9bc334956a7601dfb4a4f4cc7/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:29.965293 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f9276-1d81-4c84-9a89-395b8313658a None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:29.967930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f9276-1d81-4c84-9a89-395b8313658a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:29.972619 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f804672d-e8c7-4da4-a102-c2318064bb19 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:29.973130 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f9276-1d81-4c84-9a89-395b8313658a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:29.974541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f804672d-e8c7-4da4-a102-c2318064bb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:30.023419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-2a1f9276-1d81-4c84-9a89-395b8313658a None None] MFA Rules not processed for user `e31558db83834034b7183223bbd0f84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:30.029309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2a1f9276-1d81-4c84-9a89-395b8313658a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:30.299910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 851/1676] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:30.300898 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804672d-e8c7-4da4-a102-c2318064bb19 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:30.307535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f804672d-e8c7-4da4-a102-c2318064bb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:30.470739 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 826/1677] 10.222.0.69 () {58 vars in 1015 bytes} [Tue May 10 20:27:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:30.472379 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a1223-69cf-438d-a661-7517f0f0cc93 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:30.472678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a1223-69cf-438d-a661-7517f0f0cc93 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:30.472962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a1223-69cf-438d-a661-7517f0f0cc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:30.579557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804672d-e8c7-4da4-a102-c2318064bb19 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:30.588557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-672a1223-69cf-438d-a661-7517f0f0cc93 None None] MFA Rules not processed for user `465ff9b9bc334956a7601dfb4a4f4cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:30.589983 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-672a1223-69cf-438d-a661-7517f0f0cc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:30.611173 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfe1b9-7ae0-4c5c-ac53-caed99fa98e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:30.614737 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfe1b9-7ae0-4c5c-ac53-caed99fa98e0 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:30.615479 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfe1b9-7ae0-4c5c-ac53-caed99fa98e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:30.615948 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfe1b9-7ae0-4c5c-ac53-caed99fa98e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:30.777332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfe1b9-7ae0-4c5c-ac53-caed99fa98e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:30.779177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfe1b9-7ae0-4c5c-ac53-caed99fa98e0 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:30.812348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 852/1678] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:30.813775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5b585-5fa2-46a4-8019-82f0023b0bfb None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:30.814063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5b585-5fa2-46a4-8019-82f0023b0bfb None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:30.817843 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5b585-5fa2-46a4-8019-82f0023b0bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:30.854416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 827/1679] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:30.858443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a1223-69cf-438d-a661-7517f0f0cc93 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:30.869106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c1a5b585-5fa2-46a4-8019-82f0023b0bfb None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:30.872027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a1223-69cf-438d-a661-7517f0f0cc93 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:30.873230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c1a5b585-5fa2-46a4-8019-82f0023b0bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:30.896453 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e02749-9025-4393-b553-55b460d7fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:30.898107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02749-9025-4393-b553-55b460d7fe6f admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:30.898639 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02749-9025-4393-b553-55b460d7fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:30.899022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02749-9025-4393-b553-55b460d7fe6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:30.903065 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e02749-9025-4393-b553-55b460d7fe6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:30.905782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e02749-9025-4393-b553-55b460d7fe6f admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:30.914913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 853/1680] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:30.917212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5b585-5fa2-46a4-8019-82f0023b0bfb None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:30.942312 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5b585-5fa2-46a4-8019-82f0023b0bfb None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:30.986990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df96dc4-b732-48eb-a62a-db0984ce1032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:30.987563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 828/1681] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:30 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:30.989043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df96dc4-b732-48eb-a62a-db0984ce1032 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:30.989422 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df96dc4-b732-48eb-a62a-db0984ce1032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:30.990094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df96dc4-b732-48eb-a62a-db0984ce1032 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:30.990273 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e02749-9025-4393-b553-55b460d7fe6f admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:30.990461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df96dc4-b732-48eb-a62a-db0984ce1032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:30.994091 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df96dc4-b732-48eb-a62a-db0984ce1032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:31.001890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df96dc4-b732-48eb-a62a-db0984ce1032 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:31.051043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 854/1682] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:27:31.054215 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df96dc4-b732-48eb-a62a-db0984ce1032 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:31.063897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2df96dc4-b732-48eb-a62a-db0984ce1032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:31.091208 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df96dc4-b732-48eb-a62a-db0984ce1032 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:31.217962 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:31.219153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:31.219687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:31.220154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] PATH_INFO: `/v3/projects/0df7bfa294d8474892d9384abea254ba` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:31.222416 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df7bfa294d8474892d9384abea254ba)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:31.225189 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:31.227309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e02749-9025-4393-b553-55b460d7fe6f admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:31.250712 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af667d-97b4-4021-94d1-043ddccea55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:31.251445 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af667d-97b4-4021-94d1-043ddccea55b admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:31.251731 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af667d-97b4-4021-94d1-043ddccea55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:31.252017 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af667d-97b4-4021-94d1-043ddccea55b admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:31.252754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af667d-97b4-4021-94d1-043ddccea55b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:31.254771 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af667d-97b4-4021-94d1-043ddccea55b admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:31.322366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 829/1683] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:30 2022] POST /identity/v3/users => generated 289 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:31.323244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af667d-97b4-4021-94d1-043ddccea55b admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:31.349828 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df7bfa294d8474892d9384abea254ba', 'request_id': 'req-2a6920fe-a353-4b6c-9267-73823009364d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:31.359694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af667d-97b4-4021-94d1-043ddccea55b admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:31.367204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df7bfa294d8474892d9384abea254ba', 'request_id': 'req-2a6920fe-a353-4b6c-9267-73823009364d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:31.394831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df7bfa294d8474892d9384abea254ba', 'request_id': 'req-2a6920fe-a353-4b6c-9267-73823009364d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:31.460037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] The token cache is being invalidate because project 0df7bfa294d8474892d9384abea254ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:27:31.461589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:31.464190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:31.473807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 855/1684] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:27:31 2022] DELETE /identity/v3/projects/0df7bfa294d8474892d9384abea254ba => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:31.478623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:31.484042 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:31.595084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dca41b-4acb-4683-ae51-5c050864adf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:31.596253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca41b-4acb-4683-ae51-5c050864adf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:31.596573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca41b-4acb-4683-ae51-5c050864adf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:31.596838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca41b-4acb-4683-ae51-5c050864adf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:31.597620 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dca41b-4acb-4683-ae51-5c050864adf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:31.613666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dca41b-4acb-4683-ae51-5c050864adf0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:31.696004 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 830/1685] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:31 2022] POST /identity/v3/projects => generated 405 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:31.698515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dca41b-4acb-4683-ae51-5c050864adf0 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:31.702569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e5dca41b-4acb-4683-ae51-5c050864adf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:31.703809 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6920fe-a353-4b6c-9267-73823009364d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:31.832368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dca41b-4acb-4683-ae51-5c050864adf0 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:31.838378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c48838-9ca8-444c-b05f-a840c3ad4c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:31.839363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48838-9ca8-444c-b05f-a840c3ad4c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:31.839799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48838-9ca8-444c-b05f-a840c3ad4c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:31.840219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c48838-9ca8-444c-b05f-a840c3ad4c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:31.841374 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c48838-9ca8-444c-b05f-a840c3ad4c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:31.843652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c48838-9ca8-444c-b05f-a840c3ad4c0d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:31.854262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16f3ea-f7a3-4503-8c7b-94471ad22e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:31.859058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16f3ea-f7a3-4503-8c7b-94471ad22e36 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:31.859058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16f3ea-f7a3-4503-8c7b-94471ad22e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:31.860061 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16f3ea-f7a3-4503-8c7b-94471ad22e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:31.860235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 831/1686] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:31.862035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5701a8-478c-41eb-ac2c-e17ae8d9036a None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:31.862471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5701a8-478c-41eb-ac2c-e17ae8d9036a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:31.862889 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5701a8-478c-41eb-ac2c-e17ae8d9036a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:31.865392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bb16f3ea-f7a3-4503-8c7b-94471ad22e36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:31.884840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-0d5701a8-478c-41eb-ac2c-e17ae8d9036a None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:31.886286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0d5701a8-478c-41eb-ac2c-e17ae8d9036a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:31.895794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 832/1687] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:31.896783 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5701a8-478c-41eb-ac2c-e17ae8d9036a None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:31.898544 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0d5701a8-478c-41eb-ac2c-e17ae8d9036a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:31.910932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16f3ea-f7a3-4503-8c7b-94471ad22e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:31.912950 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5701a8-478c-41eb-ac2c-e17ae8d9036a None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:31.917605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16f3ea-f7a3-4503-8c7b-94471ad22e36 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:31.920228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0b92d-e405-462d-97fe-1b2ba8146492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:31.921150 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b92d-e405-462d-97fe-1b2ba8146492 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:31.921590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b92d-e405-462d-97fe-1b2ba8146492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:31.922007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0b92d-e405-462d-97fe-1b2ba8146492 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:31.923046 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0b92d-e405-462d-97fe-1b2ba8146492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:31.925361 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0b92d-e405-462d-97fe-1b2ba8146492 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:31.954672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 856/1688] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:31.973364 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 833/1689] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:31 2022] POST /identity/v3/users => generated 303 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:31.974748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0b92d-e405-462d-97fe-1b2ba8146492 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:31.993855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823f7d6-4730-45aa-9b0e-4f89f3857e1f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:31.996711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0b92d-e405-462d-97fe-1b2ba8146492 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:31.998441 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823f7d6-4730-45aa-9b0e-4f89f3857e1f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:31.998774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823f7d6-4730-45aa-9b0e-4f89f3857e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:32.013316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067919d9-5e07-4eb3-800a-344f82dbbae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:32.018922 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067919d9-5e07-4eb3-800a-344f82dbbae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:32.019449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067919d9-5e07-4eb3-800a-344f82dbbae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:32.019882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067919d9-5e07-4eb3-800a-344f82dbbae3 admin admin] PATH_INFO: `/v3/projects/60e2f0df15744d76abe0ef5cc3793375/users/30cfef07c1eb45f8b89af61849a5af92/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:32.065685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067919d9-5e07-4eb3-800a-344f82dbbae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e2f0df15744d76abe0ef5cc3793375, user_id=30cfef07c1eb45f8b89af61849a5af92, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:32.068862 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067919d9-5e07-4eb3-800a-344f82dbbae3 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:32.099407 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 834/1690] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:31 2022] PUT /identity/v3/projects/60e2f0df15744d76abe0ef5cc3793375/users/30cfef07c1eb45f8b89af61849a5af92/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:32.101912 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba79787-ec77-4cb4-9d35-b07a9b850546 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:32.104560 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba79787-ec77-4cb4-9d35-b07a9b850546 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:32.107027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba79787-ec77-4cb4-9d35-b07a9b850546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:32.121251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b823f7d6-4730-45aa-9b0e-4f89f3857e1f None None] MFA Rules not processed for user `36c95ddbd4384bb3a63d02698684e29a`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:32.126247 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b823f7d6-4730-45aa-9b0e-4f89f3857e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:32.152333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-2ba79787-ec77-4cb4-9d35-b07a9b850546 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:32.155040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2ba79787-ec77-4cb4-9d35-b07a9b850546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:32.310466 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 835/1691] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:32.312240 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba79787-ec77-4cb4-9d35-b07a9b850546 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:32.344790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba79787-ec77-4cb4-9d35-b07a9b850546 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:32.370039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0106f67-f0ce-463b-989f-8bc171cad0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:32.373320 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0106f67-f0ce-463b-989f-8bc171cad0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:32.375398 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0106f67-f0ce-463b-989f-8bc171cad0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:32.377334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0106f67-f0ce-463b-989f-8bc171cad0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:32.379553 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0106f67-f0ce-463b-989f-8bc171cad0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:32.382626 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0106f67-f0ce-463b-989f-8bc171cad0c4 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:32.437694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 836/1692] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:32.439839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0106f67-f0ce-463b-989f-8bc171cad0c4 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:32.450765 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 857/1693] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:32.452474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb5e11-c708-4ed8-9ed3-ad64fa886295 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:32.455495 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb5e11-c708-4ed8-9ed3-ad64fa886295 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:32.455993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb5e11-c708-4ed8-9ed3-ad64fa886295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:32.490767 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0106f67-f0ce-463b-989f-8bc171cad0c4 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:32.503247 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10aa4d-cfca-41a2-ac6d-e08a87db08b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:32.504078 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10aa4d-cfca-41a2-ac6d-e08a87db08b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:32.505126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10aa4d-cfca-41a2-ac6d-e08a87db08b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:32.505537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10aa4d-cfca-41a2-ac6d-e08a87db08b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:32.508565 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10aa4d-cfca-41a2-ac6d-e08a87db08b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:32.513480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10aa4d-cfca-41a2-ac6d-e08a87db08b2 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:32.537616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 837/1694] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:32.542779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10aa4d-cfca-41a2-ac6d-e08a87db08b2 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:32.543855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-91fb5e11-c708-4ed8-9ed3-ad64fa886295 None None] MFA Rules not processed for user `df3cf8a2f7c54b80aac61d6ca59672b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:32.545351 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-91fb5e11-c708-4ed8-9ed3-ad64fa886295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:32.565808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10aa4d-cfca-41a2-ac6d-e08a87db08b2 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:32.575181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adda44-47f5-48ac-9b11-664e2b8e40e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:32.578325 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adda44-47f5-48ac-9b11-664e2b8e40e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:32.578763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adda44-47f5-48ac-9b11-664e2b8e40e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:32.579119 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adda44-47f5-48ac-9b11-664e2b8e40e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:32.581499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adda44-47f5-48ac-9b11-664e2b8e40e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:32.581970 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adda44-47f5-48ac-9b11-664e2b8e40e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:32.588744 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adda44-47f5-48ac-9b11-664e2b8e40e2 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:32.616363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 838/1695] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:27:32.617291 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adda44-47f5-48ac-9b11-664e2b8e40e2 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:32.635383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adda44-47f5-48ac-9b11-664e2b8e40e2 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:32.652557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00292f-e3fb-4702-980c-d5c50ab7610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:32.653464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00292f-e3fb-4702-980c-d5c50ab7610d admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:32.653850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00292f-e3fb-4702-980c-d5c50ab7610d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:32.654276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00292f-e3fb-4702-980c-d5c50ab7610d admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:32.655226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00292f-e3fb-4702-980c-d5c50ab7610d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:32.656964 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00292f-e3fb-4702-980c-d5c50ab7610d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:32.693381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 839/1696] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:32.695191 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00292f-e3fb-4702-980c-d5c50ab7610d admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:32.696894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ad00292f-e3fb-4702-980c-d5c50ab7610d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:32.721403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 858/1697] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:32.726872 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb5e11-c708-4ed8-9ed3-ad64fa886295 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:32.768224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb5e11-c708-4ed8-9ed3-ad64fa886295 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:32.789174 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887758c-4c22-476b-af14-e9416b9ffda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:32.807415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887758c-4c22-476b-af14-e9416b9ffda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:32.809086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887758c-4c22-476b-af14-e9416b9ffda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:32.814305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887758c-4c22-476b-af14-e9416b9ffda9 admin admin] PATH_INFO: `/v3/projects/60e2f0df15744d76abe0ef5cc3793375/users/30cfef07c1eb45f8b89af61849a5af92/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:32.820731 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887758c-4c22-476b-af14-e9416b9ffda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e2f0df15744d76abe0ef5cc3793375, user_id=30cfef07c1eb45f8b89af61849a5af92, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:32.824419 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887758c-4c22-476b-af14-e9416b9ffda9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:32.873836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 859/1698] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:32 2022] PUT /identity/v3/projects/60e2f0df15744d76abe0ef5cc3793375/users/30cfef07c1eb45f8b89af61849a5af92/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:32.875093 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887758c-4c22-476b-af14-e9416b9ffda9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:32.935003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00292f-e3fb-4702-980c-d5c50ab7610d admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:33.126211 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887758c-4c22-476b-af14-e9416b9ffda9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:33.156164 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4586fdd-13c6-445a-a818-37c1806833a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:33.159287 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586fdd-13c6-445a-a818-37c1806833a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:33.160781 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586fdd-13c6-445a-a818-37c1806833a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:33.161335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4586fdd-13c6-445a-a818-37c1806833a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:33.163933 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4586fdd-13c6-445a-a818-37c1806833a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:33.175862 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4586fdd-13c6-445a-a818-37c1806833a7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:33.187962 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de8d86-4d68-4d0e-817a-70a50ac4245b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:33.188530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de8d86-4d68-4d0e-817a-70a50ac4245b service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:33.188817 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de8d86-4d68-4d0e-817a-70a50ac4245b service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:33.189150 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de8d86-4d68-4d0e-817a-70a50ac4245b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:33.314364 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 860/1699] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:32 2022] POST /identity/v3/projects => generated 363 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:33.314865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4586fdd-13c6-445a-a818-37c1806833a7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:33.507643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4586fdd-13c6-445a-a818-37c1806833a7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:33.518077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372b9b-b67f-45a0-9656-c3a14987f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:33.519086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372b9b-b67f-45a0-9656-c3a14987f407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:33.519508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372b9b-b67f-45a0-9656-c3a14987f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:33.519885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372b9b-b67f-45a0-9656-c3a14987f407 admin admin] PATH_INFO: `/v3/projects/ff2504be00a6476a9635477849e12605/users/7c4a7ec45cc94d1aa16eb6b355967942/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:33.563552 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40372b9b-b67f-45a0-9656-c3a14987f407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff2504be00a6476a9635477849e12605, user_id=7c4a7ec45cc94d1aa16eb6b355967942, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:33.566514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40372b9b-b67f-45a0-9656-c3a14987f407 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:33.606477 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 861/1700] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:33 2022] PUT /identity/v3/projects/ff2504be00a6476a9635477849e12605/users/7c4a7ec45cc94d1aa16eb6b355967942/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:33.611217 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e487b-734f-4b7c-ae1c-3efa4e9604af None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:33.611828 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e487b-734f-4b7c-ae1c-3efa4e9604af None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:33.613959 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e487b-734f-4b7c-ae1c-3efa4e9604af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:33.659823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-475e487b-734f-4b7c-ae1c-3efa4e9604af None None] MFA Rules not processed for user `df3cf8a2f7c54b80aac61d6ca59672b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:33.661212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-475e487b-734f-4b7c-ae1c-3efa4e9604af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:33.797861 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de8d86-4d68-4d0e-817a-70a50ac4245b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:33.800436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de8d86-4d68-4d0e-817a-70a50ac4245b service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:33.814088 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 840/1701] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 1120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:33.815833 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bf272-df30-4af0-bc11-cbe0153d783d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:33.816265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bf272-df30-4af0-bc11-cbe0153d783d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:33.816711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bf272-df30-4af0-bc11-cbe0153d783d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:33.841746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 862/1702] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:33.844716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e487b-734f-4b7c-ae1c-3efa4e9604af None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:33.885097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b88bf272-df30-4af0-bc11-cbe0153d783d None None] MFA Rules not processed for user `30cfef07c1eb45f8b89af61849a5af92`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:33.910801 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b88bf272-df30-4af0-bc11-cbe0153d783d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:34.041832 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 841/1703] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:34.046140 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec5ac6-139a-464e-bafb-ff45cabe4a60 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:34.047936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec5ac6-139a-464e-bafb-ff45cabe4a60 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:34.050111 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec5ac6-139a-464e-bafb-ff45cabe4a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:34.100764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-8dec5ac6-139a-464e-bafb-ff45cabe4a60 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:34.104476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-8dec5ac6-139a-464e-bafb-ff45cabe4a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:34.153713 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e487b-734f-4b7c-ae1c-3efa4e9604af None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:34.174065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ba4ae-4fa7-4ae9-a524-4756df44ce8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:34.174785 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ba4ae-4fa7-4ae9-a524-4756df44ce8f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:34.175528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ba4ae-4fa7-4ae9-a524-4756df44ce8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:34.175528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ba4ae-4fa7-4ae9-a524-4756df44ce8f admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:34.182046 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ba4ae-4fa7-4ae9-a524-4756df44ce8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:34.196145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ba4ae-4fa7-4ae9-a524-4756df44ce8f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:34.259577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 842/1704] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:34.260667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec5ac6-139a-464e-bafb-ff45cabe4a60 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:34.265286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-8dec5ac6-139a-464e-bafb-ff45cabe4a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:34.277923 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 863/1705] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:33 2022] POST /identity/v3/users => generated 282 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:34.277923 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ba4ae-4fa7-4ae9-a524-4756df44ce8f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:34.289721 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0d0ba4ae-4fa7-4ae9-a524-4756df44ce8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:34.485288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ba4ae-4fa7-4ae9-a524-4756df44ce8f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:34.498940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed747cc7-77df-47b6-81a9-ac22f1cb01f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:34.499564 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747cc7-77df-47b6-81a9-ac22f1cb01f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:34.499830 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747cc7-77df-47b6-81a9-ac22f1cb01f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:34.500226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747cc7-77df-47b6-81a9-ac22f1cb01f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:34.520438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec5ac6-139a-464e-bafb-ff45cabe4a60 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:34.528415 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66864f-0629-4f2e-ae0e-4b7d3ac73d4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:34.528587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66864f-0629-4f2e-ae0e-4b7d3ac73d4c service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:34.528853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66864f-0629-4f2e-ae0e-4b7d3ac73d4c service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:34.529158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66864f-0629-4f2e-ae0e-4b7d3ac73d4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:34.533220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed747cc7-77df-47b6-81a9-ac22f1cb01f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:34.534687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed747cc7-77df-47b6-81a9-ac22f1cb01f0 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:34.546264 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66864f-0629-4f2e-ae0e-4b7d3ac73d4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:34.547878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66864f-0629-4f2e-ae0e-4b7d3ac73d4c service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:34.581418 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 843/1706] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:34.582665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66864f-0629-4f2e-ae0e-4b7d3ac73d4c service nova] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:34.617319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66864f-0629-4f2e-ae0e-4b7d3ac73d4c service nova] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:34.623011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 864/1707] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:34.624035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed747cc7-77df-47b6-81a9-ac22f1cb01f0 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:34.637914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ed747cc7-77df-47b6-81a9-ac22f1cb01f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:34.639073 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83565b11-3ef1-4a46-bb0a-fda1e8e60d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:34.639932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83565b11-3ef1-4a46-bb0a-fda1e8e60d23 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:34.640365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83565b11-3ef1-4a46-bb0a-fda1e8e60d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:34.640778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83565b11-3ef1-4a46-bb0a-fda1e8e60d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:34.641693 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83565b11-3ef1-4a46-bb0a-fda1e8e60d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:34.643435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83565b11-3ef1-4a46-bb0a-fda1e8e60d23 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:34.668924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 844/1708] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:34.672570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83565b11-3ef1-4a46-bb0a-fda1e8e60d23 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:34.691611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83565b11-3ef1-4a46-bb0a-fda1e8e60d23 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:34.710895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabe5a4-fac1-4fc5-9418-aae79e781743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:34.711883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabe5a4-fac1-4fc5-9418-aae79e781743 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:34.712337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabe5a4-fac1-4fc5-9418-aae79e781743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:34.712751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabe5a4-fac1-4fc5-9418-aae79e781743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:34.713714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabe5a4-fac1-4fc5-9418-aae79e781743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:34.715546 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabe5a4-fac1-4fc5-9418-aae79e781743 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:34.768666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 845/1709] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:27:34.773245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabe5a4-fac1-4fc5-9418-aae79e781743 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:34.801374 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabe5a4-fac1-4fc5-9418-aae79e781743 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:34.808617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b7741-6238-453f-b341-ac79e4206fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:34.810455 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b7741-6238-453f-b341-ac79e4206fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:34.810879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b7741-6238-453f-b341-ac79e4206fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:34.811502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b7741-6238-453f-b341-ac79e4206fbc admin admin] PATH_INFO: `/v3/projects/6ae7bbcfd62c40bcb48946fc4269817e/users/ed19089ca04b48cf9ec7f0e23d0f1cb7/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:34.822447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed747cc7-77df-47b6-81a9-ac22f1cb01f0 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:34.832490 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b7741-6238-453f-b341-ac79e4206fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae7bbcfd62c40bcb48946fc4269817e, user_id=ed19089ca04b48cf9ec7f0e23d0f1cb7, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:34.837019 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b7741-6238-453f-b341-ac79e4206fbc admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:34.837526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f49a6-c3ec-4454-9eab-38312653b327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:34.838611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f49a6-c3ec-4454-9eab-38312653b327 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:34.840239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f49a6-c3ec-4454-9eab-38312653b327 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:34.840588 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f49a6-c3ec-4454-9eab-38312653b327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:34.868752 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 846/1710] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:34 2022] PUT /identity/v3/projects/6ae7bbcfd62c40bcb48946fc4269817e/users/ed19089ca04b48cf9ec7f0e23d0f1cb7/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:34.876855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b7741-6238-453f-b341-ac79e4206fbc admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:34.882662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f49a6-c3ec-4454-9eab-38312653b327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:34.884156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f49a6-c3ec-4454-9eab-38312653b327 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:34.908672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 865/1711] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:34.910041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712a0d5-7145-43cb-b9fa-f36c748adf2c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:34.910349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712a0d5-7145-43cb-b9fa-f36c748adf2c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:34.910589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712a0d5-7145-43cb-b9fa-f36c748adf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:34.976715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f712a0d5-7145-43cb-b9fa-f36c748adf2c None None] MFA Rules not processed for user `ed19089ca04b48cf9ec7f0e23d0f1cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:34.978800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f712a0d5-7145-43cb-b9fa-f36c748adf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:35.006540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b7741-6238-453f-b341-ac79e4206fbc admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:35.015410 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44a910-9a79-40fc-ade1-65bc615191a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:35.016081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44a910-9a79-40fc-ade1-65bc615191a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:35.017211 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44a910-9a79-40fc-ade1-65bc615191a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:35.017507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b44a910-9a79-40fc-ade1-65bc615191a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:35.022450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6b44a910-9a79-40fc-ade1-65bc615191a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:35.122633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 866/1712] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:35.127178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712a0d5-7145-43cb-b9fa-f36c748adf2c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:35.182151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44a910-9a79-40fc-ade1-65bc615191a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:35.185325 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b44a910-9a79-40fc-ade1-65bc615191a1 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:35.210154 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 847/1713] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:35.368378 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712a0d5-7145-43cb-b9fa-f36c748adf2c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:35.392458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9550b2c-12e8-4d39-978c-ee2e0e691528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:35.393178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9550b2c-12e8-4d39-978c-ee2e0e691528 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:35.393467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9550b2c-12e8-4d39-978c-ee2e0e691528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:35.393755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9550b2c-12e8-4d39-978c-ee2e0e691528 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:35.402618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9550b2c-12e8-4d39-978c-ee2e0e691528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:35.408995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9550b2c-12e8-4d39-978c-ee2e0e691528 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:35.497723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 867/1714] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:35 2022] POST /identity/v3/projects => generated 363 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:35.499051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44a910-9a79-40fc-ade1-65bc615191a1 service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:35.518707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b44a910-9a79-40fc-ade1-65bc615191a1 service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:35.748966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af8808-f595-4b62-be21-a46b59f21e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:35.749752 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af8808-f595-4b62-be21-a46b59f21e5f admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:35.750085 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af8808-f595-4b62-be21-a46b59f21e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:35.750365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af8808-f595-4b62-be21-a46b59f21e5f admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:35.751142 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af8808-f595-4b62-be21-a46b59f21e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:35.753124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af8808-f595-4b62-be21-a46b59f21e5f admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:35.840688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 848/1715] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:35 2022] POST /identity/v3/users => generated 288 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:35.845303 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9550b2c-12e8-4d39-978c-ee2e0e691528 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:35.862540 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9550b2c-12e8-4d39-978c-ee2e0e691528 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:35.878651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfce83-29e9-4332-b0db-032873542ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:35.884643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfce83-29e9-4332-b0db-032873542ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:35.885305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfce83-29e9-4332-b0db-032873542ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:35.885305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfce83-29e9-4332-b0db-032873542ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:35.886063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfce83-29e9-4332-b0db-032873542ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:35.887774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbfce83-29e9-4332-b0db-032873542ecc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:35.945790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af8808-f595-4b62-be21-a46b59f21e5f admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:35.954858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 868/1716] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:35.960016 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af8808-f595-4b62-be21-a46b59f21e5f admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:35.985265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edd3c1-156e-4e6a-b6ae-4324f9fc7f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:35.987184 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edd3c1-156e-4e6a-b6ae-4324f9fc7f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:35.987689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edd3c1-156e-4e6a-b6ae-4324f9fc7f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:35.988174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edd3c1-156e-4e6a-b6ae-4324f9fc7f4c admin admin] PATH_INFO: `/v3/projects/810ea1de49ea460eac7c9e9061f70275/users/8d36b540d7da49159f75591654226f21/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:36.059345 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edd3c1-156e-4e6a-b6ae-4324f9fc7f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=810ea1de49ea460eac7c9e9061f70275, user_id=8d36b540d7da49159f75591654226f21, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:36.062703 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edd3c1-156e-4e6a-b6ae-4324f9fc7f4c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:36.141088 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 849/1717] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:35 2022] PUT /identity/v3/projects/810ea1de49ea460eac7c9e9061f70275/users/8d36b540d7da49159f75591654226f21/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:36.145567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfce83-29e9-4332-b0db-032873542ecc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:36.158725 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfce83-29e9-4332-b0db-032873542ecc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:36.292462 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3738b-5584-4963-9c25-f0b80d959fcf None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:36.292759 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3738b-5584-4963-9c25-f0b80d959fcf None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:36.293089 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3738b-5584-4963-9c25-f0b80d959fcf None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:36.295153 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 850/1718] 10.222.0.61 () {54 vars in 912 bytes} [Tue May 10 20:27:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:27:36.314816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b932b88-dd9a-4a95-9b38-54994c8ecc08 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:36.315477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b932b88-dd9a-4a95-9b38-54994c8ecc08 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:36.315926 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b932b88-dd9a-4a95-9b38-54994c8ecc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:36.351464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-8b932b88-dd9a-4a95-9b38-54994c8ecc08 None None] MFA Rules not processed for user `e31558db83834034b7183223bbd0f84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:36.355994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-8b932b88-dd9a-4a95-9b38-54994c8ecc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:36.388390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1640f-f51f-45cb-84fc-239792320a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:36.389358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1640f-f51f-45cb-84fc-239792320a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:36.391273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1640f-f51f-45cb-84fc-239792320a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:36.392740 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1640f-f51f-45cb-84fc-239792320a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:36.399216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1640f-f51f-45cb-84fc-239792320a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:36.402180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1640f-f51f-45cb-84fc-239792320a55 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:36.432218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 869/1719] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:36.437716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00098378-9cc6-4548-b642-c78f989f4ba6 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:36.440110 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00098378-9cc6-4548-b642-c78f989f4ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:36.440552 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00098378-9cc6-4548-b642-c78f989f4ba6 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:36.444400 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 870/1720] 10.222.0.61 () {54 vars in 921 bytes} [Tue May 10 20:27:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:27:36.446905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00098378-9cc6-4548-b642-c78f989f4ba6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:36.470238 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00098378-9cc6-4548-b642-c78f989f4ba6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:36.477054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 851/1721] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:27:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:27:36.482333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3c437-ceb0-4b64-888a-d4e927d9be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:36.483238 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3c437-ceb0-4b64-888a-d4e927d9be1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:36.483732 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3c437-ceb0-4b64-888a-d4e927d9be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:36.484080 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3c437-ceb0-4b64-888a-d4e927d9be1d admin admin] PATH_INFO: `/v3/projects/810ea1de49ea460eac7c9e9061f70275/users/8d36b540d7da49159f75591654226f21/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:36.513713 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3c437-ceb0-4b64-888a-d4e927d9be1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=810ea1de49ea460eac7c9e9061f70275, user_id=8d36b540d7da49159f75591654226f21, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:36.515644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b932b88-dd9a-4a95-9b38-54994c8ecc08 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:36.522643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d3c437-ceb0-4b64-888a-d4e927d9be1d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:36.534162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b932b88-dd9a-4a95-9b38-54994c8ecc08 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:36.539911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4cd58-95c5-4e35-92f0-7bc861f5141e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:36.551159 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4cd58-95c5-4e35-92f0-7bc861f5141e service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:36.554193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4cd58-95c5-4e35-92f0-7bc861f5141e service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:36.554433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4cd58-95c5-4e35-92f0-7bc861f5141e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:36.573453 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 871/1722] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:36 2022] PUT /identity/v3/projects/810ea1de49ea460eac7c9e9061f70275/users/8d36b540d7da49159f75591654226f21/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:36.582904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b15529-efae-405e-990b-13b925384716 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:36.583128 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b15529-efae-405e-990b-13b925384716 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:36.583435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b15529-efae-405e-990b-13b925384716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:36.585785 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4cd58-95c5-4e35-92f0-7bc861f5141e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:36.587509 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4cd58-95c5-4e35-92f0-7bc861f5141e service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:36.618176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 852/1723] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:27:36.641749 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e60b11-3f5a-4e80-9f4c-1e33b45c3056 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:36.645318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e60b11-3f5a-4e80-9f4c-1e33b45c3056 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:36.647396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e60b11-3f5a-4e80-9f4c-1e33b45c3056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:36.675667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-79b15529-efae-405e-990b-13b925384716 None None] MFA Rules not processed for user `8c3c6fe7e21c4c1ebc01cf91c3c05c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:36.684494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-79b15529-efae-405e-990b-13b925384716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:36.768505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-d3e60b11-3f5a-4e80-9f4c-1e33b45c3056 None None] MFA Rules not processed for user `8d36b540d7da49159f75591654226f21`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:36.773640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d3e60b11-3f5a-4e80-9f4c-1e33b45c3056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:36.944668 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 872/1724] 10.222.0.61 () {58 vars in 1018 bytes} [Tue May 10 20:27:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:36.948440 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 853/1725] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:36 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:36.955134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b15529-efae-405e-990b-13b925384716 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:37.062812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e60b11-3f5a-4e80-9f4c-1e33b45c3056 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:37.088162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e60b11-3f5a-4e80-9f4c-1e33b45c3056 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:37.111424 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dbf14-c68a-4d84-9674-5e9fcf3950c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:37.115609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dbf14-c68a-4d84-9674-5e9fcf3950c5 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:37.117092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dbf14-c68a-4d84-9674-5e9fcf3950c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:37.118604 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dbf14-c68a-4d84-9674-5e9fcf3950c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:37.135836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b15529-efae-405e-990b-13b925384716 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:37.156164 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc827a-b13d-4034-98e9-f6e983310d8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:37.157336 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675dbf14-c68a-4d84-9674-5e9fcf3950c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:37.158113 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc827a-b13d-4034-98e9-f6e983310d8e service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:37.159835 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675dbf14-c68a-4d84-9674-5e9fcf3950c5 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:37.160218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc827a-b13d-4034-98e9-f6e983310d8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:37.160597 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc827a-b13d-4034-98e9-f6e983310d8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:37.193351 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc827a-b13d-4034-98e9-f6e983310d8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:37.196652 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc827a-b13d-4034-98e9-f6e983310d8e service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:37.200623 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 854/1726] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:37.226600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 873/1727] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:37.562888 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597ae17-716c-4799-a9b0-048c96867fd9 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:37.563290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597ae17-716c-4799-a9b0-048c96867fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:37.563702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597ae17-716c-4799-a9b0-048c96867fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:37.627152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6597ae17-716c-4799-a9b0-048c96867fd9 None None] MFA Rules not processed for user `e092796100394b63a7304abae7e25f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:37.636027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6597ae17-716c-4799-a9b0-048c96867fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:37.829479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 855/1728] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:38.541260 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc827a-b13d-4034-98e9-f6e983310d8e service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:38.675022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc827a-b13d-4034-98e9-f6e983310d8e service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:38.684270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bcba0-4fca-4f3d-a915-fbf2ddc2a6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:38.685433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bcba0-4fca-4f3d-a915-fbf2ddc2a6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:38.685912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bcba0-4fca-4f3d-a915-fbf2ddc2a6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:38.686297 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bcba0-4fca-4f3d-a915-fbf2ddc2a6db admin admin] PATH_INFO: `/v3/users/ed19089ca04b48cf9ec7f0e23d0f1cb7` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:38.687716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bcba0-4fca-4f3d-a915-fbf2ddc2a6db admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed19089ca04b48cf9ec7f0e23d0f1cb7)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:38.689832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bcba0-4fca-4f3d-a915-fbf2ddc2a6db admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:38.831105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1b6bcba0-4fca-4f3d-a915-fbf2ddc2a6db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed19089ca04b48cf9ec7f0e23d0f1cb7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:38.863706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1b6bcba0-4fca-4f3d-a915-fbf2ddc2a6db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed19089ca04b48cf9ec7f0e23d0f1cb7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:38.884944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1b6bcba0-4fca-4f3d-a915-fbf2ddc2a6db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed19089ca04b48cf9ec7f0e23d0f1cb7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:38.885753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1b6bcba0-4fca-4f3d-a915-fbf2ddc2a6db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed19089ca04b48cf9ec7f0e23d0f1cb7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:38.902559 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1b6bcba0-4fca-4f3d-a915-fbf2ddc2a6db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed19089ca04b48cf9ec7f0e23d0f1cb7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:38.917352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 874/1729] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:27:38 2022] DELETE /identity/v3/users/ed19089ca04b48cf9ec7f0e23d0f1cb7 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:38.922984 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc605efc-8575-4a54-95a0-a41a4cf46aa3 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:38.924600 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc605efc-8575-4a54-95a0-a41a4cf46aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:38.925576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc605efc-8575-4a54-95a0-a41a4cf46aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:38.982215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-dc605efc-8575-4a54-95a0-a41a4cf46aa3 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:38.985820 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-dc605efc-8575-4a54-95a0-a41a4cf46aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:39.004441 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8d11d-581a-4016-801c-a74cf5bd7e27 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:39.004734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8d11d-581a-4016-801c-a74cf5bd7e27 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:39.005084 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8d11d-581a-4016-801c-a74cf5bd7e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:39.050663 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e2c8d11d-581a-4016-801c-a74cf5bd7e27 None None] MFA Rules not processed for user `7c4a7ec45cc94d1aa16eb6b355967942`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:39.051731 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e2c8d11d-581a-4016-801c-a74cf5bd7e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:39.223439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 856/1730] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:39.240239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 875/1731] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:39.240239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8d11d-581a-4016-801c-a74cf5bd7e27 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:39.240239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e2c8d11d-581a-4016-801c-a74cf5bd7e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:39.258141 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b54a-101f-4d9a-97ac-252f72d6c43e None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:39.258438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b54a-101f-4d9a-97ac-252f72d6c43e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:39.263577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b54a-101f-4d9a-97ac-252f72d6c43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:39.341086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-caf3b54a-101f-4d9a-97ac-252f72d6c43e None None] MFA Rules not processed for user `df3cf8a2f7c54b80aac61d6ca59672b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:39.355024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-caf3b54a-101f-4d9a-97ac-252f72d6c43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:39.438586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8d11d-581a-4016-801c-a74cf5bd7e27 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:39.456493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e7bbb-8753-4b37-a9ca-ebceb101cd26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:39.460767 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e7bbb-8753-4b37-a9ca-ebceb101cd26 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:39.465656 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e7bbb-8753-4b37-a9ca-ebceb101cd26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:39.466369 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e7bbb-8753-4b37-a9ca-ebceb101cd26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:39.502794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e7bbb-8753-4b37-a9ca-ebceb101cd26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:39.511417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e7bbb-8753-4b37-a9ca-ebceb101cd26 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:39.550388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 876/1732] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:39.557570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e7bbb-8753-4b37-a9ca-ebceb101cd26 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:39.559684 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 857/1733] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:39.561302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d91e7bbb-8753-4b37-a9ca-ebceb101cd26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:39.588806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e7bbb-8753-4b37-a9ca-ebceb101cd26 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:39.609210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71948cae-2a94-4e70-a868-90d6e35a60b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:39.610824 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71948cae-2a94-4e70-a868-90d6e35a60b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:39.610824 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71948cae-2a94-4e70-a868-90d6e35a60b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:39.610824 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71948cae-2a94-4e70-a868-90d6e35a60b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:39.611301 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71948cae-2a94-4e70-a868-90d6e35a60b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:39.613259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71948cae-2a94-4e70-a868-90d6e35a60b0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:39.694983 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3b54a-101f-4d9a-97ac-252f72d6c43e None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:39.696497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 877/1734] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:39 2022] POST /identity/v3/projects => generated 405 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:39.709678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3b54a-101f-4d9a-97ac-252f72d6c43e None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:39.836506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73302b68-a640-4d7f-b855-72451229bedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:39.837549 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73302b68-a640-4d7f-b855-72451229bedf admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:39.837837 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73302b68-a640-4d7f-b855-72451229bedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:39.838115 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73302b68-a640-4d7f-b855-72451229bedf admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:39.839128 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73302b68-a640-4d7f-b855-72451229bedf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:39.842208 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73302b68-a640-4d7f-b855-72451229bedf admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:39.903565 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 858/1735] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:39 2022] POST /identity/v3/users => generated 309 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:27:39.907476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71948cae-2a94-4e70-a868-90d6e35a60b0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:39.921083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71948cae-2a94-4e70-a868-90d6e35a60b0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:39.939741 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a0961-6245-49fd-b082-360d41426d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:39.940448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a0961-6245-49fd-b082-360d41426d7a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:39.940731 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a0961-6245-49fd-b082-360d41426d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:39.941030 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a0961-6245-49fd-b082-360d41426d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:39.941790 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a0961-6245-49fd-b082-360d41426d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:39.943467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a0961-6245-49fd-b082-360d41426d7a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:40.006808 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 878/1736] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:40.011006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73302b68-a640-4d7f-b855-72451229bedf admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:40.027138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73302b68-a640-4d7f-b855-72451229bedf admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:40.044262 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d9923-d4cf-4b0c-a0ed-6ce9a6e48f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:40.048236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d9923-d4cf-4b0c-a0ed-6ce9a6e48f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:40.048828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d9923-d4cf-4b0c-a0ed-6ce9a6e48f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:40.050489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d9923-d4cf-4b0c-a0ed-6ce9a6e48f5c admin admin] PATH_INFO: `/v3/projects/decc40cefb2c48c79acb2dfd778445e2/users/c07164c890b6483aa5f647314c6d9558/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:40.091677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d9923-d4cf-4b0c-a0ed-6ce9a6e48f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=decc40cefb2c48c79acb2dfd778445e2, user_id=c07164c890b6483aa5f647314c6d9558, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:40.094993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d9923-d4cf-4b0c-a0ed-6ce9a6e48f5c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:40.115066 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 859/1737] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:40 2022] PUT /identity/v3/projects/decc40cefb2c48c79acb2dfd778445e2/users/c07164c890b6483aa5f647314c6d9558/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:27:40.119301 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a0961-6245-49fd-b082-360d41426d7a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:40.131136 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a0961-6245-49fd-b082-360d41426d7a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:40.276819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c63113-00ed-4e15-a48d-68fc8f9474d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:40.277482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c63113-00ed-4e15-a48d-68fc8f9474d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:40.277757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c63113-00ed-4e15-a48d-68fc8f9474d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:40.278277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c63113-00ed-4e15-a48d-68fc8f9474d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:40.280273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c63113-00ed-4e15-a48d-68fc8f9474d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:40.282286 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c63113-00ed-4e15-a48d-68fc8f9474d0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:40.296180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 879/1738] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:40.299956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d9923-d4cf-4b0c-a0ed-6ce9a6e48f5c admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:40.312083 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d9923-d4cf-4b0c-a0ed-6ce9a6e48f5c admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:40.329205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a66315-e2c5-4f51-9288-c81e3b1ca787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:40.330196 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a66315-e2c5-4f51-9288-c81e3b1ca787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:40.330486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a66315-e2c5-4f51-9288-c81e3b1ca787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:40.331331 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a66315-e2c5-4f51-9288-c81e3b1ca787 admin admin] PATH_INFO: `/v3/projects/decc40cefb2c48c79acb2dfd778445e2/users/c07164c890b6483aa5f647314c6d9558/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:40.333955 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a66315-e2c5-4f51-9288-c81e3b1ca787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=decc40cefb2c48c79acb2dfd778445e2, user_id=c07164c890b6483aa5f647314c6d9558, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:40.338731 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a66315-e2c5-4f51-9288-c81e3b1ca787 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:40.364556 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 860/1739] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:40 2022] PUT /identity/v3/projects/decc40cefb2c48c79acb2dfd778445e2/users/c07164c890b6483aa5f647314c6d9558/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:40.453013 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c63113-00ed-4e15-a48d-68fc8f9474d0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:40.456827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b3c63113-00ed-4e15-a48d-68fc8f9474d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:40.487648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c63113-00ed-4e15-a48d-68fc8f9474d0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:40.590240 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde4170-3084-43f3-91d9-55e7a6591d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:40.591891 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4170-3084-43f3-91d9-55e7a6591d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:40.592401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4170-3084-43f3-91d9-55e7a6591d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:40.593853 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4170-3084-43f3-91d9-55e7a6591d21 admin admin] PATH_INFO: `/v3/projects/6ae7bbcfd62c40bcb48946fc4269817e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:40.596692 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde4170-3084-43f3-91d9-55e7a6591d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae7bbcfd62c40bcb48946fc4269817e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:40.598804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde4170-3084-43f3-91d9-55e7a6591d21 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:40.674296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1cde4170-3084-43f3-91d9-55e7a6591d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae7bbcfd62c40bcb48946fc4269817e', 'request_id': 'req-1cde4170-3084-43f3-91d9-55e7a6591d21'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:40.685977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1cde4170-3084-43f3-91d9-55e7a6591d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae7bbcfd62c40bcb48946fc4269817e', 'request_id': 'req-1cde4170-3084-43f3-91d9-55e7a6591d21'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:40.697807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1cde4170-3084-43f3-91d9-55e7a6591d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae7bbcfd62c40bcb48946fc4269817e', 'request_id': 'req-1cde4170-3084-43f3-91d9-55e7a6591d21'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:40.719994 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1cde4170-3084-43f3-91d9-55e7a6591d21 admin admin] The token cache is being invalidate because project 6ae7bbcfd62c40bcb48946fc4269817e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:27:40.730000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1cde4170-3084-43f3-91d9-55e7a6591d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:40.730810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1cde4170-3084-43f3-91d9-55e7a6591d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:40.735433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 880/1740] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:27:40 2022] DELETE /identity/v3/projects/6ae7bbcfd62c40bcb48946fc4269817e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:40.736721 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a66315-e2c5-4f51-9288-c81e3b1ca787 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:40.739024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-41a66315-e2c5-4f51-9288-c81e3b1ca787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:40.758548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a66315-e2c5-4f51-9288-c81e3b1ca787 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:40.911161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a16e9-87b4-4893-b104-c09454ad026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:40.914732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a16e9-87b4-4893-b104-c09454ad026a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:40.915141 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a16e9-87b4-4893-b104-c09454ad026a admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:40.917488 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a16e9-87b4-4893-b104-c09454ad026a admin admin] PATH_INFO: `/v3/users/8d36b540d7da49159f75591654226f21` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:40.921584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a16e9-87b4-4893-b104-c09454ad026a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d36b540d7da49159f75591654226f21)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:40.928614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a16e9-87b4-4893-b104-c09454ad026a admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:41.049634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a65a16e9-87b4-4893-b104-c09454ad026a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d36b540d7da49159f75591654226f21'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:41.050533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a65a16e9-87b4-4893-b104-c09454ad026a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d36b540d7da49159f75591654226f21'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:41.074282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a65a16e9-87b4-4893-b104-c09454ad026a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d36b540d7da49159f75591654226f21'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:41.082091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a65a16e9-87b4-4893-b104-c09454ad026a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d36b540d7da49159f75591654226f21'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:41.091961 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a65a16e9-87b4-4893-b104-c09454ad026a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d36b540d7da49159f75591654226f21'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:41.103776 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 861/1741] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:27:40 2022] DELETE /identity/v3/users/8d36b540d7da49159f75591654226f21 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:41.657058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925e00b-4019-45f6-a32a-589218322d93 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:41.658458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925e00b-4019-45f6-a32a-589218322d93 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:41.659069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925e00b-4019-45f6-a32a-589218322d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:41.698069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b925e00b-4019-45f6-a32a-589218322d93 None None] MFA Rules not processed for user `36c95ddbd4384bb3a63d02698684e29a`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:41.706288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b925e00b-4019-45f6-a32a-589218322d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:41.751308 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e72fa-c747-4915-8ca9-a85b6462a81b None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:41.752054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e72fa-c747-4915-8ca9-a85b6462a81b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:41.752334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e72fa-c747-4915-8ca9-a85b6462a81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:41.825152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-320e72fa-c747-4915-8ca9-a85b6462a81b None None] MFA Rules not processed for user `c07164c890b6483aa5f647314c6d9558`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:41.826429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-320e72fa-c747-4915-8ca9-a85b6462a81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:41.839463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 881/1742] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:41.840496 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925e00b-4019-45f6-a32a-589218322d93 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:41.845168 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b925e00b-4019-45f6-a32a-589218322d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:42.014956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925e00b-4019-45f6-a32a-589218322d93 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:42.020424 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 862/1743] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:41 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:42.034966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5c176-95e9-4ef1-93d2-2a4d949e5195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:42.039486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5c176-95e9-4ef1-93d2-2a4d949e5195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:42.050692 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5c176-95e9-4ef1-93d2-2a4d949e5195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:42.051205 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5c176-95e9-4ef1-93d2-2a4d949e5195 admin admin] PATH_INFO: `/v3/projects/810ea1de49ea460eac7c9e9061f70275` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:42.062454 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5c176-95e9-4ef1-93d2-2a4d949e5195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=810ea1de49ea460eac7c9e9061f70275)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:42.064707 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5c176-95e9-4ef1-93d2-2a4d949e5195 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:42.163604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-02d5c176-95e9-4ef1-93d2-2a4d949e5195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '810ea1de49ea460eac7c9e9061f70275', 'request_id': 'req-02d5c176-95e9-4ef1-93d2-2a4d949e5195'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:42.178954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-02d5c176-95e9-4ef1-93d2-2a4d949e5195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '810ea1de49ea460eac7c9e9061f70275', 'request_id': 'req-02d5c176-95e9-4ef1-93d2-2a4d949e5195'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:42.192477 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-02d5c176-95e9-4ef1-93d2-2a4d949e5195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '810ea1de49ea460eac7c9e9061f70275', 'request_id': 'req-02d5c176-95e9-4ef1-93d2-2a4d949e5195'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:42.219170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-02d5c176-95e9-4ef1-93d2-2a4d949e5195 admin admin] The token cache is being invalidate because project 810ea1de49ea460eac7c9e9061f70275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:27:42.219431 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-02d5c176-95e9-4ef1-93d2-2a4d949e5195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:42.221365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-02d5c176-95e9-4ef1-93d2-2a4d949e5195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:42.223827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 882/1744] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:27:41 2022] DELETE /identity/v3/projects/810ea1de49ea460eac7c9e9061f70275 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:42.233476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8814645-a1b3-4b63-8b6c-d1fd731c7f46 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:42.235480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8814645-a1b3-4b63-8b6c-d1fd731c7f46 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:42.235963 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8814645-a1b3-4b63-8b6c-d1fd731c7f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:42.277114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-c8814645-a1b3-4b63-8b6c-d1fd731c7f46 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:42.281792 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c8814645-a1b3-4b63-8b6c-d1fd731c7f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:42.423905 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 863/1745] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:42.433712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef9673-3586-48b3-b9ba-c96079d50a5b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:42.434094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef9673-3586-48b3-b9ba-c96079d50a5b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:42.434442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef9673-3586-48b3-b9ba-c96079d50a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:42.467248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7fef9673-3586-48b3-b9ba-c96079d50a5b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:42.468565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7fef9673-3586-48b3-b9ba-c96079d50a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:42.487817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 883/1746] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:42.488717 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8814645-a1b3-4b63-8b6c-d1fd731c7f46 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:42.531882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8814645-a1b3-4b63-8b6c-d1fd731c7f46 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:42.542899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71f735-ed50-418a-8a21-1bad4f225c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:42.544116 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71f735-ed50-418a-8a21-1bad4f225c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:42.548452 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71f735-ed50-418a-8a21-1bad4f225c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:42.548949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71f735-ed50-418a-8a21-1bad4f225c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:42.552065 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71f735-ed50-418a-8a21-1bad4f225c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:42.553965 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71f735-ed50-418a-8a21-1bad4f225c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:42.558167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71f735-ed50-418a-8a21-1bad4f225c90 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:42.589096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 864/1747] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:27:42.590244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef9673-3586-48b3-b9ba-c96079d50a5b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:42.607319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef9673-3586-48b3-b9ba-c96079d50a5b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:42.629066 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1476d-e69a-4d4b-b080-208847bfce29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:42.629722 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1476d-e69a-4d4b-b080-208847bfce29 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:42.630003 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1476d-e69a-4d4b-b080-208847bfce29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:42.630298 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1476d-e69a-4d4b-b080-208847bfce29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:42.632679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1476d-e69a-4d4b-b080-208847bfce29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:42.634694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1476d-e69a-4d4b-b080-208847bfce29 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:42.719164 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 884/1748] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:42 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:27:42.723522 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71f735-ed50-418a-8a21-1bad4f225c90 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:42.743471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71f735-ed50-418a-8a21-1bad4f225c90 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:42.991486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea225ec9-1dbf-4611-b9df-67a42d7607c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:42.992429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea225ec9-1dbf-4611-b9df-67a42d7607c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:42.993005 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea225ec9-1dbf-4611-b9df-67a42d7607c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:42.993442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea225ec9-1dbf-4611-b9df-67a42d7607c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:42.994575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea225ec9-1dbf-4611-b9df-67a42d7607c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:42.998182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea225ec9-1dbf-4611-b9df-67a42d7607c5 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:43.064514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 865/1749] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:42 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:43.065331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1476d-e69a-4d4b-b080-208847bfce29 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:43.082532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1476d-e69a-4d4b-b080-208847bfce29 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:43.091169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564a59a-acfd-47f2-970c-6911cd785f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:43.092723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564a59a-acfd-47f2-970c-6911cd785f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:43.093413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564a59a-acfd-47f2-970c-6911cd785f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:43.093885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564a59a-acfd-47f2-970c-6911cd785f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:43.094796 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564a59a-acfd-47f2-970c-6911cd785f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:43.096837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564a59a-acfd-47f2-970c-6911cd785f24 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:43.137019 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 885/1750] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:27:43.141590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea225ec9-1dbf-4611-b9df-67a42d7607c5 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:43.155730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea225ec9-1dbf-4611-b9df-67a42d7607c5 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:43.168301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891f747-bd59-43c6-b7e6-20581f3b0a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:43.170916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891f747-bd59-43c6-b7e6-20581f3b0a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:43.171656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891f747-bd59-43c6-b7e6-20581f3b0a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:43.172080 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891f747-bd59-43c6-b7e6-20581f3b0a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:43.172988 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891f747-bd59-43c6-b7e6-20581f3b0a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:43.178327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891f747-bd59-43c6-b7e6-20581f3b0a27 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:43.211805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564a59a-acfd-47f2-970c-6911cd785f24 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:43.215107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 866/1751] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:43.234214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564a59a-acfd-47f2-970c-6911cd785f24 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:43.266490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e7424-d41d-4a6b-973a-08c9c8334295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:43.267418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7424-d41d-4a6b-973a-08c9c8334295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:43.267693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7424-d41d-4a6b-973a-08c9c8334295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:43.268103 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7424-d41d-4a6b-973a-08c9c8334295 admin admin] PATH_INFO: `/v3/projects/707c5c8dad034f45812b93e0186199b4/users/c7118056916b40e58ca1bd04ca8ca94c/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:43.315910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e7424-d41d-4a6b-973a-08c9c8334295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=707c5c8dad034f45812b93e0186199b4, user_id=c7118056916b40e58ca1bd04ca8ca94c, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:43.319168 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e7424-d41d-4a6b-973a-08c9c8334295 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:43.357343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 886/1752] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:43 2022] PUT /identity/v3/projects/707c5c8dad034f45812b93e0186199b4/users/c7118056916b40e58ca1bd04ca8ca94c/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:43.359153 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece6fb7-07de-4509-ad77-eb58fb725ff3 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:43.359654 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece6fb7-07de-4509-ad77-eb58fb725ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:43.360037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece6fb7-07de-4509-ad77-eb58fb725ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:43.435777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-aece6fb7-07de-4509-ad77-eb58fb725ff3 None None] MFA Rules not processed for user `c7118056916b40e58ca1bd04ca8ca94c`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:43.443904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-aece6fb7-07de-4509-ad77-eb58fb725ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:43.630596 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 867/1753] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:27:43.636113 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e7424-d41d-4a6b-973a-08c9c8334295 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:43.725483 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e7424-d41d-4a6b-973a-08c9c8334295 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:43.732284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9d78f-122b-4205-b29d-a9a6a92e94db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:43.745852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9d78f-122b-4205-b29d-a9a6a92e94db admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:43.749287 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9d78f-122b-4205-b29d-a9a6a92e94db admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:43.750703 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9d78f-122b-4205-b29d-a9a6a92e94db admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:43.754401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9d78f-122b-4205-b29d-a9a6a92e94db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:43.757730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9d78f-122b-4205-b29d-a9a6a92e94db admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:43.826708 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece6fb7-07de-4509-ad77-eb58fb725ff3 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:43.835795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 887/1754] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:43 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:43.843860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece6fb7-07de-4509-ad77-eb58fb725ff3 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:44.028929 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033b75c-49ca-476e-a94c-7519ef430b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:44.031419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033b75c-49ca-476e-a94c-7519ef430b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:44.032056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033b75c-49ca-476e-a94c-7519ef430b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:44.033356 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033b75c-49ca-476e-a94c-7519ef430b05 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:44.035698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033b75c-49ca-476e-a94c-7519ef430b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:44.038912 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033b75c-49ca-476e-a94c-7519ef430b05 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:44.109713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 868/1755] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:43 2022] POST /identity/v3/users => generated 299 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:44.113363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9d78f-122b-4205-b29d-a9a6a92e94db admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:44.145020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9d78f-122b-4205-b29d-a9a6a92e94db admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:44.165542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9fb2e-3c71-4c2f-b1a9-e139ccd0b8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:44.166888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9fb2e-3c71-4c2f-b1a9-e139ccd0b8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:44.167485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9fb2e-3c71-4c2f-b1a9-e139ccd0b8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:44.168058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9fb2e-3c71-4c2f-b1a9-e139ccd0b8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:44.178928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9fb2e-3c71-4c2f-b1a9-e139ccd0b8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:44.180683 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9fb2e-3c71-4c2f-b1a9-e139ccd0b8b3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:44.257120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033b75c-49ca-476e-a94c-7519ef430b05 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:44.266202 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 888/1756] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:44.279372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033b75c-49ca-476e-a94c-7519ef430b05 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:44.310064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92434624-cc94-412e-88a9-f2458a30f937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:44.310992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92434624-cc94-412e-88a9-f2458a30f937 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:44.311281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92434624-cc94-412e-88a9-f2458a30f937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:44.314369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92434624-cc94-412e-88a9-f2458a30f937 admin admin] PATH_INFO: `/v3/projects/34be9c3d3c6a468cb2f0a0a0e29fad58/users/a107d3602d7e48e5a0852d5798490d10/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:44.378550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92434624-cc94-412e-88a9-f2458a30f937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34be9c3d3c6a468cb2f0a0a0e29fad58, user_id=a107d3602d7e48e5a0852d5798490d10, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:44.381875 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92434624-cc94-412e-88a9-f2458a30f937 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:44.421773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 869/1757] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:44 2022] PUT /identity/v3/projects/34be9c3d3c6a468cb2f0a0a0e29fad58/users/a107d3602d7e48e5a0852d5798490d10/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:27:44.423923 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9fb2e-3c71-4c2f-b1a9-e139ccd0b8b3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:44.443419 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9fb2e-3c71-4c2f-b1a9-e139ccd0b8b3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:44.722896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9bfac-2945-490e-9e4a-3f31e95b8d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:44.723603 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9bfac-2945-490e-9e4a-3f31e95b8d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:44.723991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9bfac-2945-490e-9e4a-3f31e95b8d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:44.728903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9bfac-2945-490e-9e4a-3f31e95b8d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:44.733267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9bfac-2945-490e-9e4a-3f31e95b8d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:44.734985 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9bfac-2945-490e-9e4a-3f31e95b8d18 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:44.805506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 889/1758] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:44.805700 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92434624-cc94-412e-88a9-f2458a30f937 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:44.820524 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92434624-cc94-412e-88a9-f2458a30f937 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:44.840152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6cea0-9148-40a0-a2da-c36adfce88ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:44.841097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6cea0-9148-40a0-a2da-c36adfce88ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:44.841382 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6cea0-9148-40a0-a2da-c36adfce88ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:44.841654 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6cea0-9148-40a0-a2da-c36adfce88ca admin admin] PATH_INFO: `/v3/projects/34be9c3d3c6a468cb2f0a0a0e29fad58/users/a107d3602d7e48e5a0852d5798490d10/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:44.845186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6cea0-9148-40a0-a2da-c36adfce88ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=34be9c3d3c6a468cb2f0a0a0e29fad58, user_id=a107d3602d7e48e5a0852d5798490d10, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:44.852767 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6cea0-9148-40a0-a2da-c36adfce88ca admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:44.890156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 870/1759] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:44 2022] PUT /identity/v3/projects/34be9c3d3c6a468cb2f0a0a0e29fad58/users/a107d3602d7e48e5a0852d5798490d10/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:27:44.902368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296413a-6a2d-4ad5-98b9-c68ce5493975 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:44.903018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296413a-6a2d-4ad5-98b9-c68ce5493975 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:44.903580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296413a-6a2d-4ad5-98b9-c68ce5493975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:44.945538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d296413a-6a2d-4ad5-98b9-c68ce5493975 None None] MFA Rules not processed for user `a107d3602d7e48e5a0852d5798490d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:44.947033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d296413a-6a2d-4ad5-98b9-c68ce5493975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:45.139887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 890/1760] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:45.152775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6cea0-9148-40a0-a2da-c36adfce88ca admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:45.155110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-4ab6cea0-9148-40a0-a2da-c36adfce88ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:45.343375 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6cea0-9148-40a0-a2da-c36adfce88ca admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:45.349164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe7f55-1db7-49ef-bc84-61bc9cc366bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:45.350162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe7f55-1db7-49ef-bc84-61bc9cc366bc service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:45.350937 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe7f55-1db7-49ef-bc84-61bc9cc366bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:45.351391 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe7f55-1db7-49ef-bc84-61bc9cc366bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:45.364633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe7f55-1db7-49ef-bc84-61bc9cc366bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:45.370403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe7f55-1db7-49ef-bc84-61bc9cc366bc service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:45.385062 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 871/1761] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:45.468381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296413a-6a2d-4ad5-98b9-c68ce5493975 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:45.582782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296413a-6a2d-4ad5-98b9-c68ce5493975 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:45.588665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6bbd0-5b97-43bd-8cfe-81fccca6ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:45.589585 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6bbd0-5b97-43bd-8cfe-81fccca6ac0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:45.589925 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6bbd0-5b97-43bd-8cfe-81fccca6ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:45.590208 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6bbd0-5b97-43bd-8cfe-81fccca6ac0d admin admin] PATH_INFO: `/v3/users/c7118056916b40e58ca1bd04ca8ca94c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:45.591725 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6bbd0-5b97-43bd-8cfe-81fccca6ac0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7118056916b40e58ca1bd04ca8ca94c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:45.594168 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6bbd0-5b97-43bd-8cfe-81fccca6ac0d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:45.683693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-18d6bbd0-5b97-43bd-8cfe-81fccca6ac0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7118056916b40e58ca1bd04ca8ca94c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:45.700455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-18d6bbd0-5b97-43bd-8cfe-81fccca6ac0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7118056916b40e58ca1bd04ca8ca94c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:45.711453 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-18d6bbd0-5b97-43bd-8cfe-81fccca6ac0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7118056916b40e58ca1bd04ca8ca94c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:45.712607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-18d6bbd0-5b97-43bd-8cfe-81fccca6ac0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7118056916b40e58ca1bd04ca8ca94c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:45.725792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-18d6bbd0-5b97-43bd-8cfe-81fccca6ac0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7118056916b40e58ca1bd04ca8ca94c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:45.737661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 891/1762] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:27:45 2022] DELETE /identity/v3/users/c7118056916b40e58ca1bd04ca8ca94c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:45.742861 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2ad7-059f-49cc-8dae-6d500dc9cdf7 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:45.743518 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2ad7-059f-49cc-8dae-6d500dc9cdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:45.743518 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2ad7-059f-49cc-8dae-6d500dc9cdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:45.790608 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e94b2ad7-059f-49cc-8dae-6d500dc9cdf7 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:45.792606 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e94b2ad7-059f-49cc-8dae-6d500dc9cdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:45.909182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 872/1763] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:45.959999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6bbd0-5b97-43bd-8cfe-81fccca6ac0d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:45.961475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-18d6bbd0-5b97-43bd-8cfe-81fccca6ac0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:46.117385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6bbd0-5b97-43bd-8cfe-81fccca6ac0d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:46.123211 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c11f7-f7f7-4500-a6b0-9fb4027e6ada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:46.124143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c11f7-f7f7-4500-a6b0-9fb4027e6ada service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:46.124437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c11f7-f7f7-4500-a6b0-9fb4027e6ada service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:46.124715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c11f7-f7f7-4500-a6b0-9fb4027e6ada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:46.151045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c11f7-f7f7-4500-a6b0-9fb4027e6ada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:46.152625 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c11f7-f7f7-4500-a6b0-9fb4027e6ada service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:46.163211 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 892/1764] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:46.173531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7259c-a948-44cc-aa4f-3d286b736f6d None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:46.174030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7259c-a948-44cc-aa4f-3d286b736f6d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:46.174481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7259c-a948-44cc-aa4f-3d286b736f6d None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:46.175993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 873/1765] 10.222.0.61 () {54 vars in 921 bytes} [Tue May 10 20:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:27:46.188174 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2f9d8-f880-4307-b869-273dfa61bec4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:46.188813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2f9d8-f880-4307-b869-273dfa61bec4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:46.189127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2f9d8-f880-4307-b869-273dfa61bec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:46.217669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c1d2f9d8-f880-4307-b869-273dfa61bec4 None None] MFA Rules not processed for user `8c3c6fe7e21c4c1ebc01cf91c3c05c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:46.219293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c1d2f9d8-f880-4307-b869-273dfa61bec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:46.351884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 893/1766] 10.222.0.61 () {58 vars in 1018 bytes} [Tue May 10 20:27:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:46.385146 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7259c-a948-44cc-aa4f-3d286b736f6d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:46.388672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-dcd7259c-a948-44cc-aa4f-3d286b736f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:46.422889 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7259c-a948-44cc-aa4f-3d286b736f6d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:46.430081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99e5f6-aeff-49d3-a530-68b7e9db677b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:46.431332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99e5f6-aeff-49d3-a530-68b7e9db677b service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:46.431798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99e5f6-aeff-49d3-a530-68b7e9db677b service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:46.432221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99e5f6-aeff-49d3-a530-68b7e9db677b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:46.469188 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99e5f6-aeff-49d3-a530-68b7e9db677b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:46.471963 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99e5f6-aeff-49d3-a530-68b7e9db677b service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:46.486391 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 874/1767] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:47.390195 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2f9d8-f880-4307-b869-273dfa61bec4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:47.391940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c1d2f9d8-f880-4307-b869-273dfa61bec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:47.427298 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2f9d8-f880-4307-b869-273dfa61bec4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:47.433205 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423ebf2-488e-414d-8d96-0fa58e4cd0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:47.434196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ebf2-488e-414d-8d96-0fa58e4cd0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:47.434577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ebf2-488e-414d-8d96-0fa58e4cd0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:47.434946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423ebf2-488e-414d-8d96-0fa58e4cd0ae admin admin] PATH_INFO: `/v3/users/7c4a7ec45cc94d1aa16eb6b355967942` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:47.436723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423ebf2-488e-414d-8d96-0fa58e4cd0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c4a7ec45cc94d1aa16eb6b355967942)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:47.438778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423ebf2-488e-414d-8d96-0fa58e4cd0ae admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:47.529897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7423ebf2-488e-414d-8d96-0fa58e4cd0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4a7ec45cc94d1aa16eb6b355967942'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:47.555761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7423ebf2-488e-414d-8d96-0fa58e4cd0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4a7ec45cc94d1aa16eb6b355967942'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:47.571304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7423ebf2-488e-414d-8d96-0fa58e4cd0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4a7ec45cc94d1aa16eb6b355967942'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:47.573369 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7423ebf2-488e-414d-8d96-0fa58e4cd0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4a7ec45cc94d1aa16eb6b355967942'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:47.589539 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7423ebf2-488e-414d-8d96-0fa58e4cd0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4a7ec45cc94d1aa16eb6b355967942'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:47.606585 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 894/1768] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:27:47 2022] DELETE /identity/v3/users/7c4a7ec45cc94d1aa16eb6b355967942 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:47.747451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99e5f6-aeff-49d3-a530-68b7e9db677b service nova] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:47.750086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0a99e5f6-aeff-49d3-a530-68b7e9db677b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:47.779999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99e5f6-aeff-49d3-a530-68b7e9db677b service nova] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:47.873330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3872c41-7d05-4522-bb68-36ca0fb4b75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:47.874353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3872c41-7d05-4522-bb68-36ca0fb4b75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:47.874636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3872c41-7d05-4522-bb68-36ca0fb4b75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:47.874907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3872c41-7d05-4522-bb68-36ca0fb4b75a admin admin] PATH_INFO: `/v3/users/465ff9b9bc334956a7601dfb4a4f4cc7` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:47.876166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3872c41-7d05-4522-bb68-36ca0fb4b75a admin admin] RBAC: Authorizing `identity:delete_user(user_id=465ff9b9bc334956a7601dfb4a4f4cc7)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:47.880446 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3872c41-7d05-4522-bb68-36ca0fb4b75a admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:47.954328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a3872c41-7d05-4522-bb68-36ca0fb4b75a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465ff9b9bc334956a7601dfb4a4f4cc7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:47.955312 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a3872c41-7d05-4522-bb68-36ca0fb4b75a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465ff9b9bc334956a7601dfb4a4f4cc7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:47.992156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a3872c41-7d05-4522-bb68-36ca0fb4b75a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465ff9b9bc334956a7601dfb4a4f4cc7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:47.994787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423ebf2-488e-414d-8d96-0fa58e4cd0ae admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:47.997098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7423ebf2-488e-414d-8d96-0fa58e4cd0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:48.021372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423ebf2-488e-414d-8d96-0fa58e4cd0ae admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:48.024734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a3872c41-7d05-4522-bb68-36ca0fb4b75a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465ff9b9bc334956a7601dfb4a4f4cc7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:48.043472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:48.045051 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:48.045844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:48.046545 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] PATH_INFO: `/v3/projects/707c5c8dad034f45812b93e0186199b4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:48.048890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=707c5c8dad034f45812b93e0186199b4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:48.063710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a3872c41-7d05-4522-bb68-36ca0fb4b75a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465ff9b9bc334956a7601dfb4a4f4cc7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:48.069709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:48.089968 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 875/1769] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:27:47 2022] DELETE /identity/v3/users/465ff9b9bc334956a7601dfb4a4f4cc7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:48.096008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a7623-bd4f-4a4e-aac9-a4f197a7de95 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:48.097333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a7623-bd4f-4a4e-aac9-a4f197a7de95 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:48.099412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a7623-bd4f-4a4e-aac9-a4f197a7de95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:48.150055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-f53a7623-bd4f-4a4e-aac9-a4f197a7de95 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:48.151570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f53a7623-bd4f-4a4e-aac9-a4f197a7de95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:48.207676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707c5c8dad034f45812b93e0186199b4', 'request_id': 'req-ac74a096-c42f-41fd-be71-a35fb01a9e00'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:48.220528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707c5c8dad034f45812b93e0186199b4', 'request_id': 'req-ac74a096-c42f-41fd-be71-a35fb01a9e00'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:48.238647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707c5c8dad034f45812b93e0186199b4', 'request_id': 'req-ac74a096-c42f-41fd-be71-a35fb01a9e00'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:48.266982 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] The token cache is being invalidate because project 707c5c8dad034f45812b93e0186199b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:27:48.268892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:48.270641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:48.275889 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 876/1771] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:48.277045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 895/1771] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:27:47 2022] DELETE /identity/v3/projects/707c5c8dad034f45812b93e0186199b4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:48.279551 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a7623-bd4f-4a4e-aac9-a4f197a7de95 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:48.282378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f53a7623-bd4f-4a4e-aac9-a4f197a7de95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:48.298979 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a7623-bd4f-4a4e-aac9-a4f197a7de95 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:48.302135 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:48.304488 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:48.423036 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9d4ee-5fc5-4a92-9d16-c9bc6a29b0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:48.438851 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74a096-c42f-41fd-be71-a35fb01a9e00 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:48.443136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d4ee-5fc5-4a92-9d16-c9bc6a29b0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:48.443753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d4ee-5fc5-4a92-9d16-c9bc6a29b0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:48.444175 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9d4ee-5fc5-4a92-9d16-c9bc6a29b0ee admin admin] PATH_INFO: `/v3/users/a107d3602d7e48e5a0852d5798490d10` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:48.445798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9d4ee-5fc5-4a92-9d16-c9bc6a29b0ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=a107d3602d7e48e5a0852d5798490d10)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:48.446677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa11bf-cee0-4f0d-b2ba-9c0cb5635667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:48.447522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa11bf-cee0-4f0d-b2ba-9c0cb5635667 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:48.447946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa11bf-cee0-4f0d-b2ba-9c0cb5635667 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:48.448358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa11bf-cee0-4f0d-b2ba-9c0cb5635667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:48.449076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9d4ee-5fc5-4a92-9d16-c9bc6a29b0ee admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:48.450649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d7aa11bf-cee0-4f0d-b2ba-9c0cb5635667 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:48.472093 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa11bf-cee0-4f0d-b2ba-9c0cb5635667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:48.474241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa11bf-cee0-4f0d-b2ba-9c0cb5635667 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:48.494193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 896/1772] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:27:48.522654 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ede9d4ee-5fc5-4a92-9d16-c9bc6a29b0ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a107d3602d7e48e5a0852d5798490d10'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:48.524037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ede9d4ee-5fc5-4a92-9d16-c9bc6a29b0ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a107d3602d7e48e5a0852d5798490d10'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:48.528287 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cae0ce-9aa8-4223-84fc-297d827b47fa None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:48.529196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cae0ce-9aa8-4223-84fc-297d827b47fa None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:48.530323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cae0ce-9aa8-4223-84fc-297d827b47fa None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:48.534568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 897/1773] 10.222.0.61 () {54 vars in 921 bytes} [Tue May 10 20:27:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:27:48.562832 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ede9d4ee-5fc5-4a92-9d16-c9bc6a29b0ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a107d3602d7e48e5a0852d5798490d10'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:48.576903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ede9d4ee-5fc5-4a92-9d16-c9bc6a29b0ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a107d3602d7e48e5a0852d5798490d10'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:48.595543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ede9d4ee-5fc5-4a92-9d16-c9bc6a29b0ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a107d3602d7e48e5a0852d5798490d10'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:48.604561 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 877/1774] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:27:48 2022] DELETE /identity/v3/users/a107d3602d7e48e5a0852d5798490d10 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:27:48.637566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2e16a-83fc-4c89-a906-2b68999e7870 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:48.637854 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2e16a-83fc-4c89-a906-2b68999e7870 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:48.638157 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2e16a-83fc-4c89-a906-2b68999e7870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:48.700371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4fd2e16a-83fc-4c89-a906-2b68999e7870 None None] MFA Rules not processed for user `8c3c6fe7e21c4c1ebc01cf91c3c05c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:48.701634 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4fd2e16a-83fc-4c89-a906-2b68999e7870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:48.778993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9d4ee-5fc5-4a92-9d16-c9bc6a29b0ee admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:48.781156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ede9d4ee-5fc5-4a92-9d16-c9bc6a29b0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:48.795485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 898/1775] 10.222.0.61 () {58 vars in 1018 bytes} [Tue May 10 20:27:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:48.825516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2e16a-83fc-4c89-a906-2b68999e7870 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:48.844846 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4fd2e16a-83fc-4c89-a906-2b68999e7870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:48.900754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9d4ee-5fc5-4a92-9d16-c9bc6a29b0ee admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:48.905753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:48.906640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:48.906924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:48.907201 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] PATH_INFO: `/v3/projects/ff2504be00a6476a9635477849e12605` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:48.915019 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff2504be00a6476a9635477849e12605)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:48.916118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2e16a-83fc-4c89-a906-2b68999e7870 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:48.917014 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:48.939357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6bb14-0fa8-4b8d-a037-abaa0574c364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:48.940198 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6bb14-0fa8-4b8d-a037-abaa0574c364 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:48.940697 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6bb14-0fa8-4b8d-a037-abaa0574c364 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:48.940997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6bb14-0fa8-4b8d-a037-abaa0574c364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:48.966481 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6bb14-0fa8-4b8d-a037-abaa0574c364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:48.999658 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6bb14-0fa8-4b8d-a037-abaa0574c364 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:49.009125 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff2504be00a6476a9635477849e12605', 'request_id': 'req-ea65b2db-250d-4887-b656-5d711ee5ebe3'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:49.022339 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff2504be00a6476a9635477849e12605', 'request_id': 'req-ea65b2db-250d-4887-b656-5d711ee5ebe3'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:49.027280 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 899/1776] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:49.029326 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff2504be00a6476a9635477849e12605', 'request_id': 'req-ea65b2db-250d-4887-b656-5d711ee5ebe3'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:49.061669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] The token cache is being invalidate because project ff2504be00a6476a9635477849e12605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:27:49.061977 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:49.064844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:49.072908 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 878/1777] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:27:48 2022] DELETE /identity/v3/projects/ff2504be00a6476a9635477849e12605 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:49.074313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6bb14-0fa8-4b8d-a037-abaa0574c364 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:49.090200 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6bb14-0fa8-4b8d-a037-abaa0574c364 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:49.262034 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3562e-f8eb-444a-a5da-a8fc8c82537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:49.262987 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3562e-f8eb-444a-a5da-a8fc8c82537d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:49.263767 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3562e-f8eb-444a-a5da-a8fc8c82537d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:49.264071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3562e-f8eb-444a-a5da-a8fc8c82537d admin admin] PATH_INFO: `/v3/users/c07164c890b6483aa5f647314c6d9558` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:49.268953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3562e-f8eb-444a-a5da-a8fc8c82537d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07164c890b6483aa5f647314c6d9558)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:49.280083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3562e-f8eb-444a-a5da-a8fc8c82537d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:49.402404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-54b3562e-f8eb-444a-a5da-a8fc8c82537d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07164c890b6483aa5f647314c6d9558'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:49.423328 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-54b3562e-f8eb-444a-a5da-a8fc8c82537d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07164c890b6483aa5f647314c6d9558'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:49.449440 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-54b3562e-f8eb-444a-a5da-a8fc8c82537d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07164c890b6483aa5f647314c6d9558'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:49.452057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-54b3562e-f8eb-444a-a5da-a8fc8c82537d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07164c890b6483aa5f647314c6d9558'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:49.462840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-54b3562e-f8eb-444a-a5da-a8fc8c82537d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07164c890b6483aa5f647314c6d9558'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:49.474765 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 900/1778] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:27:49 2022] DELETE /identity/v3/users/c07164c890b6483aa5f647314c6d9558 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:50.025308 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:50.026810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:50.045241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65b2db-250d-4887-b656-5d711ee5ebe3 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:50.104748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134ab30-8738-42cb-96c5-0525629a78bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:50.105666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134ab30-8738-42cb-96c5-0525629a78bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:50.105944 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134ab30-8738-42cb-96c5-0525629a78bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:50.106219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134ab30-8738-42cb-96c5-0525629a78bb admin admin] PATH_INFO: `/v3/projects/34be9c3d3c6a468cb2f0a0a0e29fad58` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:50.107415 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134ab30-8738-42cb-96c5-0525629a78bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=34be9c3d3c6a468cb2f0a0a0e29fad58)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:50.109650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134ab30-8738-42cb-96c5-0525629a78bb admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:50.156891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2134ab30-8738-42cb-96c5-0525629a78bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34be9c3d3c6a468cb2f0a0a0e29fad58', 'request_id': 'req-2134ab30-8738-42cb-96c5-0525629a78bb'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.164672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2134ab30-8738-42cb-96c5-0525629a78bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34be9c3d3c6a468cb2f0a0a0e29fad58', 'request_id': 'req-2134ab30-8738-42cb-96c5-0525629a78bb'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.169899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2134ab30-8738-42cb-96c5-0525629a78bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34be9c3d3c6a468cb2f0a0a0e29fad58', 'request_id': 'req-2134ab30-8738-42cb-96c5-0525629a78bb'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.181390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2134ab30-8738-42cb-96c5-0525629a78bb admin admin] The token cache is being invalidate because project 34be9c3d3c6a468cb2f0a0a0e29fad58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:27:50.189422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2134ab30-8738-42cb-96c5-0525629a78bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.190680 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2134ab30-8738-42cb-96c5-0525629a78bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.192498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 879/1779] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:27:50 2022] DELETE /identity/v3/projects/34be9c3d3c6a468cb2f0a0a0e29fad58 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:50.197991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8f8d9-d4b5-42a9-b8ac-38aed5ca9840 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:50.198308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8f8d9-d4b5-42a9-b8ac-38aed5ca9840 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:50.198760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8f8d9-d4b5-42a9-b8ac-38aed5ca9840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:50.222091 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-48b8f8d9-d4b5-42a9-b8ac-38aed5ca9840 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:50.224367 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-48b8f8d9-d4b5-42a9-b8ac-38aed5ca9840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:50.323484 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 901/1780] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:50.332457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e80d26-f1b4-4081-8361-85829c5e239d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:50.333149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e80d26-f1b4-4081-8361-85829c5e239d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:50.333530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e80d26-f1b4-4081-8361-85829c5e239d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:50.364416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e1e80d26-f1b4-4081-8361-85829c5e239d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:50.366689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e1e80d26-f1b4-4081-8361-85829c5e239d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:50.379090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 880/1781] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:50.384281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8f8d9-d4b5-42a9-b8ac-38aed5ca9840 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:50.395642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8f8d9-d4b5-42a9-b8ac-38aed5ca9840 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:50.401288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c714e-ee06-4a40-bb34-dcab762d4f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:50.401969 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c714e-ee06-4a40-bb34-dcab762d4f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:50.402256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c714e-ee06-4a40-bb34-dcab762d4f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:50.402535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c714e-ee06-4a40-bb34-dcab762d4f79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:50.403329 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c714e-ee06-4a40-bb34-dcab762d4f79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:50.403642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c714e-ee06-4a40-bb34-dcab762d4f79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:50.405315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c714e-ee06-4a40-bb34-dcab762d4f79 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:50.421041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 902/1782] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:27:50.423915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e80d26-f1b4-4081-8361-85829c5e239d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:50.445927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e80d26-f1b4-4081-8361-85829c5e239d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:50.455338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da238091-9b77-428d-832d-f6f570838c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:50.456025 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da238091-9b77-428d-832d-f6f570838c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:50.456312 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da238091-9b77-428d-832d-f6f570838c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:50.456587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da238091-9b77-428d-832d-f6f570838c27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:50.457383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da238091-9b77-428d-832d-f6f570838c27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:50.459346 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da238091-9b77-428d-832d-f6f570838c27 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:50.496712 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 881/1783] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:50 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:50.500166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c714e-ee06-4a40-bb34-dcab762d4f79 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:50.513274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c714e-ee06-4a40-bb34-dcab762d4f79 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:50.581356 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da238091-9b77-428d-832d-f6f570838c27 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:50.583366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-da238091-9b77-428d-832d-f6f570838c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:50.584295 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfd566-8120-413d-80df-ca683dd0eecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:50.585304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfd566-8120-413d-80df-ca683dd0eecd admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:50.585490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfd566-8120-413d-80df-ca683dd0eecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:50.586092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bfd566-8120-413d-80df-ca683dd0eecd admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:50.586906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfd566-8120-413d-80df-ca683dd0eecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:50.598092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bfd566-8120-413d-80df-ca683dd0eecd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:50.601316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da238091-9b77-428d-832d-f6f570838c27 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:50.610854 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:50.611603 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:50.611894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:50.612283 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] PATH_INFO: `/v3/projects/b4e3e05d6c1547499f7279e98b189778` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:50.613679 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e3e05d6c1547499f7279e98b189778)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:50.616222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:50.639343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 903/1784] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:50 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:50.640891 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfd566-8120-413d-80df-ca683dd0eecd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:50.657016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bfd566-8120-413d-80df-ca683dd0eecd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:50.668702 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bd668-2454-451a-a3c5-c81e14fca8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:50.669997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bd668-2454-451a-a3c5-c81e14fca8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:50.670747 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bd668-2454-451a-a3c5-c81e14fca8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:50.671502 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bd668-2454-451a-a3c5-c81e14fca8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:50.672562 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bd668-2454-451a-a3c5-c81e14fca8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:50.675555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bd668-2454-451a-a3c5-c81e14fca8c7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:50.691439 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 904/1785] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:50.698230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bd668-2454-451a-a3c5-c81e14fca8c7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:50.705316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3e8bd668-2454-451a-a3c5-c81e14fca8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:50.731444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bd668-2454-451a-a3c5-c81e14fca8c7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:50.749858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:50.751034 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:50.751984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:50.752933 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] PATH_INFO: `/v3/projects/decc40cefb2c48c79acb2dfd778445e2` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:50.754443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] RBAC: Authorizing `identity:delete_project(project_id=decc40cefb2c48c79acb2dfd778445e2)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:50.756643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:50.772644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e3e05d6c1547499f7279e98b189778', 'request_id': 'req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.792153 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e3e05d6c1547499f7279e98b189778', 'request_id': 'req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.806651 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e3e05d6c1547499f7279e98b189778', 'request_id': 'req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.835034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] The token cache is being invalidate because project b4e3e05d6c1547499f7279e98b189778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:27:50.838095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.840358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.844607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'decc40cefb2c48c79acb2dfd778445e2', 'request_id': 'req-b6b362a5-46da-4fb7-97db-5b685abd029c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.845324 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 882/1786] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:27:50 2022] DELETE /identity/v3/projects/b4e3e05d6c1547499f7279e98b189778 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:50.847496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:50.852126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:50.869468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'decc40cefb2c48c79acb2dfd778445e2', 'request_id': 'req-b6b362a5-46da-4fb7-97db-5b685abd029c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.898190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'decc40cefb2c48c79acb2dfd778445e2', 'request_id': 'req-b6b362a5-46da-4fb7-97db-5b685abd029c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.920368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] The token cache is being invalidate because project decc40cefb2c48c79acb2dfd778445e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:27:50.920669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.921410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:50.927012 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 905/1787] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:27:50 2022] DELETE /identity/v3/projects/decc40cefb2c48c79acb2dfd778445e2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:50.928012 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:50.929506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:51.011538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb08768-9bc3-4b8e-a436-35f3a162f1f4 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:51.102145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b362a5-46da-4fb7-97db-5b685abd029c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:51.122620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1c82c-42f8-4e63-b4b9-021e1d2e1299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:51.123549 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c82c-42f8-4e63-b4b9-021e1d2e1299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.123832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c82c-42f8-4e63-b4b9-021e1d2e1299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.124105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c82c-42f8-4e63-b4b9-021e1d2e1299 admin admin] PATH_INFO: `/v3/users/30cfef07c1eb45f8b89af61849a5af92` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.129356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1c82c-42f8-4e63-b4b9-021e1d2e1299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30cfef07c1eb45f8b89af61849a5af92)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:51.131512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1c82c-42f8-4e63-b4b9-021e1d2e1299 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:51.166348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81bc6f-8fd8-4f37-98ac-f88954a40c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:51.167047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81bc6f-8fd8-4f37-98ac-f88954a40c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.167527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81bc6f-8fd8-4f37-98ac-f88954a40c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.167939 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81bc6f-8fd8-4f37-98ac-f88954a40c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.168829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81bc6f-8fd8-4f37-98ac-f88954a40c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:51.170624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81bc6f-8fd8-4f37-98ac-f88954a40c5d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:51.198721 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 883/1788] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:51.203780 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b16e39-31c4-4aae-80e1-25de8b88c89d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.204225 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b16e39-31c4-4aae-80e1-25de8b88c89d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.204519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b16e39-31c4-4aae-80e1-25de8b88c89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.223270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-faf1c82c-42f8-4e63-b4b9-021e1d2e1299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30cfef07c1eb45f8b89af61849a5af92'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:51.245535 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-59b16e39-31c4-4aae-80e1-25de8b88c89d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:51.247224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-59b16e39-31c4-4aae-80e1-25de8b88c89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:51.250455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-faf1c82c-42f8-4e63-b4b9-021e1d2e1299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30cfef07c1eb45f8b89af61849a5af92'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:51.263356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-faf1c82c-42f8-4e63-b4b9-021e1d2e1299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30cfef07c1eb45f8b89af61849a5af92'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:51.265241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-faf1c82c-42f8-4e63-b4b9-021e1d2e1299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30cfef07c1eb45f8b89af61849a5af92'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:51.277515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 884/1789] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:51.278109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-faf1c82c-42f8-4e63-b4b9-021e1d2e1299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30cfef07c1eb45f8b89af61849a5af92'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:51.279589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b16e39-31c4-4aae-80e1-25de8b88c89d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:51.289987 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 906/1790] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:27:50 2022] DELETE /identity/v3/users/30cfef07c1eb45f8b89af61849a5af92 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:51.290153 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-59b16e39-31c4-4aae-80e1-25de8b88c89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:51.290263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33f235-92ae-4a23-a0b1-30481d8f03cd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.290263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33f235-92ae-4a23-a0b1-30481d8f03cd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.290263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33f235-92ae-4a23-a0b1-30481d8f03cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.312610 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b16e39-31c4-4aae-80e1-25de8b88c89d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:51.319648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6d33f235-92ae-4a23-a0b1-30481d8f03cd None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:51.320845 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6d33f235-92ae-4a23-a0b1-30481d8f03cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:51.401767 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 907/1791] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:51.405245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966bdff-661a-49a2-8030-889b958bc272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:51.406160 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33f235-92ae-4a23-a0b1-30481d8f03cd None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:51.406274 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966bdff-661a-49a2-8030-889b958bc272 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.406556 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966bdff-661a-49a2-8030-889b958bc272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.406832 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966bdff-661a-49a2-8030-889b958bc272 admin admin] PATH_INFO: `/v3/projects/674156efef514f63b5c1c6dda6ec7e09/users/85082888e3df4eaf9bf1f5e8bdf31afa/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.422298 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33f235-92ae-4a23-a0b1-30481d8f03cd None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:51.430323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec118b9-33c9-46f8-be31-74862ef0c0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:51.431131 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec118b9-33c9-46f8-be31-74862ef0c0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.431484 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec118b9-33c9-46f8-be31-74862ef0c0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.431858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec118b9-33c9-46f8-be31-74862ef0c0b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.433338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec118b9-33c9-46f8-be31-74862ef0c0b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:51.433513 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec118b9-33c9-46f8-be31-74862ef0c0b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:51.435183 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec118b9-33c9-46f8-be31-74862ef0c0b1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:51.441772 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966bdff-661a-49a2-8030-889b958bc272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674156efef514f63b5c1c6dda6ec7e09, user_id=85082888e3df4eaf9bf1f5e8bdf31afa, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:51.444953 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966bdff-661a-49a2-8030-889b958bc272 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:51.450656 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 908/1792] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:27:51.455222 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec118b9-33c9-46f8-be31-74862ef0c0b1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:51.464829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 885/1793] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:51 2022] PUT /identity/v3/projects/674156efef514f63b5c1c6dda6ec7e09/users/85082888e3df4eaf9bf1f5e8bdf31afa/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:51.467334 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec118b9-33c9-46f8-be31-74862ef0c0b1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:51.477251 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54ffb1-0dd3-4b5c-9920-fa85f4294cf6 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.479124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54ffb1-0dd3-4b5c-9920-fa85f4294cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.479418 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54ffb1-0dd3-4b5c-9920-fa85f4294cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.526114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-fd54ffb1-0dd3-4b5c-9920-fa85f4294cf6 None None] MFA Rules not processed for user `85082888e3df4eaf9bf1f5e8bdf31afa`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:51.527463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fd54ffb1-0dd3-4b5c-9920-fa85f4294cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:51.580113 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3af564-3b61-473b-a939-6081dd293ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:51.580869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3af564-3b61-473b-a939-6081dd293ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.581192 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3af564-3b61-473b-a939-6081dd293ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.581517 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3af564-3b61-473b-a939-6081dd293ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.582224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3af564-3b61-473b-a939-6081dd293ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:51.584747 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3af564-3b61-473b-a939-6081dd293ed5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:51.622117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 909/1794] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:51 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:51.626989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3af564-3b61-473b-a939-6081dd293ed5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:51.643978 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 886/1795] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:51.648570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54ffb1-0dd3-4b5c-9920-fa85f4294cf6 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:51.650290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fd54ffb1-0dd3-4b5c-9920-fa85f4294cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:51.665425 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54ffb1-0dd3-4b5c-9920-fa85f4294cf6 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:51.730163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3af564-3b61-473b-a939-6081dd293ed5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:51.748049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac299038-8ed4-4a29-8277-564ed850c7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:51.748789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac299038-8ed4-4a29-8277-564ed850c7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.749114 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac299038-8ed4-4a29-8277-564ed850c7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.749382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac299038-8ed4-4a29-8277-564ed850c7e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.750092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac299038-8ed4-4a29-8277-564ed850c7e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:51.756378 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac299038-8ed4-4a29-8277-564ed850c7e1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:51.766862 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724665f9-9d67-4c3a-b040-d8afd6dbeef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:51.774583 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724665f9-9d67-4c3a-b040-d8afd6dbeef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.774879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724665f9-9d67-4c3a-b040-d8afd6dbeef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.775161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724665f9-9d67-4c3a-b040-d8afd6dbeef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.776229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724665f9-9d67-4c3a-b040-d8afd6dbeef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:51.780640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724665f9-9d67-4c3a-b040-d8afd6dbeef4 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:51.787518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 910/1796] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:51 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:27:51.791612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac299038-8ed4-4a29-8277-564ed850c7e1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:51.803530 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac299038-8ed4-4a29-8277-564ed850c7e1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:51.815386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0595c-53d5-444e-9063-c7c7a18ba6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:51.816950 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0595c-53d5-444e-9063-c7c7a18ba6da admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.817486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0595c-53d5-444e-9063-c7c7a18ba6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.817974 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0595c-53d5-444e-9063-c7c7a18ba6da admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.819592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0595c-53d5-444e-9063-c7c7a18ba6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:51.822865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0595c-53d5-444e-9063-c7c7a18ba6da admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:51.823020 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 887/1797] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:51 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:27:51.823840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724665f9-9d67-4c3a-b040-d8afd6dbeef4 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:51.836761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 911/1798] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:27:51.841998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0595c-53d5-444e-9063-c7c7a18ba6da admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:51.855027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0595c-53d5-444e-9063-c7c7a18ba6da admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:51.912284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724665f9-9d67-4c3a-b040-d8afd6dbeef4 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:51.917352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa3b43-0104-45f1-bf44-cf5a231d9aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:51.918473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa3b43-0104-45f1-bf44-cf5a231d9aff admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.918473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa3b43-0104-45f1-bf44-cf5a231d9aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.918689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa3b43-0104-45f1-bf44-cf5a231d9aff admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.919243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa3b43-0104-45f1-bf44-cf5a231d9aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:51.921186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa3b43-0104-45f1-bf44-cf5a231d9aff admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:51.937128 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0b027-17b2-46ac-b510-cbb2025fb46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:51.938000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0b027-17b2-46ac-b510-cbb2025fb46c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.938000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0b027-17b2-46ac-b510-cbb2025fb46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.938303 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0b027-17b2-46ac-b510-cbb2025fb46c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.939007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0b027-17b2-46ac-b510-cbb2025fb46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:51.941845 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0b027-17b2-46ac-b510-cbb2025fb46c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:51.944713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 888/1799] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:51 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:51.945808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa3b43-0104-45f1-bf44-cf5a231d9aff admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:51.948029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ebfa3b43-0104-45f1-bf44-cf5a231d9aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:51.959997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 912/1800] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:51.961040 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0b027-17b2-46ac-b510-cbb2025fb46c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:51.964667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa3b43-0104-45f1-bf44-cf5a231d9aff admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:51.970078 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63f768-c3d8-4d85-a0e7-8f311c380730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:51.970911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63f768-c3d8-4d85-a0e7-8f311c380730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.971194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63f768-c3d8-4d85-a0e7-8f311c380730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.971475 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63f768-c3d8-4d85-a0e7-8f311c380730 admin admin] PATH_INFO: `/v3/projects/60e2f0df15744d76abe0ef5cc3793375` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.972683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63f768-c3d8-4d85-a0e7-8f311c380730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60e2f0df15744d76abe0ef5cc3793375)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:51.975278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63f768-c3d8-4d85-a0e7-8f311c380730 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:51.976380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0b027-17b2-46ac-b510-cbb2025fb46c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:51.981560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e94568-b097-49fe-a04c-fc14738325c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:51.982349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e94568-b097-49fe-a04c-fc14738325c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:51.982754 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e94568-b097-49fe-a04c-fc14738325c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:51.983135 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e94568-b097-49fe-a04c-fc14738325c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:51.984082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e94568-b097-49fe-a04c-fc14738325c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:51.985869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e94568-b097-49fe-a04c-fc14738325c4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.000381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 913/1801] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:52.000381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e94568-b097-49fe-a04c-fc14738325c4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.017577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e94568-b097-49fe-a04c-fc14738325c4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.023846 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e030f7-29cf-4c2c-b5af-885d20b3ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.024960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e030f7-29cf-4c2c-b5af-885d20b3ac0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.025363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e030f7-29cf-4c2c-b5af-885d20b3ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.025853 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e030f7-29cf-4c2c-b5af-885d20b3ac0d admin admin] PATH_INFO: `/v3/projects/e5ecb2dc3e674bb794ab978f8d269712/users/78f7b61cc7d64fdcbc27d2e49bd516fd/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.050472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9f63f768-c3d8-4d85-a0e7-8f311c380730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60e2f0df15744d76abe0ef5cc3793375', 'request_id': 'req-9f63f768-c3d8-4d85-a0e7-8f311c380730'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:52.053700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e030f7-29cf-4c2c-b5af-885d20b3ac0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ecb2dc3e674bb794ab978f8d269712, user_id=78f7b61cc7d64fdcbc27d2e49bd516fd, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.056618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e030f7-29cf-4c2c-b5af-885d20b3ac0d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.060655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9f63f768-c3d8-4d85-a0e7-8f311c380730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60e2f0df15744d76abe0ef5cc3793375', 'request_id': 'req-9f63f768-c3d8-4d85-a0e7-8f311c380730'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:52.066706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9f63f768-c3d8-4d85-a0e7-8f311c380730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60e2f0df15744d76abe0ef5cc3793375', 'request_id': 'req-9f63f768-c3d8-4d85-a0e7-8f311c380730'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:52.070465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 914/1802] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:52 2022] PUT /identity/v3/projects/e5ecb2dc3e674bb794ab978f8d269712/users/78f7b61cc7d64fdcbc27d2e49bd516fd/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:52.071268 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e030f7-29cf-4c2c-b5af-885d20b3ac0d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.079271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9f63f768-c3d8-4d85-a0e7-8f311c380730 admin admin] The token cache is being invalidate because project 60e2f0df15744d76abe0ef5cc3793375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:27:52.079562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9f63f768-c3d8-4d85-a0e7-8f311c380730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:52.080363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9f63f768-c3d8-4d85-a0e7-8f311c380730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:52.082049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 889/1803] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:27:51 2022] DELETE /identity/v3/projects/60e2f0df15744d76abe0ef5cc3793375 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:52.083357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b1809-4e9a-48d4-aba2-9f1d8f28ab2a None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.083751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b1809-4e9a-48d4-aba2-9f1d8f28ab2a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.084103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b1809-4e9a-48d4-aba2-9f1d8f28ab2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.110932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-f40b1809-4e9a-48d4-aba2-9f1d8f28ab2a None None] MFA Rules not processed for user `78f7b61cc7d64fdcbc27d2e49bd516fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:52.112146 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f40b1809-4e9a-48d4-aba2-9f1d8f28ab2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:52.131684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e030f7-29cf-4c2c-b5af-885d20b3ac0d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.136301 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61a826-c42b-420b-b58c-8e8256b6a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.137220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61a826-c42b-420b-b58c-8e8256b6a9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.137504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61a826-c42b-420b-b58c-8e8256b6a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.137784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61a826-c42b-420b-b58c-8e8256b6a9ba admin admin] PATH_INFO: `/v3/projects/02ace63c95c4468b827a7784a12c4819/users/89a6a26e5cd841248cec75863b856abf/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.152007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61a826-c42b-420b-b58c-8e8256b6a9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ace63c95c4468b827a7784a12c4819, user_id=89a6a26e5cd841248cec75863b856abf, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.154619 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61a826-c42b-420b-b58c-8e8256b6a9ba admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.168234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 915/1804] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:52 2022] PUT /identity/v3/projects/02ace63c95c4468b827a7784a12c4819/users/89a6a26e5cd841248cec75863b856abf/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:52.169652 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d4e07-481f-422d-b521-b501e0f361c7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.170031 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d4e07-481f-422d-b521-b501e0f361c7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.170408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d4e07-481f-422d-b521-b501e0f361c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.176353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 890/1805] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:52.178286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b1809-4e9a-48d4-aba2-9f1d8f28ab2a None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.179699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f40b1809-4e9a-48d4-aba2-9f1d8f28ab2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:52.189141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7c7d4e07-481f-422d-b521-b501e0f361c7 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:52.190319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7c7d4e07-481f-422d-b521-b501e0f361c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:52.192505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b1809-4e9a-48d4-aba2-9f1d8f28ab2a None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.247368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b0b20-a4fa-47a0-8366-95accb205463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.248059 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b0b20-a4fa-47a0-8366-95accb205463 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.248344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b0b20-a4fa-47a0-8366-95accb205463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.248618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b0b20-a4fa-47a0-8366-95accb205463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.249387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b0b20-a4fa-47a0-8366-95accb205463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.251014 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b0b20-a4fa-47a0-8366-95accb205463 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.252086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 916/1806] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:52.252774 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d4e07-481f-422d-b521-b501e0f361c7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.259472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7c7d4e07-481f-422d-b521-b501e0f361c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:52.264676 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 891/1807] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:52.264676 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427789e-d3cf-45b6-8be3-cb9fc823142e None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.264676 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427789e-d3cf-45b6-8be3-cb9fc823142e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.264676 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427789e-d3cf-45b6-8be3-cb9fc823142e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.271937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d4e07-481f-422d-b521-b501e0f361c7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.276757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a85fb7-0f1d-466e-be2a-0b9c3203b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.277450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a85fb7-0f1d-466e-be2a-0b9c3203b6fd admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.277732 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a85fb7-0f1d-466e-be2a-0b9c3203b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.278015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a85fb7-0f1d-466e-be2a-0b9c3203b6fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.278706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a85fb7-0f1d-466e-be2a-0b9c3203b6fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.282052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a85fb7-0f1d-466e-be2a-0b9c3203b6fd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.282342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-5427789e-d3cf-45b6-8be3-cb9fc823142e None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:52.283606 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5427789e-d3cf-45b6-8be3-cb9fc823142e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:52.292370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 892/1808] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:52.293108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427789e-d3cf-45b6-8be3-cb9fc823142e None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.304028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427789e-d3cf-45b6-8be3-cb9fc823142e None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.309733 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c76c4-8f41-4ae3-93ed-8cd529e2d634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.310721 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c76c4-8f41-4ae3-93ed-8cd529e2d634 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.311028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c76c4-8f41-4ae3-93ed-8cd529e2d634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.311290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c76c4-8f41-4ae3-93ed-8cd529e2d634 admin admin] PATH_INFO: `/v3/projects/02ace63c95c4468b827a7784a12c4819/users/89a6a26e5cd841248cec75863b856abf/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.315046 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c76c4-8f41-4ae3-93ed-8cd529e2d634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ace63c95c4468b827a7784a12c4819, user_id=89a6a26e5cd841248cec75863b856abf, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.320150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 917/1809] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:52 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:52.320274 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c76c4-8f41-4ae3-93ed-8cd529e2d634 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.320380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a85fb7-0f1d-466e-be2a-0b9c3203b6fd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.330098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 893/1810] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:52 2022] PUT /identity/v3/projects/02ace63c95c4468b827a7784a12c4819/users/89a6a26e5cd841248cec75863b856abf/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:52.331193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c76c4-8f41-4ae3-93ed-8cd529e2d634 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.423397 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c76c4-8f41-4ae3-93ed-8cd529e2d634 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.423676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a85fb7-0f1d-466e-be2a-0b9c3203b6fd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.428883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81a5c5-aba7-4f41-a367-8ddef5dcde1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.429681 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81a5c5-aba7-4f41-a367-8ddef5dcde1d admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.430032 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81a5c5-aba7-4f41-a367-8ddef5dcde1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.430201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a296cf-17d9-461b-8f1d-f2309ab65a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.430348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81a5c5-aba7-4f41-a367-8ddef5dcde1d admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.431115 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81a5c5-aba7-4f41-a367-8ddef5dcde1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.431335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a296cf-17d9-461b-8f1d-f2309ab65a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.431761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a296cf-17d9-461b-8f1d-f2309ab65a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.432157 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a296cf-17d9-461b-8f1d-f2309ab65a7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.433213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a296cf-17d9-461b-8f1d-f2309ab65a7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:52.433431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81a5c5-aba7-4f41-a367-8ddef5dcde1d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.433725 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a296cf-17d9-461b-8f1d-f2309ab65a7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.436220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a296cf-17d9-461b-8f1d-f2309ab65a7e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.460095 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 918/1811] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:27:52.460095 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f432f3-bd5f-42c4-a197-ae64f5f6b016 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.460095 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f432f3-bd5f-42c4-a197-ae64f5f6b016 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.460095 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f432f3-bd5f-42c4-a197-ae64f5f6b016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.465135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 894/1812] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:52 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:52.466170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81a5c5-aba7-4f41-a367-8ddef5dcde1d admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.478152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81a5c5-aba7-4f41-a367-8ddef5dcde1d admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.487614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32463b8-31df-42f1-8591-79e516e128da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.488660 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32463b8-31df-42f1-8591-79e516e128da admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.489146 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32463b8-31df-42f1-8591-79e516e128da admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.489595 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32463b8-31df-42f1-8591-79e516e128da admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.492015 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32463b8-31df-42f1-8591-79e516e128da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.499778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-96f432f3-bd5f-42c4-a197-ae64f5f6b016 None None] MFA Rules not processed for user `89a6a26e5cd841248cec75863b856abf`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:52.500822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32463b8-31df-42f1-8591-79e516e128da admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.502493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-96f432f3-bd5f-42c4-a197-ae64f5f6b016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:52.566601 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 895/1813] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:52 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:52.568322 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32463b8-31df-42f1-8591-79e516e128da admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.601206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 919/1814] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:52.602167 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f432f3-bd5f-42c4-a197-ae64f5f6b016 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.616365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f432f3-bd5f-42c4-a197-ae64f5f6b016 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.668553 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32463b8-31df-42f1-8591-79e516e128da admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.673568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cda19-bd86-4ae4-b765-37c45f8b1143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.674183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cda19-bd86-4ae4-b765-37c45f8b1143 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.674469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cda19-bd86-4ae4-b765-37c45f8b1143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.674744 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cda19-bd86-4ae4-b765-37c45f8b1143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.675485 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cda19-bd86-4ae4-b765-37c45f8b1143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.677098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cda19-bd86-4ae4-b765-37c45f8b1143 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.695745 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 896/1815] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:52.696730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cda19-bd86-4ae4-b765-37c45f8b1143 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.698470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0d5cda19-bd86-4ae4-b765-37c45f8b1143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:52.698833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da40ca0-5eae-4883-a9d9-fd7fa0b47ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.699536 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da40ca0-5eae-4883-a9d9-fd7fa0b47ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.700055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da40ca0-5eae-4883-a9d9-fd7fa0b47ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.700341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da40ca0-5eae-4883-a9d9-fd7fa0b47ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.701143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da40ca0-5eae-4883-a9d9-fd7fa0b47ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.703266 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da40ca0-5eae-4883-a9d9-fd7fa0b47ea5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.729021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 920/1816] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:52 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:52.729021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da40ca0-5eae-4883-a9d9-fd7fa0b47ea5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.737182 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da40ca0-5eae-4883-a9d9-fd7fa0b47ea5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.742192 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0ab2e-df18-49a7-8e4a-f18ab6fc1a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.743230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0ab2e-df18-49a7-8e4a-f18ab6fc1a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.743631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0ab2e-df18-49a7-8e4a-f18ab6fc1a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.743916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0ab2e-df18-49a7-8e4a-f18ab6fc1a4a admin admin] PATH_INFO: `/v3/projects/1787be1769dd4433bfe7b92609f73d9a/users/6573114f29a94209a57653b917b8ba5e/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.764307 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0ab2e-df18-49a7-8e4a-f18ab6fc1a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1787be1769dd4433bfe7b92609f73d9a, user_id=6573114f29a94209a57653b917b8ba5e, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.767463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0ab2e-df18-49a7-8e4a-f18ab6fc1a4a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.767797 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cda19-bd86-4ae4-b765-37c45f8b1143 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.774430 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a521a8c-0781-426d-95ce-a29600b6ea2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.775214 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a521a8c-0781-426d-95ce-a29600b6ea2a service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.775486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a521a8c-0781-426d-95ce-a29600b6ea2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.776620 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a521a8c-0781-426d-95ce-a29600b6ea2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.785623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 921/1817] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:52 2022] PUT /identity/v3/projects/1787be1769dd4433bfe7b92609f73d9a/users/6573114f29a94209a57653b917b8ba5e/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:52.786898 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0ab2e-df18-49a7-8e4a-f18ab6fc1a4a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.842096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a521a8c-0781-426d-95ce-a29600b6ea2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.843545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a521a8c-0781-426d-95ce-a29600b6ea2a service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.848798 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0ab2e-df18-49a7-8e4a-f18ab6fc1a4a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.853579 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 897/1818] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:52.853859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff9b86-da48-4d32-8f13-8997983b7421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.854392 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a521a8c-0781-426d-95ce-a29600b6ea2a service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.854584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff9b86-da48-4d32-8f13-8997983b7421 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.855083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff9b86-da48-4d32-8f13-8997983b7421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.855367 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff9b86-da48-4d32-8f13-8997983b7421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.856223 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff9b86-da48-4d32-8f13-8997983b7421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.858577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff9b86-da48-4d32-8f13-8997983b7421 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.866306 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a521a8c-0781-426d-95ce-a29600b6ea2a service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.869893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 922/1819] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:52.871839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e9458-892e-41bd-b76c-3f51b243e98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.872503 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9458-892e-41bd-b76c-3f51b243e98e admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.872827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9458-892e-41bd-b76c-3f51b243e98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.873125 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9458-892e-41bd-b76c-3f51b243e98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.873622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff9b86-da48-4d32-8f13-8997983b7421 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.874048 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e9458-892e-41bd-b76c-3f51b243e98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.875992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e9458-892e-41bd-b76c-3f51b243e98e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.887819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff9b86-da48-4d32-8f13-8997983b7421 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.891967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 898/1820] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:52.893031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e9458-892e-41bd-b76c-3f51b243e98e admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.895073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f4092-8267-4c8d-bad1-c1fe4e26d0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.895878 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f4092-8267-4c8d-bad1-c1fe4e26d0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.896228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f4092-8267-4c8d-bad1-c1fe4e26d0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.897071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f4092-8267-4c8d-bad1-c1fe4e26d0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.898236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f4092-8267-4c8d-bad1-c1fe4e26d0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.900016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f4092-8267-4c8d-bad1-c1fe4e26d0c2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.904878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e9458-892e-41bd-b76c-3f51b243e98e admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.909713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175231c-0835-4117-9591-56995e47c889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.910589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175231c-0835-4117-9591-56995e47c889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.913895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175231c-0835-4117-9591-56995e47c889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.913895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175231c-0835-4117-9591-56995e47c889 admin admin] PATH_INFO: `/v3/projects/1787be1769dd4433bfe7b92609f73d9a/users/6573114f29a94209a57653b917b8ba5e/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.914068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 923/1821] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:52.914139 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175231c-0835-4117-9591-56995e47c889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1787be1769dd4433bfe7b92609f73d9a, user_id=6573114f29a94209a57653b917b8ba5e, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:52.915330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f4092-8267-4c8d-bad1-c1fe4e26d0c2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:52.916583 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175231c-0835-4117-9591-56995e47c889 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:52.927096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f4092-8267-4c8d-bad1-c1fe4e26d0c2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:52.933065 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 899/1822] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:52 2022] PUT /identity/v3/projects/1787be1769dd4433bfe7b92609f73d9a/users/6573114f29a94209a57653b917b8ba5e/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:27:52.944408 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31f0e9-c368-4af7-b504-0f47c90f1497 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.944697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31f0e9-c368-4af7-b504-0f47c90f1497 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.945098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31f0e9-c368-4af7-b504-0f47c90f1497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:52.971564 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-ac31f0e9-c368-4af7-b504-0f47c90f1497 None None] MFA Rules not processed for user `6573114f29a94209a57653b917b8ba5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:52.972774 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ac31f0e9-c368-4af7-b504-0f47c90f1497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:52.995790 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4978a07-9702-4426-adef-9df9c801196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:52.996701 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4978a07-9702-4426-adef-9df9c801196d admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:52.997046 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4978a07-9702-4426-adef-9df9c801196d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:52.997325 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4978a07-9702-4426-adef-9df9c801196d admin admin] PATH_INFO: `/v3/projects/3446cc29ac254efe8933be7eda3bd1ed/users/b8d228420e354a988a8d010406b7005e/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:53.011471 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4978a07-9702-4426-adef-9df9c801196d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3446cc29ac254efe8933be7eda3bd1ed, user_id=b8d228420e354a988a8d010406b7005e, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:53.014141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4978a07-9702-4426-adef-9df9c801196d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:53.027551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 924/1823] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:52 2022] PUT /identity/v3/projects/3446cc29ac254efe8933be7eda3bd1ed/users/b8d228420e354a988a8d010406b7005e/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:53.036462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4978a07-9702-4426-adef-9df9c801196d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:53.050248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 900/1824] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:27:53.052062 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb0786-dbef-488c-96ed-ca18adaceaf3 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:53.053088 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb0786-dbef-488c-96ed-ca18adaceaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:53.053573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb0786-dbef-488c-96ed-ca18adaceaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:53.092136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-16fb0786-dbef-488c-96ed-ca18adaceaf3 None None] MFA Rules not processed for user `b8d228420e354a988a8d010406b7005e`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:53.093473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-16fb0786-dbef-488c-96ed-ca18adaceaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:53.102917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4978a07-9702-4426-adef-9df9c801196d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:53.106526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d5c62-f574-41a4-84e6-8c009aa2b711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:53.107185 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d5c62-f574-41a4-84e6-8c009aa2b711 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:53.107457 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d5c62-f574-41a4-84e6-8c009aa2b711 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:53.107725 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d5c62-f574-41a4-84e6-8c009aa2b711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:53.109483 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-458d5c62-f574-41a4-84e6-8c009aa2b711 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:53.159577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 901/1825] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:53.162020 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb0786-dbef-488c-96ed-ca18adaceaf3 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:53.163425 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-16fb0786-dbef-488c-96ed-ca18adaceaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:53.172244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d5c62-f574-41a4-84e6-8c009aa2b711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:53.173885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d5c62-f574-41a4-84e6-8c009aa2b711 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:53.174801 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb0786-dbef-488c-96ed-ca18adaceaf3 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:53.179131 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc8a53-e8ea-48c1-8086-73dcdcc03b0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:53.179714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8a53-e8ea-48c1-8086-73dcdcc03b0a service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:53.179981 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8a53-e8ea-48c1-8086-73dcdcc03b0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:53.180256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc8a53-e8ea-48c1-8086-73dcdcc03b0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:53.184815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 925/1826] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:53.185377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d5c62-f574-41a4-84e6-8c009aa2b711 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:53.244103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc8a53-e8ea-48c1-8086-73dcdcc03b0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:53.245848 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc8a53-e8ea-48c1-8086-73dcdcc03b0a service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:53.250530 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d5c62-f574-41a4-84e6-8c009aa2b711 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:53.255288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2e1af-a1d5-4e69-84d5-c0fd29dfe7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:53.256499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2e1af-a1d5-4e69-84d5-c0fd29dfe7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:53.256781 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2e1af-a1d5-4e69-84d5-c0fd29dfe7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:53.257083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2e1af-a1d5-4e69-84d5-c0fd29dfe7e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:53.257777 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2e1af-a1d5-4e69-84d5-c0fd29dfe7e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:53.259676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2e1af-a1d5-4e69-84d5-c0fd29dfe7e4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:53.260953 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 902/1827] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:53.286554 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 926/1828] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:53 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:53.290610 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc8a53-e8ea-48c1-8086-73dcdcc03b0a service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:53.301366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc8a53-e8ea-48c1-8086-73dcdcc03b0a service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:53.375243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c13420-7f3d-42f5-969e-998c585a6422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:53.376253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c13420-7f3d-42f5-969e-998c585a6422 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:53.376787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c13420-7f3d-42f5-969e-998c585a6422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:53.377096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c13420-7f3d-42f5-969e-998c585a6422 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:53.377810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c13420-7f3d-42f5-969e-998c585a6422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:53.379796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c13420-7f3d-42f5-969e-998c585a6422 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:53.407598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 903/1829] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:53 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:27:53.412230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2e1af-a1d5-4e69-84d5-c0fd29dfe7e4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:53.423489 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2e1af-a1d5-4e69-84d5-c0fd29dfe7e4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:53.429599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2d425-85b1-4fe6-b0ae-120d5479e20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:53.430204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2d425-85b1-4fe6-b0ae-120d5479e20d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:53.430497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2d425-85b1-4fe6-b0ae-120d5479e20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:53.431335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2d425-85b1-4fe6-b0ae-120d5479e20d admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:53.431752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2d425-85b1-4fe6-b0ae-120d5479e20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:53.433425 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2d425-85b1-4fe6-b0ae-120d5479e20d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:53.450094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 927/1830] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:53.450879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c13420-7f3d-42f5-969e-998c585a6422 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:53.464586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c13420-7f3d-42f5-969e-998c585a6422 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:53.471755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9e253-2f0a-49e0-bbf7-b8350461db1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:53.472924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9e253-2f0a-49e0-bbf7-b8350461db1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:53.473249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9e253-2f0a-49e0-bbf7-b8350461db1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:53.473579 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9e253-2f0a-49e0-bbf7-b8350461db1f admin admin] PATH_INFO: `/v3/projects/c5006e59f0bf4fec9ede74aedd9050fb/users/d7ac6fc4b2ac4554aad9ef4304c274cc/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:53.491317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9e253-2f0a-49e0-bbf7-b8350461db1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5006e59f0bf4fec9ede74aedd9050fb, user_id=d7ac6fc4b2ac4554aad9ef4304c274cc, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:53.494069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9e253-2f0a-49e0-bbf7-b8350461db1f admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:53.524199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 904/1831] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:53 2022] PUT /identity/v3/projects/c5006e59f0bf4fec9ede74aedd9050fb/users/d7ac6fc4b2ac4554aad9ef4304c274cc/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:27:53.528106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2d425-85b1-4fe6-b0ae-120d5479e20d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:53.538504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2d425-85b1-4fe6-b0ae-120d5479e20d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:53.600633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb98d2-f153-4fe4-ad77-9784852a77af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:53.601351 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb98d2-f153-4fe4-ad77-9784852a77af admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:53.601847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb98d2-f153-4fe4-ad77-9784852a77af admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:53.601940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb98d2-f153-4fe4-ad77-9784852a77af admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:53.602616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb98d2-f153-4fe4-ad77-9784852a77af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:53.604213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb98d2-f153-4fe4-ad77-9784852a77af admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:53.618218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 928/1832] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:53.619351 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9e253-2f0a-49e0-bbf7-b8350461db1f admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:53.631171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9e253-2f0a-49e0-bbf7-b8350461db1f admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:53.636120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17790c1b-58ac-4ecc-9377-65754c8e332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:53.637165 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17790c1b-58ac-4ecc-9377-65754c8e332c admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:53.637461 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17790c1b-58ac-4ecc-9377-65754c8e332c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:53.637735 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17790c1b-58ac-4ecc-9377-65754c8e332c admin admin] PATH_INFO: `/v3/projects/c5006e59f0bf4fec9ede74aedd9050fb/users/d7ac6fc4b2ac4554aad9ef4304c274cc/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:53.645944 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17790c1b-58ac-4ecc-9377-65754c8e332c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5006e59f0bf4fec9ede74aedd9050fb, user_id=d7ac6fc4b2ac4554aad9ef4304c274cc, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:53.648926 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17790c1b-58ac-4ecc-9377-65754c8e332c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:53.673851 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 905/1833] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:53 2022] PUT /identity/v3/projects/c5006e59f0bf4fec9ede74aedd9050fb/users/d7ac6fc4b2ac4554aad9ef4304c274cc/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:53.675036 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae85fd-e897-4a28-802c-dc6af4ba4371 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:53.675329 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae85fd-e897-4a28-802c-dc6af4ba4371 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:53.675613 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae85fd-e897-4a28-802c-dc6af4ba4371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:53.711793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ddae85fd-e897-4a28-802c-dc6af4ba4371 None None] MFA Rules not processed for user `d7ac6fc4b2ac4554aad9ef4304c274cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:53.713064 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ddae85fd-e897-4a28-802c-dc6af4ba4371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:53.813013 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 929/1834] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:27:53.823279 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17790c1b-58ac-4ecc-9377-65754c8e332c admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:53.885275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17790c1b-58ac-4ecc-9377-65754c8e332c admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:53.889496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a6beb-5a3b-4230-b937-1e92ea3cedfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:53.890400 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6beb-5a3b-4230-b937-1e92ea3cedfa service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:53.890752 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6beb-5a3b-4230-b937-1e92ea3cedfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:53.891108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6beb-5a3b-4230-b937-1e92ea3cedfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:53.954664 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a6beb-5a3b-4230-b937-1e92ea3cedfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:53.956105 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a6beb-5a3b-4230-b937-1e92ea3cedfa service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:53.956210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae85fd-e897-4a28-802c-dc6af4ba4371 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:53.968444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 906/1835] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:54.030126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae85fd-e897-4a28-802c-dc6af4ba4371 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:54.034978 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c4f01-3c07-4e70-8692-5bce43e2b5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:54.036033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c4f01-3c07-4e70-8692-5bce43e2b5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:54.036327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c4f01-3c07-4e70-8692-5bce43e2b5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:54.037562 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c4f01-3c07-4e70-8692-5bce43e2b5fd admin admin] PATH_INFO: `/v3/users/78f7b61cc7d64fdcbc27d2e49bd516fd` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:54.038845 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c4f01-3c07-4e70-8692-5bce43e2b5fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f7b61cc7d64fdcbc27d2e49bd516fd)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:54.040853 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c4f01-3c07-4e70-8692-5bce43e2b5fd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:54.092508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-570c4f01-3c07-4e70-8692-5bce43e2b5fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f7b61cc7d64fdcbc27d2e49bd516fd'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.105262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-570c4f01-3c07-4e70-8692-5bce43e2b5fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f7b61cc7d64fdcbc27d2e49bd516fd'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.112576 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-570c4f01-3c07-4e70-8692-5bce43e2b5fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f7b61cc7d64fdcbc27d2e49bd516fd'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.115097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-570c4f01-3c07-4e70-8692-5bce43e2b5fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f7b61cc7d64fdcbc27d2e49bd516fd'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.121644 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-570c4f01-3c07-4e70-8692-5bce43e2b5fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f7b61cc7d64fdcbc27d2e49bd516fd'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.127540 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 930/1836] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:27:53 2022] DELETE /identity/v3/users/78f7b61cc7d64fdcbc27d2e49bd516fd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:54.132890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdf775-c991-4a49-ae31-4c0bcad32708 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:54.133216 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdf775-c991-4a49-ae31-4c0bcad32708 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:54.133517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdf775-c991-4a49-ae31-4c0bcad32708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:54.151974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-cecdf775-c991-4a49-ae31-4c0bcad32708 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:54.153217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-cecdf775-c991-4a49-ae31-4c0bcad32708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:54.213110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 907/1837] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:54.231806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c4f01-3c07-4e70-8692-5bce43e2b5fd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:54.233524 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-570c4f01-3c07-4e70-8692-5bce43e2b5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:54.298181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c4f01-3c07-4e70-8692-5bce43e2b5fd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:54.302547 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b86b0d-88a5-4bee-ade7-11586dbdbe5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:54.303352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b86b0d-88a5-4bee-ade7-11586dbdbe5d service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:54.303629 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b86b0d-88a5-4bee-ade7-11586dbdbe5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:54.303903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b86b0d-88a5-4bee-ade7-11586dbdbe5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:54.312801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b86b0d-88a5-4bee-ade7-11586dbdbe5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:54.314262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b86b0d-88a5-4bee-ade7-11586dbdbe5d service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:54.323842 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 931/1838] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:27:54.580828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdf775-c991-4a49-ae31-4c0bcad32708 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:54.582429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-cecdf775-c991-4a49-ae31-4c0bcad32708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:54.594318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdf775-c991-4a49-ae31-4c0bcad32708 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:54.598943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:54.599845 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:54.600126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:54.600410 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] PATH_INFO: `/v3/projects/e5ecb2dc3e674bb794ab978f8d269712` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:54.601650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ecb2dc3e674bb794ab978f8d269712)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:54.603559 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:54.649245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ecb2dc3e674bb794ab978f8d269712', 'request_id': 'req-e90e0900-d023-48a8-9d98-9367fa78f8b3'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.655940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ecb2dc3e674bb794ab978f8d269712', 'request_id': 'req-e90e0900-d023-48a8-9d98-9367fa78f8b3'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.661351 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ecb2dc3e674bb794ab978f8d269712', 'request_id': 'req-e90e0900-d023-48a8-9d98-9367fa78f8b3'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.671916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] The token cache is being invalidate because project e5ecb2dc3e674bb794ab978f8d269712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:27:54.672202 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.672828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.674714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 908/1839] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:27:54 2022] DELETE /identity/v3/projects/e5ecb2dc3e674bb794ab978f8d269712 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:54.678980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b86b0d-88a5-4bee-ade7-11586dbdbe5d service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:54.688844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b86b0d-88a5-4bee-ade7-11586dbdbe5d service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:54.743280 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bdef46-7178-434c-8159-fc044752529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:54.744080 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdef46-7178-434c-8159-fc044752529e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:54.744363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdef46-7178-434c-8159-fc044752529e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:54.744641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bdef46-7178-434c-8159-fc044752529e admin admin] PATH_INFO: `/v3/users/6573114f29a94209a57653b917b8ba5e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:54.745877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdef46-7178-434c-8159-fc044752529e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6573114f29a94209a57653b917b8ba5e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:54.747861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bdef46-7178-434c-8159-fc044752529e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:54.796604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-39bdef46-7178-434c-8159-fc044752529e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6573114f29a94209a57653b917b8ba5e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.808750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-39bdef46-7178-434c-8159-fc044752529e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6573114f29a94209a57653b917b8ba5e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.815673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-39bdef46-7178-434c-8159-fc044752529e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6573114f29a94209a57653b917b8ba5e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.816525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-39bdef46-7178-434c-8159-fc044752529e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6573114f29a94209a57653b917b8ba5e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.825890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-39bdef46-7178-434c-8159-fc044752529e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6573114f29a94209a57653b917b8ba5e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:54.832438 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 932/1840] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:27:54 2022] DELETE /identity/v3/users/6573114f29a94209a57653b917b8ba5e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:55.350887 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:55.353125 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:55.367623 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e0900-d023-48a8-9d98-9367fa78f8b3 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:55.427235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead65995-6288-41c2-8d25-31e419c9ede8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:55.428101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead65995-6288-41c2-8d25-31e419c9ede8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:55.428385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead65995-6288-41c2-8d25-31e419c9ede8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:55.428663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead65995-6288-41c2-8d25-31e419c9ede8 admin admin] PATH_INFO: `/v3/projects/1787be1769dd4433bfe7b92609f73d9a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:55.429967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead65995-6288-41c2-8d25-31e419c9ede8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1787be1769dd4433bfe7b92609f73d9a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:55.431859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead65995-6288-41c2-8d25-31e419c9ede8 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:55.483275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ead65995-6288-41c2-8d25-31e419c9ede8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1787be1769dd4433bfe7b92609f73d9a', 'request_id': 'req-ead65995-6288-41c2-8d25-31e419c9ede8'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:55.490030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ead65995-6288-41c2-8d25-31e419c9ede8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1787be1769dd4433bfe7b92609f73d9a', 'request_id': 'req-ead65995-6288-41c2-8d25-31e419c9ede8'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:55.495547 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ead65995-6288-41c2-8d25-31e419c9ede8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1787be1769dd4433bfe7b92609f73d9a', 'request_id': 'req-ead65995-6288-41c2-8d25-31e419c9ede8'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:55.507023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ead65995-6288-41c2-8d25-31e419c9ede8 admin admin] The token cache is being invalidate because project 1787be1769dd4433bfe7b92609f73d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:27:55.507333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ead65995-6288-41c2-8d25-31e419c9ede8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:55.507980 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ead65995-6288-41c2-8d25-31e419c9ede8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:27:55.509560 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 909/1841] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:27:55 2022] DELETE /identity/v3/projects/1787be1769dd4433bfe7b92609f73d9a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:55.515442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e91ce4-92e0-43f5-8ec1-d2c8567ef228 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:55.515730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e91ce4-92e0-43f5-8ec1-d2c8567ef228 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:55.516009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e91ce4-92e0-43f5-8ec1-d2c8567ef228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:55.534262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-16e91ce4-92e0-43f5-8ec1-d2c8567ef228 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:55.535784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-16e91ce4-92e0-43f5-8ec1-d2c8567ef228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:55.596771 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 933/1842] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:55.605338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6bfc8-ed25-4c76-87d7-18e5d066a7d4 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:55.605629 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6bfc8-ed25-4c76-87d7-18e5d066a7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:55.605934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6bfc8-ed25-4c76-87d7-18e5d066a7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:55.623527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-46f6bfc8-ed25-4c76-87d7-18e5d066a7d4 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:55.624738 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-46f6bfc8-ed25-4c76-87d7-18e5d066a7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:55.633080 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 910/1843] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:55.637275 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e91ce4-92e0-43f5-8ec1-d2c8567ef228 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:55.647122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e91ce4-92e0-43f5-8ec1-d2c8567ef228 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:55.652389 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153763d-ae1f-4656-bd34-ec419917a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:55.653065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153763d-ae1f-4656-bd34-ec419917a1db admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:55.653371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153763d-ae1f-4656-bd34-ec419917a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:55.653645 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153763d-ae1f-4656-bd34-ec419917a1db admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:55.654354 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153763d-ae1f-4656-bd34-ec419917a1db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:27:55.654656 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153763d-ae1f-4656-bd34-ec419917a1db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:55.656232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153763d-ae1f-4656-bd34-ec419917a1db admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:55.667257 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 934/1844] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:27:55.671431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6bfc8-ed25-4c76-87d7-18e5d066a7d4 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:55.680421 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6bfc8-ed25-4c76-87d7-18e5d066a7d4 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:55.684963 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d81449-df2c-4eed-a121-adfb9b1d3aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:55.685635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d81449-df2c-4eed-a121-adfb9b1d3aae admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:55.685914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d81449-df2c-4eed-a121-adfb9b1d3aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:55.686200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d81449-df2c-4eed-a121-adfb9b1d3aae admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:55.687104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d81449-df2c-4eed-a121-adfb9b1d3aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:55.689005 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d81449-df2c-4eed-a121-adfb9b1d3aae admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:55.719394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 911/1845] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:27:55 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:27:55.720564 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153763d-ae1f-4656-bd34-ec419917a1db admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:55.731040 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153763d-ae1f-4656-bd34-ec419917a1db admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:55.790038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab26c5-bf1a-4059-9ba4-7bc6f5e37992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:55.790743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab26c5-bf1a-4059-9ba4-7bc6f5e37992 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:55.791027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab26c5-bf1a-4059-9ba4-7bc6f5e37992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:55.791303 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab26c5-bf1a-4059-9ba4-7bc6f5e37992 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:55.791981 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab26c5-bf1a-4059-9ba4-7bc6f5e37992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:55.793981 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab26c5-bf1a-4059-9ba4-7bc6f5e37992 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:55.813710 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 935/1846] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:27:55 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:27:55.817882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d81449-df2c-4eed-a121-adfb9b1d3aae admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:55.828372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d81449-df2c-4eed-a121-adfb9b1d3aae admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:55.834631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d065326-c5d9-4583-b1d5-3a0277fdd9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:55.834874 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d065326-c5d9-4583-b1d5-3a0277fdd9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:55.835156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d065326-c5d9-4583-b1d5-3a0277fdd9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:55.835447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d065326-c5d9-4583-b1d5-3a0277fdd9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:55.836168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d065326-c5d9-4583-b1d5-3a0277fdd9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:55.837770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d065326-c5d9-4583-b1d5-3a0277fdd9f0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:55.848215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 912/1847] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:27:55.853469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab26c5-bf1a-4059-9ba4-7bc6f5e37992 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:55.863402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab26c5-bf1a-4059-9ba4-7bc6f5e37992 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:55.872357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a61fb-4aa9-4568-ad9e-2c3a9eb910df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:55.874119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a61fb-4aa9-4568-ad9e-2c3a9eb910df admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:55.874575 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a61fb-4aa9-4568-ad9e-2c3a9eb910df admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:55.874863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a61fb-4aa9-4568-ad9e-2c3a9eb910df admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:55.875601 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a61fb-4aa9-4568-ad9e-2c3a9eb910df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:55.877978 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a61fb-4aa9-4568-ad9e-2c3a9eb910df admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:55.899690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 936/1848] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:27:55.902433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d065326-c5d9-4583-b1d5-3a0277fdd9f0 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:55.917389 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d065326-c5d9-4583-b1d5-3a0277fdd9f0 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:55.924063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f0468-b781-40ad-a291-be3522be9a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:55.925229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f0468-b781-40ad-a291-be3522be9a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:55.925366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f0468-b781-40ad-a291-be3522be9a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:55.925688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f0468-b781-40ad-a291-be3522be9a40 admin admin] PATH_INFO: `/v3/projects/d174fc39745b4494b9fe6b3fd3d5723f/users/eda7f25dea584bbf88f6441c8ef02ca5/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:55.949105 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f0468-b781-40ad-a291-be3522be9a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d174fc39745b4494b9fe6b3fd3d5723f, user_id=eda7f25dea584bbf88f6441c8ef02ca5, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:55.956109 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f0468-b781-40ad-a291-be3522be9a40 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:56.010135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 913/1849] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:27:55 2022] PUT /identity/v3/projects/d174fc39745b4494b9fe6b3fd3d5723f/users/eda7f25dea584bbf88f6441c8ef02ca5/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:27:56.020434 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536650a-a567-4d74-82e8-60431754e10e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:56.020717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536650a-a567-4d74-82e8-60431754e10e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:56.021019 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536650a-a567-4d74-82e8-60431754e10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:56.076230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d536650a-a567-4d74-82e8-60431754e10e None None] MFA Rules not processed for user `eda7f25dea584bbf88f6441c8ef02ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:27:56.077486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d536650a-a567-4d74-82e8-60431754e10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:56.175432 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 937/1850] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:27:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:27:56.264581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f0468-b781-40ad-a291-be3522be9a40 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:27:56.268183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-190f0468-b781-40ad-a291-be3522be9a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:27:56.408960 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f0468-b781-40ad-a291-be3522be9a40 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:27:56.417557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65cde2-a279-4353-9a8f-6e6941a2ea0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:27:56.420956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65cde2-a279-4353-9a8f-6e6941a2ea0a service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:27:56.421623 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65cde2-a279-4353-9a8f-6e6941a2ea0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:27:56.422094 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65cde2-a279-4353-9a8f-6e6941a2ea0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:27:56.441589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65cde2-a279-4353-9a8f-6e6941a2ea0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:27:56.443761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65cde2-a279-4353-9a8f-6e6941a2ea0a service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:27:56.461125 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 914/1851] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:27:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:00.282546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536650a-a567-4d74-82e8-60431754e10e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:00.295166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536650a-a567-4d74-82e8-60431754e10e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:00.298773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77860f38-7469-43d3-9484-7ecf8f91e706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:00.299418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860f38-7469-43d3-9484-7ecf8f91e706 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:00.299699 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860f38-7469-43d3-9484-7ecf8f91e706 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:00.299974 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860f38-7469-43d3-9484-7ecf8f91e706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:00.301770 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-77860f38-7469-43d3-9484-7ecf8f91e706 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:00.370477 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77860f38-7469-43d3-9484-7ecf8f91e706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:00.371926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77860f38-7469-43d3-9484-7ecf8f91e706 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:00.382119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 938/1852] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:00.975691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65cde2-a279-4353-9a8f-6e6941a2ea0a service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:00.977179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-cc65cde2-a279-4353-9a8f-6e6941a2ea0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:01.048845 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65cde2-a279-4353-9a8f-6e6941a2ea0a service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:01.053677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700a723-c72a-4ff2-93a5-26e1c32a22a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:01.054522 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700a723-c72a-4ff2-93a5-26e1c32a22a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:01.054805 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700a723-c72a-4ff2-93a5-26e1c32a22a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:01.055084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700a723-c72a-4ff2-93a5-26e1c32a22a3 admin admin] PATH_INFO: `/v3/users/85082888e3df4eaf9bf1f5e8bdf31afa` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:01.056321 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700a723-c72a-4ff2-93a5-26e1c32a22a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85082888e3df4eaf9bf1f5e8bdf31afa)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:01.058281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700a723-c72a-4ff2-93a5-26e1c32a22a3 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:01.105352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4700a723-c72a-4ff2-93a5-26e1c32a22a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85082888e3df4eaf9bf1f5e8bdf31afa'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.106096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4700a723-c72a-4ff2-93a5-26e1c32a22a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85082888e3df4eaf9bf1f5e8bdf31afa'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.117803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4700a723-c72a-4ff2-93a5-26e1c32a22a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85082888e3df4eaf9bf1f5e8bdf31afa'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.124563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4700a723-c72a-4ff2-93a5-26e1c32a22a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85082888e3df4eaf9bf1f5e8bdf31afa'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.132205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4700a723-c72a-4ff2-93a5-26e1c32a22a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85082888e3df4eaf9bf1f5e8bdf31afa'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.138606 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 915/1853] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:00 2022] DELETE /identity/v3/users/85082888e3df4eaf9bf1f5e8bdf31afa => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:01.143096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef43371-d450-42dc-92fd-78ed53925a8c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:01.143459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef43371-d450-42dc-92fd-78ed53925a8c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:01.143766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef43371-d450-42dc-92fd-78ed53925a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:01.161685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5ef43371-d450-42dc-92fd-78ed53925a8c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:01.163492 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5ef43371-d450-42dc-92fd-78ed53925a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:01.216619 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 939/1854] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:01.226561 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700a723-c72a-4ff2-93a5-26e1c32a22a3 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:01.227929 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-4700a723-c72a-4ff2-93a5-26e1c32a22a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:01.283742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700a723-c72a-4ff2-93a5-26e1c32a22a3 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:01.288171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17767b9-3998-4642-85d9-7a083e3fa117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:01.288816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17767b9-3998-4642-85d9-7a083e3fa117 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:01.289130 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17767b9-3998-4642-85d9-7a083e3fa117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:01.289403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17767b9-3998-4642-85d9-7a083e3fa117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:01.298392 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17767b9-3998-4642-85d9-7a083e3fa117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:01.299853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17767b9-3998-4642-85d9-7a083e3fa117 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:01.309380 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 916/1855] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:01.590468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef43371-d450-42dc-92fd-78ed53925a8c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:01.592186 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5ef43371-d450-42dc-92fd-78ed53925a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:01.605459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef43371-d450-42dc-92fd-78ed53925a8c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:01.610469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:01.611336 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:01.611614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:01.611887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] PATH_INFO: `/v3/projects/674156efef514f63b5c1c6dda6ec7e09` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:01.613096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=674156efef514f63b5c1c6dda6ec7e09)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:01.615012 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:01.664312 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674156efef514f63b5c1c6dda6ec7e09', 'request_id': 'req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.670314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674156efef514f63b5c1c6dda6ec7e09', 'request_id': 'req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.676623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674156efef514f63b5c1c6dda6ec7e09', 'request_id': 'req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.692231 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] The token cache is being invalidate because project 674156efef514f63b5c1c6dda6ec7e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:01.692527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.693204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.695630 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 940/1856] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:01 2022] DELETE /identity/v3/projects/674156efef514f63b5c1c6dda6ec7e09 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:01.699353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17767b9-3998-4642-85d9-7a083e3fa117 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:01.709164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17767b9-3998-4642-85d9-7a083e3fa117 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:01.765585 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bcd01-cf53-440f-8291-cab201ea7c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:01.766465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bcd01-cf53-440f-8291-cab201ea7c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:01.766753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bcd01-cf53-440f-8291-cab201ea7c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:01.767051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bcd01-cf53-440f-8291-cab201ea7c2b admin admin] PATH_INFO: `/v3/users/89a6a26e5cd841248cec75863b856abf` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:01.768249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bcd01-cf53-440f-8291-cab201ea7c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a6a26e5cd841248cec75863b856abf)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:01.770191 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bcd01-cf53-440f-8291-cab201ea7c2b admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:01.815451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-196bcd01-cf53-440f-8291-cab201ea7c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a6a26e5cd841248cec75863b856abf'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.816110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-196bcd01-cf53-440f-8291-cab201ea7c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a6a26e5cd841248cec75863b856abf'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.827848 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-196bcd01-cf53-440f-8291-cab201ea7c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a6a26e5cd841248cec75863b856abf'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.834798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-196bcd01-cf53-440f-8291-cab201ea7c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a6a26e5cd841248cec75863b856abf'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.841966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-196bcd01-cf53-440f-8291-cab201ea7c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a6a26e5cd841248cec75863b856abf'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:01.847898 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 917/1857] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:01 2022] DELETE /identity/v3/users/89a6a26e5cd841248cec75863b856abf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:02.130248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:02.134557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:02.168726 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce79cb-da14-4358-b0b0-3f6ce8e0af54 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:02.238197 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4974bc-cc41-4af7-b621-e187b30d6771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:02.239257 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4974bc-cc41-4af7-b621-e187b30d6771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:02.239389 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4974bc-cc41-4af7-b621-e187b30d6771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:02.239590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4974bc-cc41-4af7-b621-e187b30d6771 admin admin] PATH_INFO: `/v3/projects/02ace63c95c4468b827a7784a12c4819` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:02.241462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4974bc-cc41-4af7-b621-e187b30d6771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ace63c95c4468b827a7784a12c4819)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:02.243458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4974bc-cc41-4af7-b621-e187b30d6771 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:02.294794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dc4974bc-cc41-4af7-b621-e187b30d6771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ace63c95c4468b827a7784a12c4819', 'request_id': 'req-dc4974bc-cc41-4af7-b621-e187b30d6771'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:02.299886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dc4974bc-cc41-4af7-b621-e187b30d6771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ace63c95c4468b827a7784a12c4819', 'request_id': 'req-dc4974bc-cc41-4af7-b621-e187b30d6771'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:02.306398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dc4974bc-cc41-4af7-b621-e187b30d6771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ace63c95c4468b827a7784a12c4819', 'request_id': 'req-dc4974bc-cc41-4af7-b621-e187b30d6771'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:02.318758 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dc4974bc-cc41-4af7-b621-e187b30d6771 admin admin] The token cache is being invalidate because project 02ace63c95c4468b827a7784a12c4819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:02.319044 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dc4974bc-cc41-4af7-b621-e187b30d6771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:02.319683 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dc4974bc-cc41-4af7-b621-e187b30d6771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:02.321253 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 941/1858] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:02 2022] DELETE /identity/v3/projects/02ace63c95c4468b827a7784a12c4819 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:02.326235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd007-3661-4f8f-a78b-9a565dbc954d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:02.326682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd007-3661-4f8f-a78b-9a565dbc954d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:02.326830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dd007-3661-4f8f-a78b-9a565dbc954d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:02.344260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-130dd007-3661-4f8f-a78b-9a565dbc954d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:02.345496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-130dd007-3661-4f8f-a78b-9a565dbc954d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:02.403956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 918/1859] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:28:02.411670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9e81-0b06-429e-9879-b724f0d5a23b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:02.411966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9e81-0b06-429e-9879-b724f0d5a23b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:02.412246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c9e81-0b06-429e-9879-b724f0d5a23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:02.431870 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1f7c9e81-0b06-429e-9879-b724f0d5a23b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:02.433000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1f7c9e81-0b06-429e-9879-b724f0d5a23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:02.440742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 942/1860] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:02.444880 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dd007-3661-4f8f-a78b-9a565dbc954d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:02.454221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dd007-3661-4f8f-a78b-9a565dbc954d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:02.458729 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2813654-3662-4559-9532-4a92ad3dcd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:02.459508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2813654-3662-4559-9532-4a92ad3dcd0f admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:02.459787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2813654-3662-4559-9532-4a92ad3dcd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:02.460175 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2813654-3662-4559-9532-4a92ad3dcd0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:02.461290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2813654-3662-4559-9532-4a92ad3dcd0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:28:02.461736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2813654-3662-4559-9532-4a92ad3dcd0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:02.463312 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2813654-3662-4559-9532-4a92ad3dcd0f admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:02.474732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 919/1861] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:28:02.479248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c9e81-0b06-429e-9879-b724f0d5a23b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:02.488115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c9e81-0b06-429e-9879-b724f0d5a23b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:02.493410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976bf5e-f297-44c9-baf4-8e0424504542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:02.493963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976bf5e-f297-44c9-baf4-8e0424504542 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:02.494277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976bf5e-f297-44c9-baf4-8e0424504542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:02.494507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976bf5e-f297-44c9-baf4-8e0424504542 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:02.495201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976bf5e-f297-44c9-baf4-8e0424504542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:02.497134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976bf5e-f297-44c9-baf4-8e0424504542 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:02.522587 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 943/1862] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:02 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:02.526867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2813654-3662-4559-9532-4a92ad3dcd0f admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:02.536388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2813654-3662-4559-9532-4a92ad3dcd0f admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:02.590007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365a81b-6d86-439e-ba30-505eebb98fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:02.590668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a81b-6d86-439e-ba30-505eebb98fac admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:02.590948 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a81b-6d86-439e-ba30-505eebb98fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:02.591232 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365a81b-6d86-439e-ba30-505eebb98fac admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:02.591907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365a81b-6d86-439e-ba30-505eebb98fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:02.593837 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1365a81b-6d86-439e-ba30-505eebb98fac admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:02.612403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 920/1863] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:02 2022] POST /identity/v3/users => generated 289 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:02.616494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976bf5e-f297-44c9-baf4-8e0424504542 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:02.626438 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976bf5e-f297-44c9-baf4-8e0424504542 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:02.631327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891b23f-38a7-4545-bca5-3b8e62bfd3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:02.631992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b23f-38a7-4545-bca5-3b8e62bfd3dd admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:02.632275 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b23f-38a7-4545-bca5-3b8e62bfd3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:02.632551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b23f-38a7-4545-bca5-3b8e62bfd3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:02.633310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891b23f-38a7-4545-bca5-3b8e62bfd3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:02.634937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891b23f-38a7-4545-bca5-3b8e62bfd3dd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:02.645056 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 944/1864] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:28:02.649510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365a81b-6d86-439e-ba30-505eebb98fac admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:02.659167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365a81b-6d86-439e-ba30-505eebb98fac admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:02.664732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0b6f7-20bc-486e-aa6e-8bbd963f1c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:02.665419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0b6f7-20bc-486e-aa6e-8bbd963f1c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:02.665700 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0b6f7-20bc-486e-aa6e-8bbd963f1c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:02.666001 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0b6f7-20bc-486e-aa6e-8bbd963f1c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:02.666722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0b6f7-20bc-486e-aa6e-8bbd963f1c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:02.668565 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0b6f7-20bc-486e-aa6e-8bbd963f1c0f admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:02.678764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 921/1865] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:02.684355 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891b23f-38a7-4545-bca5-3b8e62bfd3dd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:02.695333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891b23f-38a7-4545-bca5-3b8e62bfd3dd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:02.700029 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cebc9-4172-4dc3-bf63-47e7af8e168c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:02.700907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cebc9-4172-4dc3-bf63-47e7af8e168c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:02.701214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cebc9-4172-4dc3-bf63-47e7af8e168c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:02.701487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cebc9-4172-4dc3-bf63-47e7af8e168c admin admin] PATH_INFO: `/v3/projects/a5ae93ed677a45948d967eef3eb46102/users/6cbc68a71d9d4dff9cafef3faa17b961/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:02.716259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cebc9-4172-4dc3-bf63-47e7af8e168c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ae93ed677a45948d967eef3eb46102, user_id=6cbc68a71d9d4dff9cafef3faa17b961, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:02.718930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cebc9-4172-4dc3-bf63-47e7af8e168c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:02.732599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 945/1866] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:02 2022] PUT /identity/v3/projects/a5ae93ed677a45948d967eef3eb46102/users/6cbc68a71d9d4dff9cafef3faa17b961/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:02.742812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb058fa7-055e-47ab-8b18-fa3e9688d82a None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:02.743118 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb058fa7-055e-47ab-8b18-fa3e9688d82a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:02.743381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb058fa7-055e-47ab-8b18-fa3e9688d82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:02.769732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-bb058fa7-055e-47ab-8b18-fa3e9688d82a None None] MFA Rules not processed for user `6cbc68a71d9d4dff9cafef3faa17b961`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:02.770952 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-bb058fa7-055e-47ab-8b18-fa3e9688d82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:02.835898 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 922/1867] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:02.846509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cebc9-4172-4dc3-bf63-47e7af8e168c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:02.848185 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-016cebc9-4172-4dc3-bf63-47e7af8e168c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:02.908375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cebc9-4172-4dc3-bf63-47e7af8e168c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:02.911977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6c72b-d057-47b8-bf8f-26ca3e56be74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f59e7ae8da841dc809355fa8e4be488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:02.912725 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6c72b-d057-47b8-bf8f-26ca3e56be74 service glance] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:02.913029 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6c72b-d057-47b8-bf8f-26ca3e56be74 service glance] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:02.913310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6c72b-d057-47b8-bf8f-26ca3e56be74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:02.921498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6c72b-d057-47b8-bf8f-26ca3e56be74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:02.922921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6c72b-d057-47b8-bf8f-26ca3e56be74 service glance] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:02.931587 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 946/1868] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:23.745732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb058fa7-055e-47ab-8b18-fa3e9688d82a None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:23.747082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-bb058fa7-055e-47ab-8b18-fa3e9688d82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:23.816737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb058fa7-055e-47ab-8b18-fa3e9688d82a None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:23.822457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efdd6c-3181-4fb5-b3cd-dac7e6d3e999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:23.823330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efdd6c-3181-4fb5-b3cd-dac7e6d3e999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:23.823616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efdd6c-3181-4fb5-b3cd-dac7e6d3e999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:23.823893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efdd6c-3181-4fb5-b3cd-dac7e6d3e999 admin admin] PATH_INFO: `/v3/users/bde3e20446d444bd870958eca8baa08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:23.825163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efdd6c-3181-4fb5-b3cd-dac7e6d3e999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde3e20446d444bd870958eca8baa08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:23.827109 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efdd6c-3181-4fb5-b3cd-dac7e6d3e999 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:23.872122 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-53efdd6c-3181-4fb5-b3cd-dac7e6d3e999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde3e20446d444bd870958eca8baa08e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:23.872791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-53efdd6c-3181-4fb5-b3cd-dac7e6d3e999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde3e20446d444bd870958eca8baa08e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:23.884577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-53efdd6c-3181-4fb5-b3cd-dac7e6d3e999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde3e20446d444bd870958eca8baa08e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:23.891275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-53efdd6c-3181-4fb5-b3cd-dac7e6d3e999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde3e20446d444bd870958eca8baa08e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:23.899348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-53efdd6c-3181-4fb5-b3cd-dac7e6d3e999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde3e20446d444bd870958eca8baa08e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:23.906160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 923/1869] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:23 2022] DELETE /identity/v3/users/bde3e20446d444bd870958eca8baa08e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:23.910798 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92fdd6-6000-44b2-b180-c8eb020f24f7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:23.911323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92fdd6-6000-44b2-b180-c8eb020f24f7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:23.911421 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92fdd6-6000-44b2-b180-c8eb020f24f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:23.928739 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-da92fdd6-6000-44b2-b180-c8eb020f24f7 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:23.930600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-da92fdd6-6000-44b2-b180-c8eb020f24f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:23.987725 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 947/1870] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:23.998280 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efdd6c-3181-4fb5-b3cd-dac7e6d3e999 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:23.999612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-53efdd6c-3181-4fb5-b3cd-dac7e6d3e999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:24.057099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efdd6c-3181-4fb5-b3cd-dac7e6d3e999 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:24.060702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144760f-aa6b-4e6b-9460-7600f399ef2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:24.061389 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144760f-aa6b-4e6b-9460-7600f399ef2d service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:24.061677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144760f-aa6b-4e6b-9460-7600f399ef2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:24.061957 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144760f-aa6b-4e6b-9460-7600f399ef2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:24.071168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144760f-aa6b-4e6b-9460-7600f399ef2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:24.072588 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144760f-aa6b-4e6b-9460-7600f399ef2d service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:24.088300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 924/1871] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:24.344431 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92fdd6-6000-44b2-b180-c8eb020f24f7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:24.345915 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-da92fdd6-6000-44b2-b180-c8eb020f24f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:24.358570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92fdd6-6000-44b2-b180-c8eb020f24f7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:24.365127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:24.366416 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:24.366762 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:24.367162 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] PATH_INFO: `/v3/projects/86ce3a769a2d40999f21c8362774899c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:24.368782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ce3a769a2d40999f21c8362774899c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:24.371611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:24.434374 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ce3a769a2d40999f21c8362774899c', 'request_id': 'req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:24.440064 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ce3a769a2d40999f21c8362774899c', 'request_id': 'req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:24.446461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ce3a769a2d40999f21c8362774899c', 'request_id': 'req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:24.459322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] The token cache is being invalidate because project 86ce3a769a2d40999f21c8362774899c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:24.459613 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:24.460259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:24.463815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 948/1872] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:24 2022] DELETE /identity/v3/projects/86ce3a769a2d40999f21c8362774899c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:24.467886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144760f-aa6b-4e6b-9460-7600f399ef2d service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:24.477999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144760f-aa6b-4e6b-9460-7600f399ef2d service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:24.535221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40474d54-bb5b-4f40-9a0b-bc52daf81ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:24.536022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40474d54-bb5b-4f40-9a0b-bc52daf81ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:24.536310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40474d54-bb5b-4f40-9a0b-bc52daf81ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:24.536586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40474d54-bb5b-4f40-9a0b-bc52daf81ae8 admin admin] PATH_INFO: `/v3/users/2aefc5d5dbb347319d6bf6a9708ba0f1` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:24.537799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40474d54-bb5b-4f40-9a0b-bc52daf81ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aefc5d5dbb347319d6bf6a9708ba0f1)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:24.540273 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40474d54-bb5b-4f40-9a0b-bc52daf81ae8 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:24.585042 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-40474d54-bb5b-4f40-9a0b-bc52daf81ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aefc5d5dbb347319d6bf6a9708ba0f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:24.585753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-40474d54-bb5b-4f40-9a0b-bc52daf81ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aefc5d5dbb347319d6bf6a9708ba0f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:24.598280 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-40474d54-bb5b-4f40-9a0b-bc52daf81ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aefc5d5dbb347319d6bf6a9708ba0f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:24.605839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-40474d54-bb5b-4f40-9a0b-bc52daf81ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aefc5d5dbb347319d6bf6a9708ba0f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:24.613252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-40474d54-bb5b-4f40-9a0b-bc52daf81ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aefc5d5dbb347319d6bf6a9708ba0f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:24.619686 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 925/1873] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:24 2022] DELETE /identity/v3/users/2aefc5d5dbb347319d6bf6a9708ba0f1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:24.920697 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:24.922507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:24.938439 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dc00c-3893-4fa4-b0f6-7ba8d1822ef7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:25.013344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64402749-ff40-44e2-807a-97f789ed2249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:25.014364 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64402749-ff40-44e2-807a-97f789ed2249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.014778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64402749-ff40-44e2-807a-97f789ed2249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.015289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64402749-ff40-44e2-807a-97f789ed2249 admin admin] PATH_INFO: `/v3/projects/8a28446b83a6453a8aaca3e78afae4c6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.017687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64402749-ff40-44e2-807a-97f789ed2249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a28446b83a6453a8aaca3e78afae4c6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:25.019893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64402749-ff40-44e2-807a-97f789ed2249 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:25.077885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-64402749-ff40-44e2-807a-97f789ed2249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a28446b83a6453a8aaca3e78afae4c6', 'request_id': 'req-64402749-ff40-44e2-807a-97f789ed2249'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:25.084346 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-64402749-ff40-44e2-807a-97f789ed2249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a28446b83a6453a8aaca3e78afae4c6', 'request_id': 'req-64402749-ff40-44e2-807a-97f789ed2249'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:25.091527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-64402749-ff40-44e2-807a-97f789ed2249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a28446b83a6453a8aaca3e78afae4c6', 'request_id': 'req-64402749-ff40-44e2-807a-97f789ed2249'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:25.103581 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-64402749-ff40-44e2-807a-97f789ed2249 admin admin] The token cache is being invalidate because project 8a28446b83a6453a8aaca3e78afae4c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:25.103872 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-64402749-ff40-44e2-807a-97f789ed2249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:25.104527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-64402749-ff40-44e2-807a-97f789ed2249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:25.106088 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 949/1874] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:24 2022] DELETE /identity/v3/projects/8a28446b83a6453a8aaca3e78afae4c6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:25.110984 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05692ccc-69d5-4d44-9170-c9a56a592ba4 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.111449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05692ccc-69d5-4d44-9170-c9a56a592ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.111633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05692ccc-69d5-4d44-9170-c9a56a592ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.129660 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-05692ccc-69d5-4d44-9170-c9a56a592ba4 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:25.130877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-05692ccc-69d5-4d44-9170-c9a56a592ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:25.187203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 926/1875] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:25.195194 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ec2fd-0310-44c9-b250-6b1bc27a7229 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.195970 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ec2fd-0310-44c9-b250-6b1bc27a7229 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.196251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ec2fd-0310-44c9-b250-6b1bc27a7229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.213771 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-734ec2fd-0310-44c9-b250-6b1bc27a7229 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:25.214956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-734ec2fd-0310-44c9-b250-6b1bc27a7229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:25.222976 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 950/1876] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:25.227346 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05692ccc-69d5-4d44-9170-c9a56a592ba4 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:25.236825 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05692ccc-69d5-4d44-9170-c9a56a592ba4 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:25.241448 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce304628-6561-4be1-ae4f-cfcfa7041ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:25.242602 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce304628-6561-4be1-ae4f-cfcfa7041ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.242887 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce304628-6561-4be1-ae4f-cfcfa7041ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.243163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce304628-6561-4be1-ae4f-cfcfa7041ac7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.243918 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce304628-6561-4be1-ae4f-cfcfa7041ac7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:28:25.244228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce304628-6561-4be1-ae4f-cfcfa7041ac7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:25.245860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce304628-6561-4be1-ae4f-cfcfa7041ac7 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:25.257195 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 927/1877] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:28:25.261628 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ec2fd-0310-44c9-b250-6b1bc27a7229 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:25.270630 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ec2fd-0310-44c9-b250-6b1bc27a7229 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:25.275620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e87d23-8e17-4cfc-b002-b82be2417bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:25.276259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e87d23-8e17-4cfc-b002-b82be2417bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.276538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e87d23-8e17-4cfc-b002-b82be2417bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.276836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e87d23-8e17-4cfc-b002-b82be2417bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.277551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e87d23-8e17-4cfc-b002-b82be2417bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:25.279439 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e87d23-8e17-4cfc-b002-b82be2417bc0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:25.303616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 951/1878] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:25 2022] POST /identity/v3/projects => generated 379 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:25.307899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce304628-6561-4be1-ae4f-cfcfa7041ac7 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:25.317647 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce304628-6561-4be1-ae4f-cfcfa7041ac7 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:25.372799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27461b95-d674-4114-97f8-695579a29c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:25.373517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27461b95-d674-4114-97f8-695579a29c2a admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.373828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27461b95-d674-4114-97f8-695579a29c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.374107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27461b95-d674-4114-97f8-695579a29c2a admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.374842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27461b95-d674-4114-97f8-695579a29c2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:25.376777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27461b95-d674-4114-97f8-695579a29c2a admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:25.396374 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 928/1879] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:25 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:25.400781 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e87d23-8e17-4cfc-b002-b82be2417bc0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:25.410713 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e87d23-8e17-4cfc-b002-b82be2417bc0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:25.416540 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d666f8-90ed-4f18-a3c0-0692c029622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:25.417226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d666f8-90ed-4f18-a3c0-0692c029622d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.417533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d666f8-90ed-4f18-a3c0-0692c029622d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.417806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d666f8-90ed-4f18-a3c0-0692c029622d admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.418523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d666f8-90ed-4f18-a3c0-0692c029622d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:25.420104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d666f8-90ed-4f18-a3c0-0692c029622d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:25.430648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 952/1880] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:25.434314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27461b95-d674-4114-97f8-695579a29c2a admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:25.444107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27461b95-d674-4114-97f8-695579a29c2a admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:25.448715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d32d2-ad8f-438e-ba7d-6fd85983eec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:25.449396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d32d2-ad8f-438e-ba7d-6fd85983eec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.449683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d32d2-ad8f-438e-ba7d-6fd85983eec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.449959 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d32d2-ad8f-438e-ba7d-6fd85983eec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.450687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d32d2-ad8f-438e-ba7d-6fd85983eec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:25.452548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d32d2-ad8f-438e-ba7d-6fd85983eec0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:25.463022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 929/1881] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:25.466782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d666f8-90ed-4f18-a3c0-0692c029622d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:25.476133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d666f8-90ed-4f18-a3c0-0692c029622d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:25.481373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ab305-c882-4b83-b818-56d376558b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:25.482233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ab305-c882-4b83-b818-56d376558b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.482512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ab305-c882-4b83-b818-56d376558b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.482786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ab305-c882-4b83-b818-56d376558b58 admin admin] PATH_INFO: `/v3/projects/415d96c90cc742dba6bee8d4820af3e7/users/1f2204fd7da5455faafa7a9d9f8f468d/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.497909 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ab305-c882-4b83-b818-56d376558b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=415d96c90cc742dba6bee8d4820af3e7, user_id=1f2204fd7da5455faafa7a9d9f8f468d, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:25.501499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3ab305-c882-4b83-b818-56d376558b58 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:25.515361 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 953/1882] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:25 2022] PUT /identity/v3/projects/415d96c90cc742dba6bee8d4820af3e7/users/1f2204fd7da5455faafa7a9d9f8f468d/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:25.526836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156eff7f-0814-4be0-8d59-f62359ec58b8 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.527176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156eff7f-0814-4be0-8d59-f62359ec58b8 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.527482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156eff7f-0814-4be0-8d59-f62359ec58b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.553913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-156eff7f-0814-4be0-8d59-f62359ec58b8 None None] MFA Rules not processed for user `1f2204fd7da5455faafa7a9d9f8f468d`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:25.555091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-156eff7f-0814-4be0-8d59-f62359ec58b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:25.616363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 930/1883] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:25.620762 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ab305-c882-4b83-b818-56d376558b58 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:25.683000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ab305-c882-4b83-b818-56d376558b58 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:25.687222 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f53365-64f6-4ad8-a79f-f4387f53702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:25.688074 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f53365-64f6-4ad8-a79f-f4387f53702f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.688357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f53365-64f6-4ad8-a79f-f4387f53702f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.688634 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f53365-64f6-4ad8-a79f-f4387f53702f admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.689372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f53365-64f6-4ad8-a79f-f4387f53702f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:25.691273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f53365-64f6-4ad8-a79f-f4387f53702f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:25.717065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 954/1884] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:25 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:25.721230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156eff7f-0814-4be0-8d59-f62359ec58b8 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:25.731761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156eff7f-0814-4be0-8d59-f62359ec58b8 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:25.790920 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd22c1-b316-44a9-8f0d-5869efe44036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:25.791613 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd22c1-b316-44a9-8f0d-5869efe44036 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.791895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd22c1-b316-44a9-8f0d-5869efe44036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.792168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd22c1-b316-44a9-8f0d-5869efe44036 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.792867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd22c1-b316-44a9-8f0d-5869efe44036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:25.794809 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd22c1-b316-44a9-8f0d-5869efe44036 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:25.815624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 931/1885] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:25 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:25.819581 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f53365-64f6-4ad8-a79f-f4387f53702f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:25.830014 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f53365-64f6-4ad8-a79f-f4387f53702f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:25.834621 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36486670-9590-4fba-8b2f-1f3b59fd55fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:25.835277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36486670-9590-4fba-8b2f-1f3b59fd55fc admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.835562 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36486670-9590-4fba-8b2f-1f3b59fd55fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.837671 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36486670-9590-4fba-8b2f-1f3b59fd55fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.837671 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36486670-9590-4fba-8b2f-1f3b59fd55fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:25.838762 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36486670-9590-4fba-8b2f-1f3b59fd55fc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:25.850057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 955/1886] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:25.855390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd22c1-b316-44a9-8f0d-5869efe44036 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:25.865553 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd22c1-b316-44a9-8f0d-5869efe44036 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:25.870463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c50d91-372a-47b9-be36-60b47777c3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:25.871354 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c50d91-372a-47b9-be36-60b47777c3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.871642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c50d91-372a-47b9-be36-60b47777c3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.871922 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c50d91-372a-47b9-be36-60b47777c3e6 admin admin] PATH_INFO: `/v3/projects/20faaba3775846409b7906eaf199a29c/users/c5a5bc2500bd42b1bf3ccd218ed513d8/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.890126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c50d91-372a-47b9-be36-60b47777c3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20faaba3775846409b7906eaf199a29c, user_id=c5a5bc2500bd42b1bf3ccd218ed513d8, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:25.892768 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c50d91-372a-47b9-be36-60b47777c3e6 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:25.910255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 932/1887] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:25 2022] PUT /identity/v3/projects/20faaba3775846409b7906eaf199a29c/users/c5a5bc2500bd42b1bf3ccd218ed513d8/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:25.914570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36486670-9590-4fba-8b2f-1f3b59fd55fc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:25.924616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36486670-9590-4fba-8b2f-1f3b59fd55fc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:25.981454 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4b10e-e121-4891-a41f-3f6333fa1d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:25.982263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4b10e-e121-4891-a41f-3f6333fa1d47 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:25.982658 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4b10e-e121-4891-a41f-3f6333fa1d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:25.982942 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4b10e-e121-4891-a41f-3f6333fa1d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:25.983854 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4b10e-e121-4891-a41f-3f6333fa1d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:25.985324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4b10e-e121-4891-a41f-3f6333fa1d47 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:25.999960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 956/1888] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:26.002786 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c50d91-372a-47b9-be36-60b47777c3e6 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:26.013214 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c50d91-372a-47b9-be36-60b47777c3e6 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:26.017949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc7d12-0481-4ff7-9049-17560d5a1554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:26.018830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc7d12-0481-4ff7-9049-17560d5a1554 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:26.019116 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc7d12-0481-4ff7-9049-17560d5a1554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:26.019396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc7d12-0481-4ff7-9049-17560d5a1554 admin admin] PATH_INFO: `/v3/projects/20faaba3775846409b7906eaf199a29c/users/c5a5bc2500bd42b1bf3ccd218ed513d8/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:26.021443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc7d12-0481-4ff7-9049-17560d5a1554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20faaba3775846409b7906eaf199a29c, user_id=c5a5bc2500bd42b1bf3ccd218ed513d8, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:26.024880 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc7d12-0481-4ff7-9049-17560d5a1554 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:26.035307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 933/1889] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:26 2022] PUT /identity/v3/projects/20faaba3775846409b7906eaf199a29c/users/c5a5bc2500bd42b1bf3ccd218ed513d8/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:26.046096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03499b4-ca0b-40a5-9022-a1695122d74f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:26.046387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03499b4-ca0b-40a5-9022-a1695122d74f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:26.046668 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03499b4-ca0b-40a5-9022-a1695122d74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:26.072280 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a03499b4-ca0b-40a5-9022-a1695122d74f None None] MFA Rules not processed for user `c5a5bc2500bd42b1bf3ccd218ed513d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:26.074071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a03499b4-ca0b-40a5-9022-a1695122d74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:26.145732 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 957/1890] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:26.157635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc7d12-0481-4ff7-9049-17560d5a1554 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:26.160198 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-10fc7d12-0481-4ff7-9049-17560d5a1554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:26.215181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc7d12-0481-4ff7-9049-17560d5a1554 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:26.219388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69163dbd-492f-4d2b-bc72-7414bda1b80c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:26.220687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69163dbd-492f-4d2b-bc72-7414bda1b80c service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:26.221255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69163dbd-492f-4d2b-bc72-7414bda1b80c service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:26.221721 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69163dbd-492f-4d2b-bc72-7414bda1b80c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:26.231294 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69163dbd-492f-4d2b-bc72-7414bda1b80c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:26.232739 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69163dbd-492f-4d2b-bc72-7414bda1b80c service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:26.242290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 934/1891] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:26.315924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03499b4-ca0b-40a5-9022-a1695122d74f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:26.325875 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03499b4-ca0b-40a5-9022-a1695122d74f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:26.329446 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3e0e8-2243-4e5e-9286-2e7b2de56426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:26.330086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3e0e8-2243-4e5e-9286-2e7b2de56426 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:26.330370 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3e0e8-2243-4e5e-9286-2e7b2de56426 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:26.330677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3e0e8-2243-4e5e-9286-2e7b2de56426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:26.384843 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3e0e8-2243-4e5e-9286-2e7b2de56426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:26.386320 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3e0e8-2243-4e5e-9286-2e7b2de56426 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:26.395188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 958/1892] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:38.552355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69163dbd-492f-4d2b-bc72-7414bda1b80c service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:38.553824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-69163dbd-492f-4d2b-bc72-7414bda1b80c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:38.625128 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69163dbd-492f-4d2b-bc72-7414bda1b80c service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:38.630316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25361d1b-f140-40f8-9f48-040f4dc144df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:38.631787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361d1b-f140-40f8-9f48-040f4dc144df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:38.632164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361d1b-f140-40f8-9f48-040f4dc144df admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:38.632864 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25361d1b-f140-40f8-9f48-040f4dc144df admin admin] PATH_INFO: `/v3/users/6cbc68a71d9d4dff9cafef3faa17b961` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:38.635360 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25361d1b-f140-40f8-9f48-040f4dc144df admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cbc68a71d9d4dff9cafef3faa17b961)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:38.637875 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25361d1b-f140-40f8-9f48-040f4dc144df admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:38.714709 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-25361d1b-f140-40f8-9f48-040f4dc144df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cbc68a71d9d4dff9cafef3faa17b961'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:38.715912 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-25361d1b-f140-40f8-9f48-040f4dc144df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cbc68a71d9d4dff9cafef3faa17b961'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:38.733475 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-25361d1b-f140-40f8-9f48-040f4dc144df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cbc68a71d9d4dff9cafef3faa17b961'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:38.740275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-25361d1b-f140-40f8-9f48-040f4dc144df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cbc68a71d9d4dff9cafef3faa17b961'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:38.747696 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-25361d1b-f140-40f8-9f48-040f4dc144df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cbc68a71d9d4dff9cafef3faa17b961'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:38.753822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 935/1893] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:38 2022] DELETE /identity/v3/users/6cbc68a71d9d4dff9cafef3faa17b961 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:38.758474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4a732-a565-413e-9c7d-2487eadaf5fa None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:38.759330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4a732-a565-413e-9c7d-2487eadaf5fa None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:38.759612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4a732-a565-413e-9c7d-2487eadaf5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:38.777873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e5d4a732-a565-413e-9c7d-2487eadaf5fa None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:38.779055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e5d4a732-a565-413e-9c7d-2487eadaf5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:38.838112 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 959/1894] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:38.847540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25361d1b-f140-40f8-9f48-040f4dc144df admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:38.849025 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-25361d1b-f140-40f8-9f48-040f4dc144df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:38.914177 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25361d1b-f140-40f8-9f48-040f4dc144df admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:38.918084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a2832-6da9-45d7-b8c3-f07a1301b87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:38.918741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a2832-6da9-45d7-b8c3-f07a1301b87d service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:38.919021 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a2832-6da9-45d7-b8c3-f07a1301b87d service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:38.919301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a2832-6da9-45d7-b8c3-f07a1301b87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:38.928852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a2832-6da9-45d7-b8c3-f07a1301b87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:38.930901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a2832-6da9-45d7-b8c3-f07a1301b87d service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:38.955951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 936/1895] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:39.076139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4a732-a565-413e-9c7d-2487eadaf5fa None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:39.077922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e5d4a732-a565-413e-9c7d-2487eadaf5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:39.091143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4a732-a565-413e-9c7d-2487eadaf5fa None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:39.096243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f2d11-8586-49bc-8e76-95826fb7928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:39.097415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f2d11-8586-49bc-8e76-95826fb7928b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:39.097703 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f2d11-8586-49bc-8e76-95826fb7928b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:39.097983 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f2d11-8586-49bc-8e76-95826fb7928b admin admin] PATH_INFO: `/v3/users/b8d228420e354a988a8d010406b7005e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:39.099421 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f2d11-8586-49bc-8e76-95826fb7928b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d228420e354a988a8d010406b7005e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:39.102015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f2d11-8586-49bc-8e76-95826fb7928b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:39.150158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f95f2d11-8586-49bc-8e76-95826fb7928b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d228420e354a988a8d010406b7005e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:39.161989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f95f2d11-8586-49bc-8e76-95826fb7928b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d228420e354a988a8d010406b7005e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:39.169229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f95f2d11-8586-49bc-8e76-95826fb7928b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d228420e354a988a8d010406b7005e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:39.169943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f95f2d11-8586-49bc-8e76-95826fb7928b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d228420e354a988a8d010406b7005e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:39.180145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f95f2d11-8586-49bc-8e76-95826fb7928b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d228420e354a988a8d010406b7005e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:39.187836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 960/1896] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:39 2022] DELETE /identity/v3/users/b8d228420e354a988a8d010406b7005e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:39.192343 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be771869-9f05-48f4-81e5-c777ee19742f None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:39.192639 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be771869-9f05-48f4-81e5-c777ee19742f None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:39.192924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be771869-9f05-48f4-81e5-c777ee19742f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:39.214065 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-be771869-9f05-48f4-81e5-c777ee19742f None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:39.215282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-be771869-9f05-48f4-81e5-c777ee19742f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:39.288203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 937/1897] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:39.294613 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f2d11-8586-49bc-8e76-95826fb7928b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:39.296348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f95f2d11-8586-49bc-8e76-95826fb7928b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:39.317841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be771869-9f05-48f4-81e5-c777ee19742f None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:39.320328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-be771869-9f05-48f4-81e5-c777ee19742f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:39.338795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be771869-9f05-48f4-81e5-c777ee19742f None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:39.343637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da7898-634a-4fb5-9308-aacf2083ef0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:39.344896 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da7898-634a-4fb5-9308-aacf2083ef0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:39.345351 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da7898-634a-4fb5-9308-aacf2083ef0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:39.345784 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da7898-634a-4fb5-9308-aacf2083ef0e admin admin] PATH_INFO: `/v3/projects/a5ae93ed677a45948d967eef3eb46102` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:39.347339 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da7898-634a-4fb5-9308-aacf2083ef0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ae93ed677a45948d967eef3eb46102)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:39.350091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da7898-634a-4fb5-9308-aacf2083ef0e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:39.379204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f2d11-8586-49bc-8e76-95826fb7928b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:39.383565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6af898-62cb-487d-bf08-0fc0877fceb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:39.384740 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6af898-62cb-487d-bf08-0fc0877fceb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:39.385861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6af898-62cb-487d-bf08-0fc0877fceb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:39.386354 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6af898-62cb-487d-bf08-0fc0877fceb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:39.397204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6af898-62cb-487d-bf08-0fc0877fceb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:39.399923 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6af898-62cb-487d-bf08-0fc0877fceb4 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:39.411020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 961/1898] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:28:39.430034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-47da7898-634a-4fb5-9308-aacf2083ef0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ae93ed677a45948d967eef3eb46102', 'request_id': 'req-47da7898-634a-4fb5-9308-aacf2083ef0e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:39.441534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-47da7898-634a-4fb5-9308-aacf2083ef0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ae93ed677a45948d967eef3eb46102', 'request_id': 'req-47da7898-634a-4fb5-9308-aacf2083ef0e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:39.453388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-47da7898-634a-4fb5-9308-aacf2083ef0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ae93ed677a45948d967eef3eb46102', 'request_id': 'req-47da7898-634a-4fb5-9308-aacf2083ef0e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:39.466373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-47da7898-634a-4fb5-9308-aacf2083ef0e admin admin] The token cache is being invalidate because project a5ae93ed677a45948d967eef3eb46102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:39.466675 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-47da7898-634a-4fb5-9308-aacf2083ef0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:39.467332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-47da7898-634a-4fb5-9308-aacf2083ef0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:39.469064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 938/1899] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:39 2022] DELETE /identity/v3/projects/a5ae93ed677a45948d967eef3eb46102 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:39.473821 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431814aa-5d20-4442-a0e2-07b5e882616c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:39.474110 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431814aa-5d20-4442-a0e2-07b5e882616c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:39.474388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431814aa-5d20-4442-a0e2-07b5e882616c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:39.496387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-431814aa-5d20-4442-a0e2-07b5e882616c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:39.497987 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-431814aa-5d20-4442-a0e2-07b5e882616c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:39.608023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 962/1900] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:39.616937 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81359c6-7710-41c6-89a5-6410f2412bdb None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:39.617433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81359c6-7710-41c6-89a5-6410f2412bdb None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:39.617611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81359c6-7710-41c6-89a5-6410f2412bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:39.646115 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-c81359c6-7710-41c6-89a5-6410f2412bdb None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:39.649281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c81359c6-7710-41c6-89a5-6410f2412bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:39.659126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 939/1901] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:39.663188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431814aa-5d20-4442-a0e2-07b5e882616c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:39.674109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431814aa-5d20-4442-a0e2-07b5e882616c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:39.679082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3e91e-1335-4633-886a-2e1d001f02ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:39.679786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3e91e-1335-4633-886a-2e1d001f02ff admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:39.680126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3e91e-1335-4633-886a-2e1d001f02ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:39.680390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3e91e-1335-4633-886a-2e1d001f02ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:39.681133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3e91e-1335-4633-886a-2e1d001f02ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:28:39.681447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3e91e-1335-4633-886a-2e1d001f02ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:39.683085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3e91e-1335-4633-886a-2e1d001f02ff admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:39.700006 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 963/1902] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:28:39.701301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81359c6-7710-41c6-89a5-6410f2412bdb None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:39.715856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81359c6-7710-41c6-89a5-6410f2412bdb None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:39.720827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de968b-9f67-413b-96bf-09479616cb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:39.721545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de968b-9f67-413b-96bf-09479616cb30 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:39.721838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de968b-9f67-413b-96bf-09479616cb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:39.722115 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de968b-9f67-413b-96bf-09479616cb30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:39.722811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de968b-9f67-413b-96bf-09479616cb30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:39.724871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de968b-9f67-413b-96bf-09479616cb30 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:39.769018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 940/1903] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:39 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:39.770763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3e91e-1335-4633-886a-2e1d001f02ff admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:39.782583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3e91e-1335-4633-886a-2e1d001f02ff admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:39.850233 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de968b-9f67-413b-96bf-09479616cb30 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:39.853213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-78de968b-9f67-413b-96bf-09479616cb30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:39.871900 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b5540-03cd-4369-b450-161ec4d3598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:39.872721 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b5540-03cd-4369-b450-161ec4d3598c admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:39.873033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b5540-03cd-4369-b450-161ec4d3598c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:39.873671 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b5540-03cd-4369-b450-161ec4d3598c admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:39.874579 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b5540-03cd-4369-b450-161ec4d3598c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:39.876874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b5540-03cd-4369-b450-161ec4d3598c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:39.902267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 964/1904] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:39 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:39.902267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b5540-03cd-4369-b450-161ec4d3598c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:39.902953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6a0b5540-03cd-4369-b450-161ec4d3598c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:39.920282 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b5540-03cd-4369-b450-161ec4d3598c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:39.925970 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de225482-fc0c-4620-a82b-b7d9b986c1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:39.927059 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de225482-fc0c-4620-a82b-b7d9b986c1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:39.927157 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de225482-fc0c-4620-a82b-b7d9b986c1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:39.927387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de225482-fc0c-4620-a82b-b7d9b986c1ca admin admin] PATH_INFO: `/v3/users/eda7f25dea584bbf88f6441c8ef02ca5` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:39.928895 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de225482-fc0c-4620-a82b-b7d9b986c1ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda7f25dea584bbf88f6441c8ef02ca5)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:39.931768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de225482-fc0c-4620-a82b-b7d9b986c1ca admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:39.962576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de968b-9f67-413b-96bf-09479616cb30 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:39.973164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:39.973164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:39.973164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:39.973164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b admin admin] PATH_INFO: `/v3/projects/3446cc29ac254efe8933be7eda3bd1ed` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:39.973472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3446cc29ac254efe8933be7eda3bd1ed)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:39.974804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:40.008066 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-de225482-fc0c-4620-a82b-b7d9b986c1ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda7f25dea584bbf88f6441c8ef02ca5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.025128 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-de225482-fc0c-4620-a82b-b7d9b986c1ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda7f25dea584bbf88f6441c8ef02ca5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.039128 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-de225482-fc0c-4620-a82b-b7d9b986c1ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda7f25dea584bbf88f6441c8ef02ca5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.039825 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-de225482-fc0c-4620-a82b-b7d9b986c1ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda7f25dea584bbf88f6441c8ef02ca5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.049259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-de225482-fc0c-4620-a82b-b7d9b986c1ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda7f25dea584bbf88f6441c8ef02ca5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.050031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3446cc29ac254efe8933be7eda3bd1ed', 'request_id': 'req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.057425 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 965/1905] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:39 2022] DELETE /identity/v3/users/eda7f25dea584bbf88f6441c8ef02ca5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:40.058093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3446cc29ac254efe8933be7eda3bd1ed', 'request_id': 'req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.058474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de225482-fc0c-4620-a82b-b7d9b986c1ca admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:40.059792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-de225482-fc0c-4620-a82b-b7d9b986c1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:40.067891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3446cc29ac254efe8933be7eda3bd1ed', 'request_id': 'req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.087926 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b admin admin] The token cache is being invalidate because project 3446cc29ac254efe8933be7eda3bd1ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:40.090093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.091395 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c5ea1b89-d9e9-4603-84c1-3dc16fe9b30b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.095823 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 941/1906] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:39 2022] DELETE /identity/v3/projects/3446cc29ac254efe8933be7eda3bd1ed => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:40.099184 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68b026-eeb3-4189-affd-2435e1289b63 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:40.100530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68b026-eeb3-4189-affd-2435e1289b63 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:40.101840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68b026-eeb3-4189-affd-2435e1289b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:40.137226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de225482-fc0c-4620-a82b-b7d9b986c1ca admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:40.141915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-fb68b026-eeb3-4189-affd-2435e1289b63 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:40.142953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1c307-acaa-4116-b27c-6c97d1885448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:40.143450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fb68b026-eeb3-4189-affd-2435e1289b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:40.143635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1c307-acaa-4116-b27c-6c97d1885448 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:40.143913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1c307-acaa-4116-b27c-6c97d1885448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:40.144952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1c307-acaa-4116-b27c-6c97d1885448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:40.145745 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1c307-acaa-4116-b27c-6c97d1885448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:40.148803 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1c307-acaa-4116-b27c-6c97d1885448 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:40.157825 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 942/1907] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:40.158874 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68b026-eeb3-4189-affd-2435e1289b63 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:40.160223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fb68b026-eeb3-4189-affd-2435e1289b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:40.165190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 966/1908] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:40.167650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1c307-acaa-4116-b27c-6c97d1885448 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:40.169787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3aa1c307-acaa-4116-b27c-6c97d1885448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:40.176271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68b026-eeb3-4189-affd-2435e1289b63 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:40.183901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dcb61-bbc2-42a3-a4b2-13ccc59f94c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:40.184056 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1c307-acaa-4116-b27c-6c97d1885448 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:40.184934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dcb61-bbc2-42a3-a4b2-13ccc59f94c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:40.185346 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dcb61-bbc2-42a3-a4b2-13ccc59f94c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:40.185720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453dcb61-bbc2-42a3-a4b2-13ccc59f94c1 admin admin] PATH_INFO: `/v3/users/d7ac6fc4b2ac4554aad9ef4304c274cc` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:40.186946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dcb61-bbc2-42a3-a4b2-13ccc59f94c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ac6fc4b2ac4554aad9ef4304c274cc)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:40.189178 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453dcb61-bbc2-42a3-a4b2-13ccc59f94c1 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:40.189531 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a056f0-e6c3-4255-8217-2ad048168e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:40.190323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a056f0-e6c3-4255-8217-2ad048168e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:40.190857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a056f0-e6c3-4255-8217-2ad048168e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:40.191244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a056f0-e6c3-4255-8217-2ad048168e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:40.192341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a056f0-e6c3-4255-8217-2ad048168e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:40.195459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a056f0-e6c3-4255-8217-2ad048168e76 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:40.213562 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 967/1909] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:40.214461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a056f0-e6c3-4255-8217-2ad048168e76 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:40.217239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-11a056f0-e6c3-4255-8217-2ad048168e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:40.260094 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-453dcb61-bbc2-42a3-a4b2-13ccc59f94c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ac6fc4b2ac4554aad9ef4304c274cc'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.260824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-453dcb61-bbc2-42a3-a4b2-13ccc59f94c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ac6fc4b2ac4554aad9ef4304c274cc'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.287833 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-453dcb61-bbc2-42a3-a4b2-13ccc59f94c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ac6fc4b2ac4554aad9ef4304c274cc'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.289596 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a056f0-e6c3-4255-8217-2ad048168e76 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:40.293814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ff362-d58c-435c-b156-ad4e0c449298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:40.294586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ff362-d58c-435c-b156-ad4e0c449298 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:40.294832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ff362-d58c-435c-b156-ad4e0c449298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:40.295119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ff362-d58c-435c-b156-ad4e0c449298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:40.296379 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-453dcb61-bbc2-42a3-a4b2-13ccc59f94c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ac6fc4b2ac4554aad9ef4304c274cc'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.297001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-314ff362-d58c-435c-b156-ad4e0c449298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:40.305554 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-453dcb61-bbc2-42a3-a4b2-13ccc59f94c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ac6fc4b2ac4554aad9ef4304c274cc'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:40.313509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ff362-d58c-435c-b156-ad4e0c449298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:40.314995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ff362-d58c-435c-b156-ad4e0c449298 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:40.319304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 943/1910] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:40 2022] DELETE /identity/v3/users/d7ac6fc4b2ac4554aad9ef4304c274cc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:40.319304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dcb61-bbc2-42a3-a4b2-13ccc59f94c1 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:40.320938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-453dcb61-bbc2-42a3-a4b2-13ccc59f94c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:40.339080 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 968/1911] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:40.415199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453dcb61-bbc2-42a3-a4b2-13ccc59f94c1 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:40.421015 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436cdc7-6d23-4ef4-83af-b5cc33cfc4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:40.421954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436cdc7-6d23-4ef4-83af-b5cc33cfc4a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:40.422313 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436cdc7-6d23-4ef4-83af-b5cc33cfc4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:40.422794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436cdc7-6d23-4ef4-83af-b5cc33cfc4a3 admin admin] PATH_INFO: `/v3/projects/dfb02902e5b849c388f6c1a3d70b5904/users/3bf23da251f64f01bce23135fdd5e4f4/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:40.442158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436cdc7-6d23-4ef4-83af-b5cc33cfc4a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb02902e5b849c388f6c1a3d70b5904, user_id=3bf23da251f64f01bce23135fdd5e4f4, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:40.445478 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436cdc7-6d23-4ef4-83af-b5cc33cfc4a3 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:40.463730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 944/1912] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:40 2022] PUT /identity/v3/projects/dfb02902e5b849c388f6c1a3d70b5904/users/3bf23da251f64f01bce23135fdd5e4f4/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:40.472647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375fd52-73a5-4556-952a-07392549ceba None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:40.472942 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375fd52-73a5-4556-952a-07392549ceba None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:40.473406 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375fd52-73a5-4556-952a-07392549ceba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:40.527323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4375fd52-73a5-4556-952a-07392549ceba None None] MFA Rules not processed for user `3bf23da251f64f01bce23135fdd5e4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:40.529556 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4375fd52-73a5-4556-952a-07392549ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:40.638498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 969/1913] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:40.651461 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436cdc7-6d23-4ef4-83af-b5cc33cfc4a3 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:40.653764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-1436cdc7-6d23-4ef4-83af-b5cc33cfc4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:40.735446 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436cdc7-6d23-4ef4-83af-b5cc33cfc4a3 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:40.743157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e973db-ee61-48e9-81ec-1f682f24849b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:40.743902 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e973db-ee61-48e9-81ec-1f682f24849b service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:40.744253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e973db-ee61-48e9-81ec-1f682f24849b service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:40.744487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e973db-ee61-48e9-81ec-1f682f24849b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:40.756561 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e973db-ee61-48e9-81ec-1f682f24849b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:40.758232 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e973db-ee61-48e9-81ec-1f682f24849b service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:40.808939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375fd52-73a5-4556-952a-07392549ceba None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:40.810254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 945/1914] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:40.810402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4375fd52-73a5-4556-952a-07392549ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:40.896770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e973db-ee61-48e9-81ec-1f682f24849b service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:40.899081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-93e973db-ee61-48e9-81ec-1f682f24849b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:40.944198 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375fd52-73a5-4556-952a-07392549ceba None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:40.955744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22df67f-0c9b-42af-b263-6aab4f1abc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:40.956629 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22df67f-0c9b-42af-b263-6aab4f1abc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:40.956914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22df67f-0c9b-42af-b263-6aab4f1abc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:40.957215 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22df67f-0c9b-42af-b263-6aab4f1abc84 admin admin] PATH_INFO: `/v3/users/1f2204fd7da5455faafa7a9d9f8f468d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:40.958884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22df67f-0c9b-42af-b263-6aab4f1abc84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f2204fd7da5455faafa7a9d9f8f468d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:40.962886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22df67f-0c9b-42af-b263-6aab4f1abc84 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:41.045848 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e973db-ee61-48e9-81ec-1f682f24849b service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:41.055251 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:41.056389 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.056543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.056831 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] PATH_INFO: `/v3/projects/d174fc39745b4494b9fe6b3fd3d5723f` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.059038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b22df67f-0c9b-42af-b263-6aab4f1abc84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f2204fd7da5455faafa7a9d9f8f468d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.060621 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d174fc39745b4494b9fe6b3fd3d5723f)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:41.063678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:41.082574 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b22df67f-0c9b-42af-b263-6aab4f1abc84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f2204fd7da5455faafa7a9d9f8f468d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.090407 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b22df67f-0c9b-42af-b263-6aab4f1abc84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f2204fd7da5455faafa7a9d9f8f468d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.091212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b22df67f-0c9b-42af-b263-6aab4f1abc84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f2204fd7da5455faafa7a9d9f8f468d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.099787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b22df67f-0c9b-42af-b263-6aab4f1abc84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f2204fd7da5455faafa7a9d9f8f468d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.111004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 970/1915] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:40 2022] DELETE /identity/v3/users/1f2204fd7da5455faafa7a9d9f8f468d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:41.117816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698b601-ecb1-4fd1-bb5d-f5007a5ab522 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.118292 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698b601-ecb1-4fd1-bb5d-f5007a5ab522 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.118732 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698b601-ecb1-4fd1-bb5d-f5007a5ab522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.141893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-6698b601-ecb1-4fd1-bb5d-f5007a5ab522 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:41.145244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6698b601-ecb1-4fd1-bb5d-f5007a5ab522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:41.168833 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd174fc39745b4494b9fe6b3fd3d5723f', 'request_id': 'req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.181486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd174fc39745b4494b9fe6b3fd3d5723f', 'request_id': 'req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.191150 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd174fc39745b4494b9fe6b3fd3d5723f', 'request_id': 'req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.210466 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] The token cache is being invalidate because project d174fc39745b4494b9fe6b3fd3d5723f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:41.211085 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.212679 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.217305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 946/1916] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:40 2022] DELETE /identity/v3/projects/d174fc39745b4494b9fe6b3fd3d5723f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:41.219710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:41.222605 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:41.248591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 971/1917] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:41.249934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d7629-f19c-49f6-8240-235ee7d32550 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.250226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d7629-f19c-49f6-8240-235ee7d32550 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.250509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d7629-f19c-49f6-8240-235ee7d32550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.287262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-743d7629-f19c-49f6-8240-235ee7d32550 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:41.289136 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-743d7629-f19c-49f6-8240-235ee7d32550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:41.304607 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 972/1918] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:41.305602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d7629-f19c-49f6-8240-235ee7d32550 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:41.314124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-743d7629-f19c-49f6-8240-235ee7d32550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:41.376335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad42bd-a23c-4dbd-aa31-2b258d53e92f admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:41.395854 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e59d82-c298-4009-9032-48bf9b39e0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:41.396854 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e59d82-c298-4009-9032-48bf9b39e0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.397233 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e59d82-c298-4009-9032-48bf9b39e0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.397864 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e59d82-c298-4009-9032-48bf9b39e0d2 admin admin] PATH_INFO: `/v3/projects/c5006e59f0bf4fec9ede74aedd9050fb` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.399199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e59d82-c298-4009-9032-48bf9b39e0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5006e59f0bf4fec9ede74aedd9050fb)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:41.401266 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e59d82-c298-4009-9032-48bf9b39e0d2 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:41.411304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d7629-f19c-49f6-8240-235ee7d32550 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:41.417205 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffc3a6-70dc-40b8-a441-64bfa910d494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:41.417639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffc3a6-70dc-40b8-a441-64bfa910d494 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.417869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffc3a6-70dc-40b8-a441-64bfa910d494 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.418245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffc3a6-70dc-40b8-a441-64bfa910d494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.427797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffc3a6-70dc-40b8-a441-64bfa910d494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:41.430000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffc3a6-70dc-40b8-a441-64bfa910d494 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:41.441930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 973/1919] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:41.443214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab532f-70f6-4ec7-9e9b-635f82c777e1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.443503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab532f-70f6-4ec7-9e9b-635f82c777e1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.443780 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab532f-70f6-4ec7-9e9b-635f82c777e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.463968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-bfab532f-70f6-4ec7-9e9b-635f82c777e1 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:41.465181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bfab532f-70f6-4ec7-9e9b-635f82c777e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:41.467106 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-84e59d82-c298-4009-9032-48bf9b39e0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5006e59f0bf4fec9ede74aedd9050fb', 'request_id': 'req-84e59d82-c298-4009-9032-48bf9b39e0d2'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.478164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-84e59d82-c298-4009-9032-48bf9b39e0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5006e59f0bf4fec9ede74aedd9050fb', 'request_id': 'req-84e59d82-c298-4009-9032-48bf9b39e0d2'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.487654 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-84e59d82-c298-4009-9032-48bf9b39e0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5006e59f0bf4fec9ede74aedd9050fb', 'request_id': 'req-84e59d82-c298-4009-9032-48bf9b39e0d2'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.505398 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-84e59d82-c298-4009-9032-48bf9b39e0d2 admin admin] The token cache is being invalidate because project c5006e59f0bf4fec9ede74aedd9050fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:41.505696 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-84e59d82-c298-4009-9032-48bf9b39e0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.506446 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-84e59d82-c298-4009-9032-48bf9b39e0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.508556 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 947/1920] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:41 2022] DELETE /identity/v3/projects/c5006e59f0bf4fec9ede74aedd9050fb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:41.513417 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0e5b-b8da-4e1a-bdf6-c3b805edd3aa None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.513674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0e5b-b8da-4e1a-bdf6-c3b805edd3aa None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.513947 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0e5b-b8da-4e1a-bdf6-c3b805edd3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.534435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-85ed0e5b-b8da-4e1a-bdf6-c3b805edd3aa None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:41.535895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-85ed0e5b-b8da-4e1a-bdf6-c3b805edd3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:41.550857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 974/1921] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:41.554674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab532f-70f6-4ec7-9e9b-635f82c777e1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:41.567120 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab532f-70f6-4ec7-9e9b-635f82c777e1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:41.582871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6839b2-57e6-4ba0-b1e4-c04f7d09e7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:41.583583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6839b2-57e6-4ba0-b1e4-c04f7d09e7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.583934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6839b2-57e6-4ba0-b1e4-c04f7d09e7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.584213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6839b2-57e6-4ba0-b1e4-c04f7d09e7c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.585791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6839b2-57e6-4ba0-b1e4-c04f7d09e7c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:28:41.585941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6839b2-57e6-4ba0-b1e4-c04f7d09e7c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:41.587479 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6839b2-57e6-4ba0-b1e4-c04f7d09e7c5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:41.600078 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 975/1922] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:28:41.604636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 948/1923] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:28:41.604843 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6839b2-57e6-4ba0-b1e4-c04f7d09e7c5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:41.612915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246121c5-a5b4-4a64-ad30-3f9679401eba None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.613308 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246121c5-a5b4-4a64-ad30-3f9679401eba None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.613743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246121c5-a5b4-4a64-ad30-3f9679401eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.617685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6839b2-57e6-4ba0-b1e4-c04f7d09e7c5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:41.627905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de166ace-ae8b-4f41-bb7a-2930045fd32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:41.629383 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de166ace-ae8b-4f41-bb7a-2930045fd32b admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.629685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de166ace-ae8b-4f41-bb7a-2930045fd32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.629969 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de166ace-ae8b-4f41-bb7a-2930045fd32b admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.631218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de166ace-ae8b-4f41-bb7a-2930045fd32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:41.633218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de166ace-ae8b-4f41-bb7a-2930045fd32b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:41.637822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-246121c5-a5b4-4a64-ad30-3f9679401eba None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:41.639039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-246121c5-a5b4-4a64-ad30-3f9679401eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:41.648966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 949/1924] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:41.653348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246121c5-a5b4-4a64-ad30-3f9679401eba None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:41.662303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246121c5-a5b4-4a64-ad30-3f9679401eba None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:41.663249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 976/1925] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:41 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:41.668248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de166ace-ae8b-4f41-bb7a-2930045fd32b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:41.725401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a637d-96f1-4698-baa2-8ea6c8d913b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:41.726649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a637d-96f1-4698-baa2-8ea6c8d913b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.726926 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a637d-96f1-4698-baa2-8ea6c8d913b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.727195 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a637d-96f1-4698-baa2-8ea6c8d913b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.727916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a637d-96f1-4698-baa2-8ea6c8d913b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:28:41.728221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a637d-96f1-4698-baa2-8ea6c8d913b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:41.729840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a637d-96f1-4698-baa2-8ea6c8d913b3 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:41.736089 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de166ace-ae8b-4f41-bb7a-2930045fd32b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:41.746504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 950/1926] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:28:41.746685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929172ea-c8c2-45b7-a5b5-e47194944abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:41.746685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929172ea-c8c2-45b7-a5b5-e47194944abe admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.746685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929172ea-c8c2-45b7-a5b5-e47194944abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.746685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929172ea-c8c2-45b7-a5b5-e47194944abe admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.746998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929172ea-c8c2-45b7-a5b5-e47194944abe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:41.747747 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929172ea-c8c2-45b7-a5b5-e47194944abe admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:41.747983 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a637d-96f1-4698-baa2-8ea6c8d913b3 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:41.761864 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a637d-96f1-4698-baa2-8ea6c8d913b3 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:41.767576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b99cd0-2620-425c-8a32-b1f82adaa3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:41.768395 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b99cd0-2620-425c-8a32-b1f82adaa3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.768679 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b99cd0-2620-425c-8a32-b1f82adaa3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.768957 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b99cd0-2620-425c-8a32-b1f82adaa3c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.769678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b99cd0-2620-425c-8a32-b1f82adaa3c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:41.770548 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 977/1927] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:41 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:41.774401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b99cd0-2620-425c-8a32-b1f82adaa3c0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:41.778093 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929172ea-c8c2-45b7-a5b5-e47194944abe admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:41.791504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929172ea-c8c2-45b7-a5b5-e47194944abe admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:41.799428 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84333250-c12b-4bff-9ed4-526cdde49b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:41.800229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333250-c12b-4bff-9ed4-526cdde49b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.800998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333250-c12b-4bff-9ed4-526cdde49b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.800998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84333250-c12b-4bff-9ed4-526cdde49b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.801739 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84333250-c12b-4bff-9ed4-526cdde49b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:41.803475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84333250-c12b-4bff-9ed4-526cdde49b79 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:41.814901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 951/1928] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:41 2022] POST /identity/v3/projects => generated 389 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:41.815981 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b99cd0-2620-425c-8a32-b1f82adaa3c0 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:41.820862 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-80b99cd0-2620-425c-8a32-b1f82adaa3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:41.823659 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 978/1929] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:41.825598 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84333250-c12b-4bff-9ed4-526cdde49b79 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:41.836728 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84333250-c12b-4bff-9ed4-526cdde49b79 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:41.895415 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b99cd0-2620-425c-8a32-b1f82adaa3c0 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:41.897775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf8ec3-81eb-4286-a3b5-28e9074fd220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:41.898672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf8ec3-81eb-4286-a3b5-28e9074fd220 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.898954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf8ec3-81eb-4286-a3b5-28e9074fd220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.899299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf8ec3-81eb-4286-a3b5-28e9074fd220 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.900030 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf8ec3-81eb-4286-a3b5-28e9074fd220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:41.900448 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:41.901338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.901616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.901888 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] PATH_INFO: `/v3/projects/415d96c90cc742dba6bee8d4820af3e7` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.902065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf8ec3-81eb-4286-a3b5-28e9074fd220 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:41.903070 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=415d96c90cc742dba6bee8d4820af3e7)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:41.904958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:41.928493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 979/1930] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:41 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:41.928493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf8ec3-81eb-4286-a3b5-28e9074fd220 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:41.938141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf8ec3-81eb-4286-a3b5-28e9074fd220 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:41.943374 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6eb447-1136-460f-8822-4241a72379ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:41.944292 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6eb447-1136-460f-8822-4241a72379ba admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:41.944850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6eb447-1136-460f-8822-4241a72379ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:41.945478 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6eb447-1136-460f-8822-4241a72379ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:41.946371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6eb447-1136-460f-8822-4241a72379ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:41.948126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6eb447-1136-460f-8822-4241a72379ba admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:41.955318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415d96c90cc742dba6bee8d4820af3e7', 'request_id': 'req-96906474-1d0e-4332-9ca9-e43b2212cbb7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.959252 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 980/1931] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:41.960180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6eb447-1136-460f-8822-4241a72379ba admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:41.966822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415d96c90cc742dba6bee8d4820af3e7', 'request_id': 'req-96906474-1d0e-4332-9ca9-e43b2212cbb7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.970802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6eb447-1136-460f-8822-4241a72379ba admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:41.972546 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415d96c90cc742dba6bee8d4820af3e7', 'request_id': 'req-96906474-1d0e-4332-9ca9-e43b2212cbb7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.989535 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] The token cache is being invalidate because project 415d96c90cc742dba6bee8d4820af3e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:41.989825 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.990498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:41.992618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 952/1932] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:41 2022] DELETE /identity/v3/projects/415d96c90cc742dba6bee8d4820af3e7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:41.993382 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:41.994786 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:42.031917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dedf3-6a05-463b-99b4-3e2f13dba613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:42.032583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dedf3-6a05-463b-99b4-3e2f13dba613 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:42.032864 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dedf3-6a05-463b-99b4-3e2f13dba613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:42.033176 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dedf3-6a05-463b-99b4-3e2f13dba613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:42.033892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1dedf3-6a05-463b-99b4-3e2f13dba613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:42.035476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1dedf3-6a05-463b-99b4-3e2f13dba613 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:42.045422 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 981/1933] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:42.046196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dedf3-6a05-463b-99b4-3e2f13dba613 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:42.047815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0d1dedf3-6a05-463b-99b4-3e2f13dba613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:42.060605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dedf3-6a05-463b-99b4-3e2f13dba613 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:42.061941 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96906474-1d0e-4332-9ca9-e43b2212cbb7 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:42.065242 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384517f-0d23-4438-b208-348f0a6b0287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:42.066097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384517f-0d23-4438-b208-348f0a6b0287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:42.066382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384517f-0d23-4438-b208-348f0a6b0287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:42.066658 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384517f-0d23-4438-b208-348f0a6b0287 admin admin] PATH_INFO: `/v3/users/c5a5bc2500bd42b1bf3ccd218ed513d8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:42.066791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0330c-beea-4dd1-818e-b47f1feda365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:42.067708 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0330c-beea-4dd1-818e-b47f1feda365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:42.067850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384517f-0d23-4438-b208-348f0a6b0287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a5bc2500bd42b1bf3ccd218ed513d8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:42.067994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0330c-beea-4dd1-818e-b47f1feda365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:42.068253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0330c-beea-4dd1-818e-b47f1feda365 admin admin] PATH_INFO: `/v3/projects/507a0e875ab44bca8a740119920fec98/users/eba6fdb492ac4490a577cd90f5f3f9ca/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:42.069839 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384517f-0d23-4438-b208-348f0a6b0287 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:42.083081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0330c-beea-4dd1-818e-b47f1feda365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507a0e875ab44bca8a740119920fec98, user_id=eba6fdb492ac4490a577cd90f5f3f9ca, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:42.086133 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0330c-beea-4dd1-818e-b47f1feda365 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:42.100310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 953/1934] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:41 2022] PUT /identity/v3/projects/507a0e875ab44bca8a740119920fec98/users/eba6fdb492ac4490a577cd90f5f3f9ca/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:42.101645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0330c-beea-4dd1-818e-b47f1feda365 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:42.103706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-eda0330c-beea-4dd1-818e-b47f1feda365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:42.121802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5384517f-0d23-4438-b208-348f0a6b0287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a5bc2500bd42b1bf3ccd218ed513d8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:42.133120 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5384517f-0d23-4438-b208-348f0a6b0287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a5bc2500bd42b1bf3ccd218ed513d8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:42.139593 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5384517f-0d23-4438-b208-348f0a6b0287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a5bc2500bd42b1bf3ccd218ed513d8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:42.140323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5384517f-0d23-4438-b208-348f0a6b0287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a5bc2500bd42b1bf3ccd218ed513d8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:42.148495 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5384517f-0d23-4438-b208-348f0a6b0287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a5bc2500bd42b1bf3ccd218ed513d8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:42.154459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 982/1935] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:42 2022] DELETE /identity/v3/users/c5a5bc2500bd42b1bf3ccd218ed513d8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:42.155685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bc691-7f42-4855-a001-7e1becaf322f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:42.155973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bc691-7f42-4855-a001-7e1becaf322f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:42.156247 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bc691-7f42-4855-a001-7e1becaf322f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:42.167200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0330c-beea-4dd1-818e-b47f1feda365 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:42.184398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f52bc691-7f42-4855-a001-7e1becaf322f None None] MFA Rules not processed for user `eba6fdb492ac4490a577cd90f5f3f9ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:42.186614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f52bc691-7f42-4855-a001-7e1becaf322f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:42.234127 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d3cda-4f6e-4a99-bd30-cea668951108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:42.234872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d3cda-4f6e-4a99-bd30-cea668951108 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:42.235235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d3cda-4f6e-4a99-bd30-cea668951108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:42.235877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d3cda-4f6e-4a99-bd30-cea668951108 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:42.236638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d3cda-4f6e-4a99-bd30-cea668951108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:42.238377 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d3cda-4f6e-4a99-bd30-cea668951108 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:42.249321 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 954/1936] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:42.253559 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d3cda-4f6e-4a99-bd30-cea668951108 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:42.255334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-838d3cda-4f6e-4a99-bd30-cea668951108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:42.258225 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 983/1937] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:42.269982 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bc691-7f42-4855-a001-7e1becaf322f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:42.270493 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d3cda-4f6e-4a99-bd30-cea668951108 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:42.271389 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f52bc691-7f42-4855-a001-7e1becaf322f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:42.278050 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac95dd8-a0a0-4f86-91df-57877e0ae05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:42.279108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac95dd8-a0a0-4f86-91df-57877e0ae05b admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:42.279522 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac95dd8-a0a0-4f86-91df-57877e0ae05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:42.279904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac95dd8-a0a0-4f86-91df-57877e0ae05b admin admin] PATH_INFO: `/v3/projects/a42026f079d8429bad7be0b5d8e93279/users/b3e4bbf1801e4713a07ded6070950944/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:42.297151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac95dd8-a0a0-4f86-91df-57877e0ae05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42026f079d8429bad7be0b5d8e93279, user_id=b3e4bbf1801e4713a07ded6070950944, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:42.300542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac95dd8-a0a0-4f86-91df-57877e0ae05b admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:42.325067 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 955/1938] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:42 2022] PUT /identity/v3/projects/a42026f079d8429bad7be0b5d8e93279/users/b3e4bbf1801e4713a07ded6070950944/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:42.328117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f659-ac71-4914-9191-fa783fe0f6c0 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:42.329035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f659-ac71-4914-9191-fa783fe0f6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:42.329035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f659-ac71-4914-9191-fa783fe0f6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:42.349983 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bc691-7f42-4855-a001-7e1becaf322f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:42.357574 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6a44f659-ac71-4914-9191-fa783fe0f6c0 None None] MFA Rules not processed for user `b3e4bbf1801e4713a07ded6070950944`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:42.358784 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6a44f659-ac71-4914-9191-fa783fe0f6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:42.412510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573f869-7a89-4317-b2ff-c454d36c4055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:42.413954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f869-7a89-4317-b2ff-c454d36c4055 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:42.414383 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f869-7a89-4317-b2ff-c454d36c4055 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:42.414804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f869-7a89-4317-b2ff-c454d36c4055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:42.436958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 956/1939] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:28:42.441145 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44f659-ac71-4914-9191-fa783fe0f6c0 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:42.486558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573f869-7a89-4317-b2ff-c454d36c4055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:42.488201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573f869-7a89-4317-b2ff-c454d36c4055 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:42.499621 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 984/1940] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:42.517739 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573f869-7a89-4317-b2ff-c454d36c4055 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:42.521763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f573f869-7a89-4317-b2ff-c454d36c4055 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:42.549830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44f659-ac71-4914-9191-fa783fe0f6c0 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:42.563511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70828bac-f6dd-4184-856f-f6a1e713636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:42.564262 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70828bac-f6dd-4184-856f-f6a1e713636c admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:42.564555 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70828bac-f6dd-4184-856f-f6a1e713636c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:42.564846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70828bac-f6dd-4184-856f-f6a1e713636c admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:42.566278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70828bac-f6dd-4184-856f-f6a1e713636c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:42.568618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70828bac-f6dd-4184-856f-f6a1e713636c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:42.625472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 957/1941] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:42 2022] POST /identity/v3/projects => generated 389 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:42.629298 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70828bac-f6dd-4184-856f-f6a1e713636c admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:42.633988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573f869-7a89-4317-b2ff-c454d36c4055 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:42.737533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3135e-3818-4485-94ca-d38e415d31d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:42.738520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3135e-3818-4485-94ca-d38e415d31d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:42.738907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3135e-3818-4485-94ca-d38e415d31d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:42.739289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3135e-3818-4485-94ca-d38e415d31d8 admin admin] PATH_INFO: `/v3/projects/20faaba3775846409b7906eaf199a29c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:42.740662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3135e-3818-4485-94ca-d38e415d31d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20faaba3775846409b7906eaf199a29c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:42.742969 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3135e-3818-4485-94ca-d38e415d31d8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:42.756082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70828bac-f6dd-4184-856f-f6a1e713636c admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:42.762780 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b215c-ad7a-40bf-88f1-819aa8cf5d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:42.764075 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b215c-ad7a-40bf-88f1-819aa8cf5d98 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:42.764389 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b215c-ad7a-40bf-88f1-819aa8cf5d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:42.764656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b215c-ad7a-40bf-88f1-819aa8cf5d98 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:42.765421 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b215c-ad7a-40bf-88f1-819aa8cf5d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:42.769033 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b215c-ad7a-40bf-88f1-819aa8cf5d98 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:42.790612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 958/1942] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:42 2022] POST /identity/v3/users => generated 301 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:42.794632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b215c-ad7a-40bf-88f1-819aa8cf5d98 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:42.810026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b215c-ad7a-40bf-88f1-819aa8cf5d98 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:42.815540 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d4f3135e-3818-4485-94ca-d38e415d31d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20faaba3775846409b7906eaf199a29c', 'request_id': 'req-d4f3135e-3818-4485-94ca-d38e415d31d8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:42.822175 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d4f3135e-3818-4485-94ca-d38e415d31d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20faaba3775846409b7906eaf199a29c', 'request_id': 'req-d4f3135e-3818-4485-94ca-d38e415d31d8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:42.829338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d4f3135e-3818-4485-94ca-d38e415d31d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20faaba3775846409b7906eaf199a29c', 'request_id': 'req-d4f3135e-3818-4485-94ca-d38e415d31d8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:42.845166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d4f3135e-3818-4485-94ca-d38e415d31d8 admin admin] The token cache is being invalidate because project 20faaba3775846409b7906eaf199a29c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:42.845555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d4f3135e-3818-4485-94ca-d38e415d31d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:42.846862 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d4f3135e-3818-4485-94ca-d38e415d31d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:42.849382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 985/1943] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:42 2022] DELETE /identity/v3/projects/20faaba3775846409b7906eaf199a29c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:42.854213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c824fb-7eaf-4f66-9321-c10d0310d8ab None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:42.854746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c824fb-7eaf-4f66-9321-c10d0310d8ab None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:42.855212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c824fb-7eaf-4f66-9321-c10d0310d8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:42.876139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-44c824fb-7eaf-4f66-9321-c10d0310d8ab None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:42.878468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-44c824fb-7eaf-4f66-9321-c10d0310d8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:42.895028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16051eaf-51de-4792-a072-40bf8df3bba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:42.903588 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16051eaf-51de-4792-a072-40bf8df3bba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:42.904099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16051eaf-51de-4792-a072-40bf8df3bba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:42.904584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16051eaf-51de-4792-a072-40bf8df3bba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:42.905858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16051eaf-51de-4792-a072-40bf8df3bba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:42.907567 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16051eaf-51de-4792-a072-40bf8df3bba0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:42.923956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 959/1944] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:28:42.924848 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16051eaf-51de-4792-a072-40bf8df3bba0 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:42.926750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-16051eaf-51de-4792-a072-40bf8df3bba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:42.940044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16051eaf-51de-4792-a072-40bf8df3bba0 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:42.945643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62efb7-e0be-46bf-96ac-a92d3faa08cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:42.946533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62efb7-e0be-46bf-96ac-a92d3faa08cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:42.946818 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62efb7-e0be-46bf-96ac-a92d3faa08cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:42.947169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62efb7-e0be-46bf-96ac-a92d3faa08cb admin admin] PATH_INFO: `/v3/projects/6a1c7a50f48a46cdbc614b9ec308a7a5/users/5b72f2781499402ba5f9ba3009ac451b/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:42.963686 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62efb7-e0be-46bf-96ac-a92d3faa08cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1c7a50f48a46cdbc614b9ec308a7a5, user_id=5b72f2781499402ba5f9ba3009ac451b, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:42.966617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62efb7-e0be-46bf-96ac-a92d3faa08cb admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:43.000285 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 960/1945] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:42 2022] PUT /identity/v3/projects/6a1c7a50f48a46cdbc614b9ec308a7a5/users/5b72f2781499402ba5f9ba3009ac451b/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:43.001280 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62efb7-e0be-46bf-96ac-a92d3faa08cb admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:43.013136 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 986/1946] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:28:43.023462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a4ed1-7e28-40ae-a175-ea28b474829b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.023810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a4ed1-7e28-40ae-a175-ea28b474829b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.024152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a4ed1-7e28-40ae-a175-ea28b474829b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.056997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-751a4ed1-7e28-40ae-a175-ea28b474829b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:43.058220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-751a4ed1-7e28-40ae-a175-ea28b474829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:43.110519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62efb7-e0be-46bf-96ac-a92d3faa08cb admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:43.118297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121a4e7-addb-41df-bdc1-3e97ca037476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:43.119512 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121a4e7-addb-41df-bdc1-3e97ca037476 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.119800 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121a4e7-addb-41df-bdc1-3e97ca037476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.120081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121a4e7-addb-41df-bdc1-3e97ca037476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.120826 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121a4e7-addb-41df-bdc1-3e97ca037476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:43.122482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121a4e7-addb-41df-bdc1-3e97ca037476 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:43.138136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 961/1947] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:43.142525 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121a4e7-addb-41df-bdc1-3e97ca037476 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:43.156510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121a4e7-addb-41df-bdc1-3e97ca037476 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:43.157273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 987/1948] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:43.160585 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a4ed1-7e28-40ae-a175-ea28b474829b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:43.165552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc667297-b006-46e9-9f0c-9af2662279f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:43.166456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc667297-b006-46e9-9f0c-9af2662279f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.166740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc667297-b006-46e9-9f0c-9af2662279f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.167017 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc667297-b006-46e9-9f0c-9af2662279f6 admin admin] PATH_INFO: `/v3/projects/6a1c7a50f48a46cdbc614b9ec308a7a5/users/5b72f2781499402ba5f9ba3009ac451b/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.170460 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc667297-b006-46e9-9f0c-9af2662279f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1c7a50f48a46cdbc614b9ec308a7a5, user_id=5b72f2781499402ba5f9ba3009ac451b, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:43.170680 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a4ed1-7e28-40ae-a175-ea28b474829b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:43.175791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac5809-c5bb-4346-a605-163ae5bb1d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:43.176895 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac5809-c5bb-4346-a605-163ae5bb1d85 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.177347 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac5809-c5bb-4346-a605-163ae5bb1d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.177766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac5809-c5bb-4346-a605-163ae5bb1d85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.179621 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac5809-c5bb-4346-a605-163ae5bb1d85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:28:43.179941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac5809-c5bb-4346-a605-163ae5bb1d85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:43.181854 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac5809-c5bb-4346-a605-163ae5bb1d85 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:43.182781 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc667297-b006-46e9-9f0c-9af2662279f6 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:43.201031 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 988/1949] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:28:43.202389 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac5809-c5bb-4346-a605-163ae5bb1d85 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:43.204136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 962/1950] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:43 2022] PUT /identity/v3/projects/6a1c7a50f48a46cdbc614b9ec308a7a5/users/5b72f2781499402ba5f9ba3009ac451b/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:43.214270 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72875d00-ddfa-40f2-95cd-400e5222a17d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.214567 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72875d00-ddfa-40f2-95cd-400e5222a17d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.214853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72875d00-ddfa-40f2-95cd-400e5222a17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.225994 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac5809-c5bb-4346-a605-163ae5bb1d85 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:43.241732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-72875d00-ddfa-40f2-95cd-400e5222a17d None None] MFA Rules not processed for user `5b72f2781499402ba5f9ba3009ac451b`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:43.243096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-72875d00-ddfa-40f2-95cd-400e5222a17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:43.296891 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9333a-f02b-416e-b3b9-19695af7b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:43.297592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9333a-f02b-416e-b3b9-19695af7b38b admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.297880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9333a-f02b-416e-b3b9-19695af7b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.298160 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9333a-f02b-416e-b3b9-19695af7b38b admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.301537 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9333a-f02b-416e-b3b9-19695af7b38b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:43.303451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9333a-f02b-416e-b3b9-19695af7b38b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:43.321903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 963/1951] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:28:43.322763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72875d00-ddfa-40f2-95cd-400e5222a17d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:43.324443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-72875d00-ddfa-40f2-95cd-400e5222a17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:43.331299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 989/1952] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:43 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:43.333910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9333a-f02b-416e-b3b9-19695af7b38b admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:43.335703 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bed9333a-f02b-416e-b3b9-19695af7b38b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:43.338609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72875d00-ddfa-40f2-95cd-400e5222a17d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:43.389795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9333a-f02b-416e-b3b9-19695af7b38b admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:43.393493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9344d-7c2d-4de6-84fd-8980446d0ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:43.394130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9344d-7c2d-4de6-84fd-8980446d0ccb service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.394413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9344d-7c2d-4de6-84fd-8980446d0ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.394685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9344d-7c2d-4de6-84fd-8980446d0ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.399008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004bfb9-7352-419a-92a3-83355553cbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:43.399905 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004bfb9-7352-419a-92a3-83355553cbf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.400187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004bfb9-7352-419a-92a3-83355553cbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.400464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004bfb9-7352-419a-92a3-83355553cbf1 admin admin] PATH_INFO: `/v3/users/45ecca878e5d46cabb3471d7ef14c2d0` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.401697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004bfb9-7352-419a-92a3-83355553cbf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ecca878e5d46cabb3471d7ef14c2d0)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:43.403652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6004bfb9-7352-419a-92a3-83355553cbf1 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:43.448317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6004bfb9-7352-419a-92a3-83355553cbf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ecca878e5d46cabb3471d7ef14c2d0'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.449059 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6004bfb9-7352-419a-92a3-83355553cbf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ecca878e5d46cabb3471d7ef14c2d0'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.454977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9344d-7c2d-4de6-84fd-8980446d0ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:43.456454 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9344d-7c2d-4de6-84fd-8980446d0ccb service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:43.460692 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6004bfb9-7352-419a-92a3-83355553cbf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ecca878e5d46cabb3471d7ef14c2d0'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.466108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 990/1953] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:43.466969 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9344d-7c2d-4de6-84fd-8980446d0ccb service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:43.468157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6004bfb9-7352-419a-92a3-83355553cbf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ecca878e5d46cabb3471d7ef14c2d0'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.477229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9344d-7c2d-4de6-84fd-8980446d0ccb service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:43.481211 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6004bfb9-7352-419a-92a3-83355553cbf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ecca878e5d46cabb3471d7ef14c2d0'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.484613 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b60d0-1327-46a0-8cb7-3f3334075800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:43.485422 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b60d0-1327-46a0-8cb7-3f3334075800 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.485791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b60d0-1327-46a0-8cb7-3f3334075800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.486062 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b60d0-1327-46a0-8cb7-3f3334075800 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.486718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b60d0-1327-46a0-8cb7-3f3334075800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:43.488559 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 964/1954] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:43 2022] DELETE /identity/v3/users/45ecca878e5d46cabb3471d7ef14c2d0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:43.492287 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b60d0-1327-46a0-8cb7-3f3334075800 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:43.511842 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 991/1955] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:43 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:43.515710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004bfb9-7352-419a-92a3-83355553cbf1 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:43.517526 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6004bfb9-7352-419a-92a3-83355553cbf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:43.585509 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004bfb9-7352-419a-92a3-83355553cbf1 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:43.594425 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f60e2-6548-4f8c-afac-f9c8dfcec252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:43.595116 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f60e2-6548-4f8c-afac-f9c8dfcec252 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.595401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f60e2-6548-4f8c-afac-f9c8dfcec252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.595679 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f60e2-6548-4f8c-afac-f9c8dfcec252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.596420 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f60e2-6548-4f8c-afac-f9c8dfcec252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:43.598124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f60e2-6548-4f8c-afac-f9c8dfcec252 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:43.609015 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 965/1956] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:28:43.612876 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b60d0-1327-46a0-8cb7-3f3334075800 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:43.620234 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f60e2-6548-4f8c-afac-f9c8dfcec252 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:43.622211 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-1f3f60e2-6548-4f8c-afac-f9c8dfcec252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:43.623955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b60d0-1327-46a0-8cb7-3f3334075800 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:43.628634 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d133f3-0b71-4b77-acea-ace35691ddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:43.629345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d133f3-0b71-4b77-acea-ace35691ddde admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.629624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d133f3-0b71-4b77-acea-ace35691ddde admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.629897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d133f3-0b71-4b77-acea-ace35691ddde admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.630618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d133f3-0b71-4b77-acea-ace35691ddde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:43.632447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d133f3-0b71-4b77-acea-ace35691ddde admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:43.635943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f60e2-6548-4f8c-afac-f9c8dfcec252 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:43.640712 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf87a6b-03b3-478c-abd1-54c9e0ab89ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:43.641609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87a6b-03b3-478c-abd1-54c9e0ab89ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.641896 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87a6b-03b3-478c-abd1-54c9e0ab89ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.642198 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87a6b-03b3-478c-abd1-54c9e0ab89ba admin admin] PATH_INFO: `/v3/users/b3e4bbf1801e4713a07ded6070950944` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.645966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 992/1957] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:43.646107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf87a6b-03b3-478c-abd1-54c9e0ab89ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e4bbf1801e4713a07ded6070950944)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:43.646107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf87a6b-03b3-478c-abd1-54c9e0ab89ba admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:43.647715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d133f3-0b71-4b77-acea-ace35691ddde admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:43.658457 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d133f3-0b71-4b77-acea-ace35691ddde admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:43.664043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6d76e-d5d4-4d36-a8e1-f28cf42b9ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:43.665005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6d76e-d5d4-4d36-a8e1-f28cf42b9ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.665286 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6d76e-d5d4-4d36-a8e1-f28cf42b9ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.665558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6d76e-d5d4-4d36-a8e1-f28cf42b9ea8 admin admin] PATH_INFO: `/v3/projects/f0e71c5c7e774c5988f14b0ef5206d28/users/b4f8ff36c9d2487694025d041fd945d3/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.683013 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6d76e-d5d4-4d36-a8e1-f28cf42b9ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e71c5c7e774c5988f14b0ef5206d28, user_id=b4f8ff36c9d2487694025d041fd945d3, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:43.686143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6d76e-d5d4-4d36-a8e1-f28cf42b9ea8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:43.704007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 993/1958] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:43 2022] PUT /identity/v3/projects/f0e71c5c7e774c5988f14b0ef5206d28/users/b4f8ff36c9d2487694025d041fd945d3/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:43.704750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6d76e-d5d4-4d36-a8e1-f28cf42b9ea8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:43.706410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cab6d76e-d5d4-4d36-a8e1-f28cf42b9ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:43.717834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9cf87a6b-03b3-478c-abd1-54c9e0ab89ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e4bbf1801e4713a07ded6070950944'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.718751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9cf87a6b-03b3-478c-abd1-54c9e0ab89ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e4bbf1801e4713a07ded6070950944'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.734747 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9cf87a6b-03b3-478c-abd1-54c9e0ab89ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e4bbf1801e4713a07ded6070950944'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.741688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9cf87a6b-03b3-478c-abd1-54c9e0ab89ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e4bbf1801e4713a07ded6070950944'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.749232 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9cf87a6b-03b3-478c-abd1-54c9e0ab89ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e4bbf1801e4713a07ded6070950944'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.755095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 966/1959] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:43 2022] DELETE /identity/v3/users/b3e4bbf1801e4713a07ded6070950944 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:43.756507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e908fe-2c17-4ffa-afbd-fe8dc45b1edf None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e908fe-2c17-4ffa-afbd-fe8dc45b1edf None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.757136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e908fe-2c17-4ffa-afbd-fe8dc45b1edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.778792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6d76e-d5d4-4d36-a8e1-f28cf42b9ea8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:43.785640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-c1e908fe-2c17-4ffa-afbd-fe8dc45b1edf None None] MFA Rules not processed for user `b4f8ff36c9d2487694025d041fd945d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:43.786961 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c1e908fe-2c17-4ffa-afbd-fe8dc45b1edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:43.832587 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:43.833533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.833814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.834088 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] PATH_INFO: `/v3/projects/c86827b1ba384ed9b24e7e6afd65a4d5` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.835788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86827b1ba384ed9b24e7e6afd65a4d5)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:43.837729 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:43.851523 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 967/1960] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:43.852951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f2cfa-5e08-4271-8439-76cb05ac57eb None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.853362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f2cfa-5e08-4271-8439-76cb05ac57eb None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.853860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f2cfa-5e08-4271-8439-76cb05ac57eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.870213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-ad6f2cfa-5e08-4271-8439-76cb05ac57eb None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:43.871386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ad6f2cfa-5e08-4271-8439-76cb05ac57eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:43.883623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'request_id': 'req-5741697a-2be5-442d-aece-1c5a43eb63d6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.888838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'request_id': 'req-5741697a-2be5-442d-aece-1c5a43eb63d6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.894782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'request_id': 'req-5741697a-2be5-442d-aece-1c5a43eb63d6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.907523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] The token cache is being invalidate because project c86827b1ba384ed9b24e7e6afd65a4d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:43.907805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.908429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:43.919991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 994/1961] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:43 2022] DELETE /identity/v3/projects/c86827b1ba384ed9b24e7e6afd65a4d5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:43.919991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:43.921038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:43.930118 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 968/1962] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:43.931450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97385c2-67ce-43a9-984f-c6e00e77539f None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.931740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97385c2-67ce-43a9-984f-c6e00e77539f None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.932075 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97385c2-67ce-43a9-984f-c6e00e77539f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.949407 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-c97385c2-67ce-43a9-984f-c6e00e77539f None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:43.950580 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c97385c2-67ce-43a9-984f-c6e00e77539f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:43.958461 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 969/1963] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:43.965326 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97385c2-67ce-43a9-984f-c6e00e77539f None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:43.965326 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c97385c2-67ce-43a9-984f-c6e00e77539f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:43.985553 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741697a-2be5-442d-aece-1c5a43eb63d6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:43.990355 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416fe3c-202d-4262-824f-41f66a0a64cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:43.991021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416fe3c-202d-4262-824f-41f66a0a64cf admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:43.992256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416fe3c-202d-4262-824f-41f66a0a64cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:43.992610 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416fe3c-202d-4262-824f-41f66a0a64cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:43.993691 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416fe3c-202d-4262-824f-41f66a0a64cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:43.995632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416fe3c-202d-4262-824f-41f66a0a64cf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.025084 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 995/1964] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:43 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:44.025601 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97385c2-67ce-43a9-984f-c6e00e77539f None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.026392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886f6ce-2ae7-43cc-80b5-9f8e5d0c9ab5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.026681 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886f6ce-2ae7-43cc-80b5-9f8e5d0c9ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.026959 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886f6ce-2ae7-43cc-80b5-9f8e5d0c9ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.052210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c886f6ce-2ae7-43cc-80b5-9f8e5d0c9ab5 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:44.053418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c886f6ce-2ae7-43cc-80b5-9f8e5d0c9ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:44.075604 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb36b1-6592-44b9-9dfa-45f912e70f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.076261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb36b1-6592-44b9-9dfa-45f912e70f20 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.076545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb36b1-6592-44b9-9dfa-45f912e70f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.076824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb36b1-6592-44b9-9dfa-45f912e70f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.111598 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 996/1965] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:44.112501 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886f6ce-2ae7-43cc-80b5-9f8e5d0c9ab5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.122265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886f6ce-2ae7-43cc-80b5-9f8e5d0c9ab5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.126857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff139c9-9b4f-4ff1-b8f1-3dfa1fb13bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.127501 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff139c9-9b4f-4ff1-b8f1-3dfa1fb13bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.127794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff139c9-9b4f-4ff1-b8f1-3dfa1fb13bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.128068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff139c9-9b4f-4ff1-b8f1-3dfa1fb13bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.128749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff139c9-9b4f-4ff1-b8f1-3dfa1fb13bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.130730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff139c9-9b4f-4ff1-b8f1-3dfa1fb13bc0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.134967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb36b1-6592-44b9-9dfa-45f912e70f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.136383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb36b1-6592-44b9-9dfa-45f912e70f20 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.145868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 970/1966] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:44.146657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb36b1-6592-44b9-9dfa-45f912e70f20 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.154313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 997/1967] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:44 2022] POST /identity/v3/users => generated 292 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:44.155758 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff139c9-9b4f-4ff1-b8f1-3dfa1fb13bc0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.159039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb36b1-6592-44b9-9dfa-45f912e70f20 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.165067 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0bebd-4413-4f0d-bbd2-3c595873a16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.165774 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0bebd-4413-4f0d-bbd2-3c595873a16c admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.165886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff139c9-9b4f-4ff1-b8f1-3dfa1fb13bc0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.166090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0bebd-4413-4f0d-bbd2-3c595873a16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.166336 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0bebd-4413-4f0d-bbd2-3c595873a16c admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.167224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0bebd-4413-4f0d-bbd2-3c595873a16c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:28:44.167543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0bebd-4413-4f0d-bbd2-3c595873a16c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.169203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0bebd-4413-4f0d-bbd2-3c595873a16c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.170496 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7a58d-1eae-4300-a637-4bc3a1e20b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.171149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7a58d-1eae-4300-a637-4bc3a1e20b07 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.171432 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7a58d-1eae-4300-a637-4bc3a1e20b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.171706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7a58d-1eae-4300-a637-4bc3a1e20b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.172449 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7a58d-1eae-4300-a637-4bc3a1e20b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.174046 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7a58d-1eae-4300-a637-4bc3a1e20b07 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.182188 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 971/1968] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:28:44.184600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 998/1969] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:28:44.186685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0bebd-4413-4f0d-bbd2-3c595873a16c admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.189172 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7a58d-1eae-4300-a637-4bc3a1e20b07 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.197404 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0bebd-4413-4f0d-bbd2-3c595873a16c admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.200072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7a58d-1eae-4300-a637-4bc3a1e20b07 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.203135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdbfd4-b0c5-444d-ab75-08cdbe0ca4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.203838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdbfd4-b0c5-444d-ab75-08cdbe0ca4dd admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.204114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdbfd4-b0c5-444d-ab75-08cdbe0ca4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.204759 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdbfd4-b0c5-444d-ab75-08cdbe0ca4dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.205372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca24e1-de7f-4e77-ab95-5f94c1b6df08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.205506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdbfd4-b0c5-444d-ab75-08cdbe0ca4dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.206048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca24e1-de7f-4e77-ab95-5f94c1b6df08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.206406 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca24e1-de7f-4e77-ab95-5f94c1b6df08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.206688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca24e1-de7f-4e77-ab95-5f94c1b6df08 admin admin] PATH_INFO: `/v3/projects/1a9b0d5e647840cd8bca96da01ed5c4b/users/2be3ed31c3534f2696084ce86a561863/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.207521 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdbfd4-b0c5-444d-ab75-08cdbe0ca4dd admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.242558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 972/1970] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:44 2022] POST /identity/v3/projects => generated 401 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:44.243824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdbfd4-b0c5-444d-ab75-08cdbe0ca4dd admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.247527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca24e1-de7f-4e77-ab95-5f94c1b6df08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9b0d5e647840cd8bca96da01ed5c4b, user_id=2be3ed31c3534f2696084ce86a561863, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.252107 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca24e1-de7f-4e77-ab95-5f94c1b6df08 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.272152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 999/1971] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:44 2022] PUT /identity/v3/projects/1a9b0d5e647840cd8bca96da01ed5c4b/users/2be3ed31c3534f2696084ce86a561863/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:44.277489 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca24e1-de7f-4e77-ab95-5f94c1b6df08 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.329221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdbfd4-b0c5-444d-ab75-08cdbe0ca4dd admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.353263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca24e1-de7f-4e77-ab95-5f94c1b6df08 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.359915 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad17c93-743e-47ef-8f28-8d7fa64b7a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.360583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17c93-743e-47ef-8f28-8d7fa64b7a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.360858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17c93-743e-47ef-8f28-8d7fa64b7a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.361162 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad17c93-743e-47ef-8f28-8d7fa64b7a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.361891 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad17c93-743e-47ef-8f28-8d7fa64b7a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.363541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad17c93-743e-47ef-8f28-8d7fa64b7a7a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.374585 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1000/1972] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:28:44.378709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad17c93-743e-47ef-8f28-8d7fa64b7a7a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.389665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad17c93-743e-47ef-8f28-8d7fa64b7a7a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.394793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6af45-b248-4ac9-acd6-e1c4e5d65091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.395747 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6af45-b248-4ac9-acd6-e1c4e5d65091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.396554 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6af45-b248-4ac9-acd6-e1c4e5d65091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.396554 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6af45-b248-4ac9-acd6-e1c4e5d65091 admin admin] PATH_INFO: `/v3/projects/1a9b0d5e647840cd8bca96da01ed5c4b/users/2be3ed31c3534f2696084ce86a561863/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.399017 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6af45-b248-4ac9-acd6-e1c4e5d65091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9b0d5e647840cd8bca96da01ed5c4b, user_id=2be3ed31c3534f2696084ce86a561863, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.399555 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cbba2-1a04-4e65-ba0e-019828c93a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.400232 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cbba2-1a04-4e65-ba0e-019828c93a28 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.401024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cbba2-1a04-4e65-ba0e-019828c93a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.401024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cbba2-1a04-4e65-ba0e-019828c93a28 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.401766 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cbba2-1a04-4e65-ba0e-019828c93a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.402593 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6af45-b248-4ac9-acd6-e1c4e5d65091 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.403629 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cbba2-1a04-4e65-ba0e-019828c93a28 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.414984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1001/1973] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:44 2022] PUT /identity/v3/projects/1a9b0d5e647840cd8bca96da01ed5c4b/users/2be3ed31c3534f2696084ce86a561863/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:44.425761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10a661-b989-4cfa-a1c9-126ee818f2dc None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.425968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10a661-b989-4cfa-a1c9-126ee818f2dc None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.426156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10a661-b989-4cfa-a1c9-126ee818f2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.438909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 973/1974] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:44 2022] POST /identity/v3/users => generated 301 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:44.442899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cbba2-1a04-4e65-ba0e-019828c93a28 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.452532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cbba2-1a04-4e65-ba0e-019828c93a28 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.461987 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9e10a661-b989-4cfa-a1c9-126ee818f2dc None None] MFA Rules not processed for user `2be3ed31c3534f2696084ce86a561863`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:44.463318 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9e10a661-b989-4cfa-a1c9-126ee818f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:44.518505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5711f-45ac-4b80-b3d5-0c85f8acbdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.520215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5711f-45ac-4b80-b3d5-0c85f8acbdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.520589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5711f-45ac-4b80-b3d5-0c85f8acbdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.520775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5711f-45ac-4b80-b3d5-0c85f8acbdb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.521557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5711f-45ac-4b80-b3d5-0c85f8acbdb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.524059 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5711f-45ac-4b80-b3d5-0c85f8acbdb3 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.535799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 974/1975] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:28:44.536639 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5711f-45ac-4b80-b3d5-0c85f8acbdb3 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.539063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f9b5711f-45ac-4b80-b3d5-0c85f8acbdb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:44.550750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5711f-45ac-4b80-b3d5-0c85f8acbdb3 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.555001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1002/1976] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:28:44.555539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.555920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10a661-b989-4cfa-a1c9-126ee818f2dc None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.556388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.556669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.556945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] PATH_INFO: `/v3/projects/a42026f079d8429bad7be0b5d8e93279` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.558381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42026f079d8429bad7be0b5d8e93279)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.560358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.565808 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10a661-b989-4cfa-a1c9-126ee818f2dc None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.570482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2a4af-1b55-4398-a664-550fbe63464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.571132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2a4af-1b55-4398-a664-550fbe63464f admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.571418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2a4af-1b55-4398-a664-550fbe63464f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.571697 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2a4af-1b55-4398-a664-550fbe63464f admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.572420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2a4af-1b55-4398-a664-550fbe63464f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.574036 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2a4af-1b55-4398-a664-550fbe63464f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.586690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1003/1977] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:44.586690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2a4af-1b55-4398-a664-550fbe63464f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.588049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-26f2a4af-1b55-4398-a664-550fbe63464f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:44.609063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42026f079d8429bad7be0b5d8e93279', 'request_id': 'req-cfd86144-6348-46cb-8ceb-b0ee6890e794'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:44.615782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42026f079d8429bad7be0b5d8e93279', 'request_id': 'req-cfd86144-6348-46cb-8ceb-b0ee6890e794'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:44.621954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42026f079d8429bad7be0b5d8e93279', 'request_id': 'req-cfd86144-6348-46cb-8ceb-b0ee6890e794'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:44.634492 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] The token cache is being invalidate because project a42026f079d8429bad7be0b5d8e93279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:44.634776 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:44.635433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:44.636985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 975/1978] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:44 2022] DELETE /identity/v3/projects/a42026f079d8429bad7be0b5d8e93279 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:44.640089 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.640089 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:44.644133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2a4af-1b55-4398-a664-550fbe63464f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.693327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db805148-8e55-499f-bdff-22031864f5a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.693990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db805148-8e55-499f-bdff-22031864f5a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.694295 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db805148-8e55-499f-bdff-22031864f5a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.694577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db805148-8e55-499f-bdff-22031864f5a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.696426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-db805148-8e55-499f-bdff-22031864f5a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:44.702588 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd86144-6348-46cb-8ceb-b0ee6890e794 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.707264 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ab273-dec2-4eb5-9ae0-26b2a40865b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.708149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab273-dec2-4eb5-9ae0-26b2a40865b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.708432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab273-dec2-4eb5-9ae0-26b2a40865b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.708712 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab273-dec2-4eb5-9ae0-26b2a40865b0 admin admin] PATH_INFO: `/v3/projects/4ab4b09d92cc430db74358a286d243e4/users/bbe0ff9b94af473dab335ca578b470f1/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.726184 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ab273-dec2-4eb5-9ae0-26b2a40865b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab4b09d92cc430db74358a286d243e4, user_id=bbe0ff9b94af473dab335ca578b470f1, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.728831 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ab273-dec2-4eb5-9ae0-26b2a40865b0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.743178 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 976/1979] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:44 2022] PUT /identity/v3/projects/4ab4b09d92cc430db74358a286d243e4/users/bbe0ff9b94af473dab335ca578b470f1/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:44.743970 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ab273-dec2-4eb5-9ae0-26b2a40865b0 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.745581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-bd4ab273-dec2-4eb5-9ae0-26b2a40865b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:44.767357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db805148-8e55-499f-bdff-22031864f5a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.768924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db805148-8e55-499f-bdff-22031864f5a7 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.779525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1004/1980] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:44.781113 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a7c73-bddf-4cc4-befe-a04a71c8c2c9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.781566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a7c73-bddf-4cc4-befe-a04a71c8c2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.781857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a7c73-bddf-4cc4-befe-a04a71c8c2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.810058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-327a7c73-bddf-4cc4-befe-a04a71c8c2c9 None None] MFA Rules not processed for user `bbe0ff9b94af473dab335ca578b470f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:44.811571 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-327a7c73-bddf-4cc4-befe-a04a71c8c2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:44.818122 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ab273-dec2-4eb5-9ae0-26b2a40865b0 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.823424 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee2832-fab7-44d8-8657-9236b476bd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.824466 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2832-fab7-44d8-8657-9236b476bd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.825310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2832-fab7-44d8-8657-9236b476bd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.825310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2832-fab7-44d8-8657-9236b476bd64 admin admin] PATH_INFO: `/v3/users/5b72f2781499402ba5f9ba3009ac451b` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.826400 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee2832-fab7-44d8-8657-9236b476bd64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b72f2781499402ba5f9ba3009ac451b)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.828474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee2832-fab7-44d8-8657-9236b476bd64 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.879842 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1005/1981] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:44.885849 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d2ee2832-fab7-44d8-8657-9236b476bd64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b72f2781499402ba5f9ba3009ac451b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:44.885849 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d2ee2832-fab7-44d8-8657-9236b476bd64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b72f2781499402ba5f9ba3009ac451b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:44.886065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a7c73-bddf-4cc4-befe-a04a71c8c2c9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.898500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a7c73-bddf-4cc4-befe-a04a71c8c2c9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:44.898681 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d2ee2832-fab7-44d8-8657-9236b476bd64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b72f2781499402ba5f9ba3009ac451b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:44.903274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a454e-0bc9-4f59-a5de-13796d563480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:44.903863 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a454e-0bc9-4f59-a5de-13796d563480 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:44.904447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a454e-0bc9-4f59-a5de-13796d563480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:44.904447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a454e-0bc9-4f59-a5de-13796d563480 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:44.905107 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a454e-0bc9-4f59-a5de-13796d563480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:44.906417 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d2ee2832-fab7-44d8-8657-9236b476bd64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b72f2781499402ba5f9ba3009ac451b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:44.907007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a454e-0bc9-4f59-a5de-13796d563480 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:44.914737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d2ee2832-fab7-44d8-8657-9236b476bd64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b72f2781499402ba5f9ba3009ac451b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:44.924036 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 977/1982] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:44 2022] DELETE /identity/v3/users/5b72f2781499402ba5f9ba3009ac451b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:44.935870 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1006/1983] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:44 2022] POST /identity/v3/projects => generated 401 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:44.941659 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee2832-fab7-44d8-8657-9236b476bd64 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:44.943256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d2ee2832-fab7-44d8-8657-9236b476bd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:45.022199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee2832-fab7-44d8-8657-9236b476bd64 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.104791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0d1c3-701c-4e97-aa24-cb4515514c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.105588 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0d1c3-701c-4e97-aa24-cb4515514c3d admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.105878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0d1c3-701c-4e97-aa24-cb4515514c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.106156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0d1c3-701c-4e97-aa24-cb4515514c3d admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.106876 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0d1c3-701c-4e97-aa24-cb4515514c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.109661 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0d1c3-701c-4e97-aa24-cb4515514c3d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:45.133891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 978/1984] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:44 2022] POST /identity/v3/users => generated 307 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:45.137935 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a454e-0bc9-4f59-a5de-13796d563480 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:45.150391 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a454e-0bc9-4f59-a5de-13796d563480 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.155322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b06524-abf7-4c08-bbc0-637016894f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.156004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b06524-abf7-4c08-bbc0-637016894f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.156317 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b06524-abf7-4c08-bbc0-637016894f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.156558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b06524-abf7-4c08-bbc0-637016894f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.157450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b06524-abf7-4c08-bbc0-637016894f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.159064 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b06524-abf7-4c08-bbc0-637016894f68 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:45.176148 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1007/1985] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:45.180953 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0d1c3-701c-4e97-aa24-cb4515514c3d admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:45.191385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0d1c3-701c-4e97-aa24-cb4515514c3d admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.196576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1ff9d-5b0b-4990-94a1-d51e3e75e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.198067 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1ff9d-5b0b-4990-94a1-d51e3e75e414 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.198431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1ff9d-5b0b-4990-94a1-d51e3e75e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.198625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1ff9d-5b0b-4990-94a1-d51e3e75e414 admin admin] PATH_INFO: `/v3/projects/bb4fc4a6af604b5ba178c9b774bb37fb/users/0abd96584bf34dd08e643ccde334f907/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.207833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b06524-abf7-4c08-bbc0-637016894f68 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:45.210391 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-90b06524-abf7-4c08-bbc0-637016894f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:45.222206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1ff9d-5b0b-4990-94a1-d51e3e75e414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4fc4a6af604b5ba178c9b774bb37fb, user_id=0abd96584bf34dd08e643ccde334f907, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.224500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b06524-abf7-4c08-bbc0-637016894f68 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.225028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1ff9d-5b0b-4990-94a1-d51e3e75e414 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:45.230325 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b6412-8027-4e48-a661-2cefdaca59a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.231350 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b6412-8027-4e48-a661-2cefdaca59a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.231799 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b6412-8027-4e48-a661-2cefdaca59a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.231971 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b6412-8027-4e48-a661-2cefdaca59a7 admin admin] PATH_INFO: `/v3/users/b4f8ff36c9d2487694025d041fd945d3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.233425 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b6412-8027-4e48-a661-2cefdaca59a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f8ff36c9d2487694025d041fd945d3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.235405 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b6412-8027-4e48-a661-2cefdaca59a7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:45.244126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 979/1986] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:45 2022] PUT /identity/v3/projects/bb4fc4a6af604b5ba178c9b774bb37fb/users/0abd96584bf34dd08e643ccde334f907/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:45.245309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1ff9d-5b0b-4990-94a1-d51e3e75e414 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:45.247158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d1c1ff9d-5b0b-4990-94a1-d51e3e75e414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:45.292658 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e28b6412-8027-4e48-a661-2cefdaca59a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f8ff36c9d2487694025d041fd945d3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:45.304048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e28b6412-8027-4e48-a661-2cefdaca59a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f8ff36c9d2487694025d041fd945d3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:45.311842 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e28b6412-8027-4e48-a661-2cefdaca59a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f8ff36c9d2487694025d041fd945d3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:45.313779 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e28b6412-8027-4e48-a661-2cefdaca59a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f8ff36c9d2487694025d041fd945d3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:45.321270 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1ff9d-5b0b-4990-94a1-d51e3e75e414 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.322342 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e28b6412-8027-4e48-a661-2cefdaca59a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f8ff36c9d2487694025d041fd945d3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:45.326761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d16d10-3dd7-43a0-afe6-19720474d507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.327632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d16d10-3dd7-43a0-afe6-19720474d507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.327914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d16d10-3dd7-43a0-afe6-19720474d507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.328186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d16d10-3dd7-43a0-afe6-19720474d507 admin admin] PATH_INFO: `/v3/projects/6a1c7a50f48a46cdbc614b9ec308a7a5` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.329405 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d16d10-3dd7-43a0-afe6-19720474d507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1c7a50f48a46cdbc614b9ec308a7a5)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.329506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1008/1987] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:45 2022] DELETE /identity/v3/users/b4f8ff36c9d2487694025d041fd945d3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:45.331514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d16d10-3dd7-43a0-afe6-19720474d507 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:45.333348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b6412-8027-4e48-a661-2cefdaca59a7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:45.334683 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e28b6412-8027-4e48-a661-2cefdaca59a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:45.377723 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-10d16d10-3dd7-43a0-afe6-19720474d507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1c7a50f48a46cdbc614b9ec308a7a5', 'request_id': 'req-10d16d10-3dd7-43a0-afe6-19720474d507'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:45.384876 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-10d16d10-3dd7-43a0-afe6-19720474d507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1c7a50f48a46cdbc614b9ec308a7a5', 'request_id': 'req-10d16d10-3dd7-43a0-afe6-19720474d507'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:45.390290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-10d16d10-3dd7-43a0-afe6-19720474d507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1c7a50f48a46cdbc614b9ec308a7a5', 'request_id': 'req-10d16d10-3dd7-43a0-afe6-19720474d507'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:45.396085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b6412-8027-4e48-a661-2cefdaca59a7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.401740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-10d16d10-3dd7-43a0-afe6-19720474d507 admin admin] The token cache is being invalidate because project 6a1c7a50f48a46cdbc614b9ec308a7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:45.402032 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-10d16d10-3dd7-43a0-afe6-19720474d507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:45.402705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-10d16d10-3dd7-43a0-afe6-19720474d507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:45.404498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 980/1988] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:45 2022] DELETE /identity/v3/projects/6a1c7a50f48a46cdbc614b9ec308a7a5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:45.406312 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1e0dd-4352-48b2-98d8-398b6b04cc98 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.406852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1e0dd-4352-48b2-98d8-398b6b04cc98 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.407273 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1e0dd-4352-48b2-98d8-398b6b04cc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.425674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-2cc1e0dd-4352-48b2-98d8-398b6b04cc98 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:45.426882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2cc1e0dd-4352-48b2-98d8-398b6b04cc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:45.461134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199ac27-4746-4361-a212-9b265cd56de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.461944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199ac27-4746-4361-a212-9b265cd56de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.462333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199ac27-4746-4361-a212-9b265cd56de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.462711 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199ac27-4746-4361-a212-9b265cd56de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.463677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199ac27-4746-4361-a212-9b265cd56de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.465571 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199ac27-4746-4361-a212-9b265cd56de7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:45.478842 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1009/1989] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:45.482931 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16782d-770b-484a-8307-c994043c1518 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.483282 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16782d-770b-484a-8307-c994043c1518 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.483566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16782d-770b-484a-8307-c994043c1518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.487990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 981/1990] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:45.488783 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1e0dd-4352-48b2-98d8-398b6b04cc98 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:45.490197 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2cc1e0dd-4352-48b2-98d8-398b6b04cc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:45.502691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1e0dd-4352-48b2-98d8-398b6b04cc98 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.505123 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-da16782d-770b-484a-8307-c994043c1518 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:45.507497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-da16782d-770b-484a-8307-c994043c1518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:45.509133 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6ccb1-dc28-4387-a40b-5ef29f470b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.510025 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6ccb1-dc28-4387-a40b-5ef29f470b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.510307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6ccb1-dc28-4387-a40b-5ef29f470b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.510576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6ccb1-dc28-4387-a40b-5ef29f470b79 admin admin] PATH_INFO: `/v3/projects/bb4fc4a6af604b5ba178c9b774bb37fb/users/0abd96584bf34dd08e643ccde334f907/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.512560 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6ccb1-dc28-4387-a40b-5ef29f470b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4fc4a6af604b5ba178c9b774bb37fb, user_id=0abd96584bf34dd08e643ccde334f907, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.515219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6ccb1-dc28-4387-a40b-5ef29f470b79 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:45.517521 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1010/1991] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:45.518474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16782d-770b-484a-8307-c994043c1518 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:45.519884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-da16782d-770b-484a-8307-c994043c1518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:45.532050 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 982/1992] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:45 2022] PUT /identity/v3/projects/bb4fc4a6af604b5ba178c9b774bb37fb/users/0abd96584bf34dd08e643ccde334f907/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:45.533835 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a5380-7527-4896-97b0-c9b321cf0aa2 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.534291 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a5380-7527-4896-97b0-c9b321cf0aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.534714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a5380-7527-4896-97b0-c9b321cf0aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.553358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-da4a5380-7527-4896-97b0-c9b321cf0aa2 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:45.555084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-da4a5380-7527-4896-97b0-c9b321cf0aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:45.595721 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16782d-770b-484a-8307-c994043c1518 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.617780 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 983/1993] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:45.619214 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4ca0f-9fc0-4673-a05c-d752dee1bb2d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.619503 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4ca0f-9fc0-4673-a05c-d752dee1bb2d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.619781 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4ca0f-9fc0-4673-a05c-d752dee1bb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.645234 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-25e4ca0f-9fc0-4673-a05c-d752dee1bb2d None None] MFA Rules not processed for user `0abd96584bf34dd08e643ccde334f907`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:45.646097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7790165-4f3e-40cc-9d1e-b46833ae84a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.646470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-25e4ca0f-9fc0-4673-a05c-d752dee1bb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:45.646885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790165-4f3e-40cc-9d1e-b46833ae84a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.647174 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790165-4f3e-40cc-9d1e-b46833ae84a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.647750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790165-4f3e-40cc-9d1e-b46833ae84a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.656555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7790165-4f3e-40cc-9d1e-b46833ae84a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.658020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7790165-4f3e-40cc-9d1e-b46833ae84a1 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:45.667699 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1011/1994] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:45.668483 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7790165-4f3e-40cc-9d1e-b46833ae84a1 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:45.677426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7790165-4f3e-40cc-9d1e-b46833ae84a1 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.683129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f4b64-92e2-4129-9a14-a7bcf40cb3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.684068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f4b64-92e2-4129-9a14-a7bcf40cb3cb admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.684757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f4b64-92e2-4129-9a14-a7bcf40cb3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.685069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f4b64-92e2-4129-9a14-a7bcf40cb3cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.685798 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f4b64-92e2-4129-9a14-a7bcf40cb3cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:28:45.686109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f4b64-92e2-4129-9a14-a7bcf40cb3cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.687745 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f4b64-92e2-4129-9a14-a7bcf40cb3cb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:45.699727 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1012/1995] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:28:45.704158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f4b64-92e2-4129-9a14-a7bcf40cb3cb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:45.714388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f4b64-92e2-4129-9a14-a7bcf40cb3cb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.719566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6b2fe-dafb-4629-bcd4-77875db4feeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.720219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b2fe-dafb-4629-bcd4-77875db4feeb admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.720634 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b2fe-dafb-4629-bcd4-77875db4feeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.720924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6b2fe-dafb-4629-bcd4-77875db4feeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.721563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 984/1996] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:45 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:45.725035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6b2fe-dafb-4629-bcd4-77875db4feeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.727899 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6b2fe-dafb-4629-bcd4-77875db4feeb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:45.735152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4ca0f-9fc0-4673-a05c-d752dee1bb2d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:45.737380 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-25e4ca0f-9fc0-4673-a05c-d752dee1bb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:45.762535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1013/1997] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:45 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:45.767626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6b2fe-dafb-4629-bcd4-77875db4feeb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:45.807064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4ca0f-9fc0-4673-a05c-d752dee1bb2d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.839764 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6b2fe-dafb-4629-bcd4-77875db4feeb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.845353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d019e87-0264-41d5-906b-58bbbf4bd0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.846053 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d019e87-0264-41d5-906b-58bbbf4bd0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.846336 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d019e87-0264-41d5-906b-58bbbf4bd0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.846613 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d019e87-0264-41d5-906b-58bbbf4bd0d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.847833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d019e87-0264-41d5-906b-58bbbf4bd0d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.849352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d019e87-0264-41d5-906b-58bbbf4bd0d9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:45.859172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd06128-a749-4c7d-9cfd-4884b5cb3914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.859884 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd06128-a749-4c7d-9cfd-4884b5cb3914 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.860107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd06128-a749-4c7d-9cfd-4884b5cb3914 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.860406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd06128-a749-4c7d-9cfd-4884b5cb3914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.874632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1014/1998] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:45 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:45.881509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d019e87-0264-41d5-906b-58bbbf4bd0d9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:45.892747 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d019e87-0264-41d5-906b-58bbbf4bd0d9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.899012 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596867d-b787-4cd2-85ae-3e3f5687da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.899702 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596867d-b787-4cd2-85ae-3e3f5687da41 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.899985 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596867d-b787-4cd2-85ae-3e3f5687da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.900258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596867d-b787-4cd2-85ae-3e3f5687da41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.901024 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596867d-b787-4cd2-85ae-3e3f5687da41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.902642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596867d-b787-4cd2-85ae-3e3f5687da41 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:45.917592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1015/1999] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:45.919011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596867d-b787-4cd2-85ae-3e3f5687da41 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:45.930508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596867d-b787-4cd2-85ae-3e3f5687da41 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.935578 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14f95c-9ea0-4e8f-b6aa-ebae2b0198b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.936112 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd06128-a749-4c7d-9cfd-4884b5cb3914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.936297 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14f95c-9ea0-4e8f-b6aa-ebae2b0198b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.936532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14f95c-9ea0-4e8f-b6aa-ebae2b0198b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.936964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14f95c-9ea0-4e8f-b6aa-ebae2b0198b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.937635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd06128-a749-4c7d-9cfd-4884b5cb3914 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:45.937738 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14f95c-9ea0-4e8f-b6aa-ebae2b0198b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.939299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14f95c-9ea0-4e8f-b6aa-ebae2b0198b8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:45.949469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 985/2000] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:45 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:28:45.951176 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1016/2001] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:28:45.955168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd06128-a749-4c7d-9cfd-4884b5cb3914 service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:45.967419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd06128-a749-4c7d-9cfd-4884b5cb3914 service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:45.971727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a49562-d5d4-45a0-8bf8-8eb505316033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:45.973162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a49562-d5d4-45a0-8bf8-8eb505316033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:45.973617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a49562-d5d4-45a0-8bf8-8eb505316033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:45.973958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a49562-d5d4-45a0-8bf8-8eb505316033 admin admin] PATH_INFO: `/v3/projects/6a85e80a428e438caa16b6c3848f387d/users/ed12a733cde84fabad93d468146706b7/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:45.992681 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a49562-d5d4-45a0-8bf8-8eb505316033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a85e80a428e438caa16b6c3848f387d, user_id=ed12a733cde84fabad93d468146706b7, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:45.995723 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a49562-d5d4-45a0-8bf8-8eb505316033 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:46.019004 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 986/2002] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:45 2022] PUT /identity/v3/projects/6a85e80a428e438caa16b6c3848f387d/users/ed12a733cde84fabad93d468146706b7/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:46.020777 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5090425-6794-48d5-9ade-b4c468412b09 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:46.021135 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5090425-6794-48d5-9ade-b4c468412b09 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:46.021420 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5090425-6794-48d5-9ade-b4c468412b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:46.050718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e5090425-6794-48d5-9ade-b4c468412b09 None None] MFA Rules not processed for user `ed12a733cde84fabad93d468146706b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:46.051916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e5090425-6794-48d5-9ade-b4c468412b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:46.059684 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a49562-d5d4-45a0-8bf8-8eb505316033 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:46.119937 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a49562-d5d4-45a0-8bf8-8eb505316033 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:46.126641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1017/2003] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:28:46.130405 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7dad5-1241-4595-8cab-1ad129a18847 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:46.130867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5090425-6794-48d5-9ade-b4c468412b09 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:46.131287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7dad5-1241-4595-8cab-1ad129a18847 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:46.131386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7dad5-1241-4595-8cab-1ad129a18847 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:46.131790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7dad5-1241-4595-8cab-1ad129a18847 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:46.134918 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ddc7dad5-1241-4595-8cab-1ad129a18847 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:46.210957 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7dad5-1241-4595-8cab-1ad129a18847 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:46.212295 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7dad5-1241-4595-8cab-1ad129a18847 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:46.221836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5090425-6794-48d5-9ade-b4c468412b09 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:46.225297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 987/2004] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:28:46.226671 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7dad5-1241-4595-8cab-1ad129a18847 service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:46.227980 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ddc7dad5-1241-4595-8cab-1ad129a18847 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:46.228101 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983f50f-45e5-47f8-947b-233df259daaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:46.228948 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983f50f-45e5-47f8-947b-233df259daaf admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:46.229457 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983f50f-45e5-47f8-947b-233df259daaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:46.229809 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1983f50f-45e5-47f8-947b-233df259daaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:46.230650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983f50f-45e5-47f8-947b-233df259daaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:46.233013 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1983f50f-45e5-47f8-947b-233df259daaf admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:46.241693 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7dad5-1241-4595-8cab-1ad129a18847 service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:46.246587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:46.247443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:46.247722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:46.247992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] PATH_INFO: `/v3/projects/f0e71c5c7e774c5988f14b0ef5206d28` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:46.249261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e71c5c7e774c5988f14b0ef5206d28)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:46.251292 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:46.273784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1018/2005] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:46 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:46.279892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983f50f-45e5-47f8-947b-233df259daaf admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:46.318841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e71c5c7e774c5988f14b0ef5206d28', 'request_id': 'req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:46.330858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e71c5c7e774c5988f14b0ef5206d28', 'request_id': 'req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:46.339166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e71c5c7e774c5988f14b0ef5206d28', 'request_id': 'req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:46.354708 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] The token cache is being invalidate because project f0e71c5c7e774c5988f14b0ef5206d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:46.354996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:46.355993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:46.359742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 988/2006] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:46 2022] DELETE /identity/v3/projects/f0e71c5c7e774c5988f14b0ef5206d28 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:46.364679 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:46.366191 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:46.371233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1983f50f-45e5-47f8-947b-233df259daaf admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:46.448760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdb782-8efd-4fb3-bca7-7dd1403cc3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:46.450065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb782-8efd-4fb3-bca7-7dd1403cc3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:46.450353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb782-8efd-4fb3-bca7-7dd1403cc3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:46.450629 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb782-8efd-4fb3-bca7-7dd1403cc3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:46.451328 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdb782-8efd-4fb3-bca7-7dd1403cc3a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:46.452916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8ce8d-7b1d-426e-8c95-3e7f33cc292a admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:46.453353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdb782-8efd-4fb3-bca7-7dd1403cc3a8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:46.458926 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86fd78-766d-476e-986a-6b76edab4364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:46.460524 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86fd78-766d-476e-986a-6b76edab4364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:46.460776 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86fd78-766d-476e-986a-6b76edab4364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:46.461080 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86fd78-766d-476e-986a-6b76edab4364 admin admin] PATH_INFO: `/v3/users/2be3ed31c3534f2696084ce86a561863` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:46.462308 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86fd78-766d-476e-986a-6b76edab4364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be3ed31c3534f2696084ce86a561863)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:46.464326 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86fd78-766d-476e-986a-6b76edab4364 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:46.475958 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1019/2007] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:46 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:46.479979 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdb782-8efd-4fb3-bca7-7dd1403cc3a8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:46.481857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-39fdb782-8efd-4fb3-bca7-7dd1403cc3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:46.493953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdb782-8efd-4fb3-bca7-7dd1403cc3a8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:46.499178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc1dcc-e26c-4acf-9171-64a03ad9f5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:46.499852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc1dcc-e26c-4acf-9171-64a03ad9f5bd admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:46.500136 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc1dcc-e26c-4acf-9171-64a03ad9f5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:46.500445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc1dcc-e26c-4acf-9171-64a03ad9f5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:46.501214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc1dcc-e26c-4acf-9171-64a03ad9f5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:46.502997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc1dcc-e26c-4acf-9171-64a03ad9f5bd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:46.529722 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1020/2008] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:46.531055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc1dcc-e26c-4acf-9171-64a03ad9f5bd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:46.539010 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7b86fd78-766d-476e-986a-6b76edab4364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be3ed31c3534f2696084ce86a561863'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:46.539732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7b86fd78-766d-476e-986a-6b76edab4364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be3ed31c3534f2696084ce86a561863'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:46.542579 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc1dcc-e26c-4acf-9171-64a03ad9f5bd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:46.548048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cddc27-8d20-4010-af86-d8c81cdbe613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:46.548801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cddc27-8d20-4010-af86-d8c81cdbe613 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:46.549173 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cddc27-8d20-4010-af86-d8c81cdbe613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:46.549767 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cddc27-8d20-4010-af86-d8c81cdbe613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:46.550567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cddc27-8d20-4010-af86-d8c81cdbe613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:46.552450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cddc27-8d20-4010-af86-d8c81cdbe613 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:46.555665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7b86fd78-766d-476e-986a-6b76edab4364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be3ed31c3534f2696084ce86a561863'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:46.564468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1021/2009] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:46.566701 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7b86fd78-766d-476e-986a-6b76edab4364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be3ed31c3534f2696084ce86a561863'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:46.568676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cddc27-8d20-4010-af86-d8c81cdbe613 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:46.570728 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-88cddc27-8d20-4010-af86-d8c81cdbe613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:46.576372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7b86fd78-766d-476e-986a-6b76edab4364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be3ed31c3534f2696084ce86a561863'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:46.584101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 989/2010] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:46 2022] DELETE /identity/v3/users/2be3ed31c3534f2696084ce86a561863 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:46.586934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cddc27-8d20-4010-af86-d8c81cdbe613 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:46.663760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5d536-c6d5-47ef-9081-3daf79e8b1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:46.665189 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d536-c6d5-47ef-9081-3daf79e8b1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:46.665534 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d536-c6d5-47ef-9081-3daf79e8b1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:46.665756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d536-c6d5-47ef-9081-3daf79e8b1ed admin admin] PATH_INFO: `/v3/projects/a6ec3f96e55c41f9a8b09618b8798bad/users/95e32a0229cd45c3927c70390974efd1/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:46.681019 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5d536-c6d5-47ef-9081-3daf79e8b1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ec3f96e55c41f9a8b09618b8798bad, user_id=95e32a0229cd45c3927c70390974efd1, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:46.683690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5d536-c6d5-47ef-9081-3daf79e8b1ed admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:46.696707 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1022/2011] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:46 2022] PUT /identity/v3/projects/a6ec3f96e55c41f9a8b09618b8798bad/users/95e32a0229cd45c3927c70390974efd1/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:46.707074 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfa2c2-070a-43f7-a53e-b3520cb3caa4 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:46.707393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfa2c2-070a-43f7-a53e-b3520cb3caa4 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:46.707667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfa2c2-070a-43f7-a53e-b3520cb3caa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:46.739946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-aacfa2c2-070a-43f7-a53e-b3520cb3caa4 None None] MFA Rules not processed for user `95e32a0229cd45c3927c70390974efd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:46.741188 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-aacfa2c2-070a-43f7-a53e-b3520cb3caa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:46.822925 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 990/2012] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:46.827593 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5d536-c6d5-47ef-9081-3daf79e8b1ed admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:46.898145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5d536-c6d5-47ef-9081-3daf79e8b1ed admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:46.903373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66eaa5-d5ad-45ce-91b6-ce5a9710b0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:46.904049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66eaa5-d5ad-45ce-91b6-ce5a9710b0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:46.904335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66eaa5-d5ad-45ce-91b6-ce5a9710b0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:46.904618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66eaa5-d5ad-45ce-91b6-ce5a9710b0f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:46.905417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66eaa5-d5ad-45ce-91b6-ce5a9710b0f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:46.907442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66eaa5-d5ad-45ce-91b6-ce5a9710b0f0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:46.935849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1023/2013] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:46 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:46.940404 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfa2c2-070a-43f7-a53e-b3520cb3caa4 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:46.947606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66eaa5-d5ad-45ce-91b6-ce5a9710b0f0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:46.949835 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9a66eaa5-d5ad-45ce-91b6-ce5a9710b0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:46.954158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfa2c2-070a-43f7-a53e-b3520cb3caa4 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.034819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d817-479e-4d1b-b247-cdd33fc48311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.035508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d817-479e-4d1b-b247-cdd33fc48311 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.035796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d817-479e-4d1b-b247-cdd33fc48311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.036072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7d817-479e-4d1b-b247-cdd33fc48311 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.036501 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66eaa5-d5ad-45ce-91b6-ce5a9710b0f0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.036767 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7d817-479e-4d1b-b247-cdd33fc48311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.039297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7d817-479e-4d1b-b247-cdd33fc48311 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.042037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235c489-0d71-4faf-b67c-e336c7b72700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.042901 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235c489-0d71-4faf-b67c-e336c7b72700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.043298 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235c489-0d71-4faf-b67c-e336c7b72700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.043454 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235c489-0d71-4faf-b67c-e336c7b72700 admin admin] PATH_INFO: `/v3/projects/1a9b0d5e647840cd8bca96da01ed5c4b` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.044712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235c489-0d71-4faf-b67c-e336c7b72700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9b0d5e647840cd8bca96da01ed5c4b)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.046689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235c489-0d71-4faf-b67c-e336c7b72700 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.060431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 991/2014] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:46 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:47.064268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d817-479e-4d1b-b247-cdd33fc48311 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:47.075166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7d817-479e-4d1b-b247-cdd33fc48311 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.080215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a72a6d-3781-43a5-9742-a1fab5ab0338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.080799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a72a6d-3781-43a5-9742-a1fab5ab0338 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.081091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a72a6d-3781-43a5-9742-a1fab5ab0338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.081368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a72a6d-3781-43a5-9742-a1fab5ab0338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.082094 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a72a6d-3781-43a5-9742-a1fab5ab0338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.083709 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a72a6d-3781-43a5-9742-a1fab5ab0338 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.095204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 992/2015] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:47.098838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a72a6d-3781-43a5-9742-a1fab5ab0338 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:47.101667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d235c489-0d71-4faf-b67c-e336c7b72700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9b0d5e647840cd8bca96da01ed5c4b', 'request_id': 'req-d235c489-0d71-4faf-b67c-e336c7b72700'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:47.107254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d235c489-0d71-4faf-b67c-e336c7b72700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9b0d5e647840cd8bca96da01ed5c4b', 'request_id': 'req-d235c489-0d71-4faf-b67c-e336c7b72700'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:47.109698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a72a6d-3781-43a5-9742-a1fab5ab0338 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.114825 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d235c489-0d71-4faf-b67c-e336c7b72700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9b0d5e647840cd8bca96da01ed5c4b', 'request_id': 'req-d235c489-0d71-4faf-b67c-e336c7b72700'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:47.128542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d235c489-0d71-4faf-b67c-e336c7b72700 admin admin] The token cache is being invalidate because project 1a9b0d5e647840cd8bca96da01ed5c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:47.128838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d235c489-0d71-4faf-b67c-e336c7b72700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:47.129683 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d235c489-0d71-4faf-b67c-e336c7b72700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:47.131549 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1024/2016] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:46 2022] DELETE /identity/v3/projects/1a9b0d5e647840cd8bca96da01ed5c4b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:47.136646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c83601-4073-401e-b9f0-f0b999061079 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.137175 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c83601-4073-401e-b9f0-f0b999061079 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.137580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c83601-4073-401e-b9f0-f0b999061079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.157495 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f5c83601-4073-401e-b9f0-f0b999061079 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:47.158745 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f5c83601-4073-401e-b9f0-f0b999061079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:47.178938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8962f-853c-4378-ab1e-cfc3e0288177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.179841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8962f-853c-4378-ab1e-cfc3e0288177 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.180124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8962f-853c-4378-ab1e-cfc3e0288177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.180402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8962f-853c-4378-ab1e-cfc3e0288177 admin admin] PATH_INFO: `/v3/projects/5a5e2fb35301437da13196efc465eb37/users/5ac0d3de62e44ebcadf1fe14fab405d4/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.196333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8962f-853c-4378-ab1e-cfc3e0288177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5e2fb35301437da13196efc465eb37, user_id=5ac0d3de62e44ebcadf1fe14fab405d4, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.199035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8962f-853c-4378-ab1e-cfc3e0288177 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.215429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 993/2017] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:47 2022] PUT /identity/v3/projects/5a5e2fb35301437da13196efc465eb37/users/5ac0d3de62e44ebcadf1fe14fab405d4/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:47.219151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8962f-853c-4378-ab1e-cfc3e0288177 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:47.221123 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fcc8962f-853c-4378-ab1e-cfc3e0288177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:47.222141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1025/2018] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:28:47.230682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee9b07-d47b-4955-94cb-16fe8b8db48a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.231129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee9b07-d47b-4955-94cb-16fe8b8db48a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.231393 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee9b07-d47b-4955-94cb-16fe8b8db48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.250979 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-90ee9b07-d47b-4955-94cb-16fe8b8db48a None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:47.253274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-90ee9b07-d47b-4955-94cb-16fe8b8db48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:47.288094 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8962f-853c-4378-ab1e-cfc3e0288177 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.293378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c21b5-7090-43b6-9840-3810f697df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.293946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c21b5-7090-43b6-9840-3810f697df58 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.294233 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c21b5-7090-43b6-9840-3810f697df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.294514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c21b5-7090-43b6-9840-3810f697df58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.295314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c21b5-7090-43b6-9840-3810f697df58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.299773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c21b5-7090-43b6-9840-3810f697df58 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.313786 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 994/2019] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:28:47.314988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1026/2020] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:28:47.320045 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c21b5-7090-43b6-9840-3810f697df58 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:47.320173 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee9b07-d47b-4955-94cb-16fe8b8db48a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:47.329549 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee9b07-d47b-4955-94cb-16fe8b8db48a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.331511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c21b5-7090-43b6-9840-3810f697df58 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.334448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357499f-da27-422b-a695-5fffef60ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.335868 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357499f-da27-422b-a695-5fffef60ad72 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.336148 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357499f-da27-422b-a695-5fffef60ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.336545 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357499f-da27-422b-a695-5fffef60ad72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.337215 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357499f-da27-422b-a695-5fffef60ad72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:28:47.337564 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357499f-da27-422b-a695-5fffef60ad72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.338296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7993c8c-bc02-40d2-8d7f-10d7424f3255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.339160 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357499f-da27-422b-a695-5fffef60ad72 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.339267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7993c8c-bc02-40d2-8d7f-10d7424f3255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.339457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7993c8c-bc02-40d2-8d7f-10d7424f3255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.339736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7993c8c-bc02-40d2-8d7f-10d7424f3255 admin admin] PATH_INFO: `/v3/projects/5a5e2fb35301437da13196efc465eb37/users/5ac0d3de62e44ebcadf1fe14fab405d4/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.341968 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7993c8c-bc02-40d2-8d7f-10d7424f3255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5e2fb35301437da13196efc465eb37, user_id=5ac0d3de62e44ebcadf1fe14fab405d4, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.344589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7993c8c-bc02-40d2-8d7f-10d7424f3255 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.351629 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1027/2021] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:28:47.355670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357499f-da27-422b-a695-5fffef60ad72 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:47.357197 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 995/2022] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:47 2022] PUT /identity/v3/projects/5a5e2fb35301437da13196efc465eb37/users/5ac0d3de62e44ebcadf1fe14fab405d4/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:47.366331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357499f-da27-422b-a695-5fffef60ad72 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.367927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35259cdb-34f9-400c-962f-3d2a006f0913 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.368225 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35259cdb-34f9-400c-962f-3d2a006f0913 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.369494 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35259cdb-34f9-400c-962f-3d2a006f0913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.399457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-35259cdb-34f9-400c-962f-3d2a006f0913 None None] MFA Rules not processed for user `5ac0d3de62e44ebcadf1fe14fab405d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:47.401147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-35259cdb-34f9-400c-962f-3d2a006f0913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:47.429935 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f186574-24bd-404e-a5f5-3e381195b211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.430834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f186574-24bd-404e-a5f5-3e381195b211 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.431124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f186574-24bd-404e-a5f5-3e381195b211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.431428 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f186574-24bd-404e-a5f5-3e381195b211 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.432125 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f186574-24bd-404e-a5f5-3e381195b211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.434244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f186574-24bd-404e-a5f5-3e381195b211 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.463989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1028/2023] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:47 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:47.468466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f186574-24bd-404e-a5f5-3e381195b211 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:47.489096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 996/2024] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:28:47.500771 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35259cdb-34f9-400c-962f-3d2a006f0913 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:47.502467 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-35259cdb-34f9-400c-962f-3d2a006f0913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:47.541010 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f186574-24bd-404e-a5f5-3e381195b211 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.545730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7100cb1-680d-429a-a8cb-fff0ce19b0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.546423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100cb1-680d-429a-a8cb-fff0ce19b0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.546700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100cb1-680d-429a-a8cb-fff0ce19b0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.546970 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7100cb1-680d-429a-a8cb-fff0ce19b0d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.547647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7100cb1-680d-429a-a8cb-fff0ce19b0d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.549620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7100cb1-680d-429a-a8cb-fff0ce19b0d1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.563805 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35259cdb-34f9-400c-962f-3d2a006f0913 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.571145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1029/2025] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:47 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:47.575262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7100cb1-680d-429a-a8cb-fff0ce19b0d1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:47.586008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7100cb1-680d-429a-a8cb-fff0ce19b0d1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.590842 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbe002-7f0f-483d-95ae-2e2fe9405529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.591500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbe002-7f0f-483d-95ae-2e2fe9405529 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.591812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbe002-7f0f-483d-95ae-2e2fe9405529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.592161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbe002-7f0f-483d-95ae-2e2fe9405529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.592902 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbe002-7f0f-483d-95ae-2e2fe9405529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.594555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbe002-7f0f-483d-95ae-2e2fe9405529 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.605424 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1030/2026] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:47.609208 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbe002-7f0f-483d-95ae-2e2fe9405529 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:47.616688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e6620-1c34-46b4-aa30-d3c166d5c6f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.617363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e6620-1c34-46b4-aa30-d3c166d5c6f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.617652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e6620-1c34-46b4-aa30-d3c166d5c6f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.617930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e6620-1c34-46b4-aa30-d3c166d5c6f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.622653 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbe002-7f0f-483d-95ae-2e2fe9405529 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.627366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05a024-efb7-4008-9d5a-8f1832d01651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.628033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05a024-efb7-4008-9d5a-8f1832d01651 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.628320 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05a024-efb7-4008-9d5a-8f1832d01651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.628603 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05a024-efb7-4008-9d5a-8f1832d01651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.629362 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05a024-efb7-4008-9d5a-8f1832d01651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.630949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05a024-efb7-4008-9d5a-8f1832d01651 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.641274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1031/2027] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:47.645264 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05a024-efb7-4008-9d5a-8f1832d01651 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:47.655216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05a024-efb7-4008-9d5a-8f1832d01651 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.660360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e6a6-8571-430d-8ada-bd7c97bf4809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.661255 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e6a6-8571-430d-8ada-bd7c97bf4809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.661537 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e6a6-8571-430d-8ada-bd7c97bf4809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.661807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e6a6-8571-430d-8ada-bd7c97bf4809 admin admin] PATH_INFO: `/v3/projects/8a3045e2a6614624901ce5b64487f785/users/62054848574b43979cad909400f90f01/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.676055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0e6a6-8571-430d-8ada-bd7c97bf4809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3045e2a6614624901ce5b64487f785, user_id=62054848574b43979cad909400f90f01, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.677751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e6620-1c34-46b4-aa30-d3c166d5c6f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.678792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0e6a6-8571-430d-8ada-bd7c97bf4809 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.679244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e6620-1c34-46b4-aa30-d3c166d5c6f5 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.689214 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 997/2028] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:28:47.691493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1032/2029] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:47 2022] PUT /identity/v3/projects/8a3045e2a6614624901ce5b64487f785/users/62054848574b43979cad909400f90f01/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:47.701801 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129f075-fbd3-4448-b308-933609c37ac5 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.702100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129f075-fbd3-4448-b308-933609c37ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.702385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a129f075-fbd3-4448-b308-933609c37ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.732239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-a129f075-fbd3-4448-b308-933609c37ac5 None None] MFA Rules not processed for user `62054848574b43979cad909400f90f01`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:47.733462 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a129f075-fbd3-4448-b308-933609c37ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:47.747495 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e6a6-8571-430d-8ada-bd7c97bf4809 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:47.749286 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-dfa0e6a6-8571-430d-8ada-bd7c97bf4809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:47.797020 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 998/2030] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:47.801688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129f075-fbd3-4448-b308-933609c37ac5 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:47.805035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e6a6-8571-430d-8ada-bd7c97bf4809 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.808929 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a46f8b-59ca-4cd9-8f8d-e7325eb25378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.809601 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a46f8b-59ca-4cd9-8f8d-e7325eb25378 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.809882 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a46f8b-59ca-4cd9-8f8d-e7325eb25378 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.810155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a46f8b-59ca-4cd9-8f8d-e7325eb25378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.812008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-93a46f8b-59ca-4cd9-8f8d-e7325eb25378 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:47.861216 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a129f075-fbd3-4448-b308-933609c37ac5 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.868339 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75790b39-eac3-4317-b7ac-bbe6656739ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.869047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75790b39-eac3-4317-b7ac-bbe6656739ed admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.869332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75790b39-eac3-4317-b7ac-bbe6656739ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.869606 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75790b39-eac3-4317-b7ac-bbe6656739ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.870296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75790b39-eac3-4317-b7ac-bbe6656739ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.872182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75790b39-eac3-4317-b7ac-bbe6656739ed admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.873338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a46f8b-59ca-4cd9-8f8d-e7325eb25378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.874771 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a46f8b-59ca-4cd9-8f8d-e7325eb25378 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:47.884482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1033/2031] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:28:47.902446 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 999/2032] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:47 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:47.903625 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a46f8b-59ca-4cd9-8f8d-e7325eb25378 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:47.917821 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a46f8b-59ca-4cd9-8f8d-e7325eb25378 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:47.993845 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7fbab-7e39-420b-b6bb-cd302b98b2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:47.995309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7fbab-7e39-420b-b6bb-cd302b98b2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:47.995595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7fbab-7e39-420b-b6bb-cd302b98b2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:47.995880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7fbab-7e39-420b-b6bb-cd302b98b2f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:47.996583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7fbab-7e39-420b-b6bb-cd302b98b2f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:47.998572 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7fbab-7e39-420b-b6bb-cd302b98b2f9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:48.026295 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1034/2033] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:47 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:48.030589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75790b39-eac3-4317-b7ac-bbe6656739ed admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:48.041381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75790b39-eac3-4317-b7ac-bbe6656739ed admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:48.046112 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533088b9-d50d-499b-a8f0-bca282196d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:48.046778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533088b9-d50d-499b-a8f0-bca282196d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:48.047068 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533088b9-d50d-499b-a8f0-bca282196d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:48.047350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533088b9-d50d-499b-a8f0-bca282196d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:48.048076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533088b9-d50d-499b-a8f0-bca282196d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:48.049881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533088b9-d50d-499b-a8f0-bca282196d4d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:48.060921 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1000/2034] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:48.065270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7fbab-7e39-420b-b6bb-cd302b98b2f9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:48.075555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7fbab-7e39-420b-b6bb-cd302b98b2f9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:48.081377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9e9bf-1747-41b9-bcd6-ac5ad4791325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:48.082260 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9e9bf-1747-41b9-bcd6-ac5ad4791325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:48.082543 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9e9bf-1747-41b9-bcd6-ac5ad4791325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:48.082818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9e9bf-1747-41b9-bcd6-ac5ad4791325 admin admin] PATH_INFO: `/v3/projects/26701c393ba9426882a37c3ce997d6c5/users/c03e5d4bd9864bfc90e2c9b59f68afa2/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:48.100015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9e9bf-1747-41b9-bcd6-ac5ad4791325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26701c393ba9426882a37c3ce997d6c5, user_id=c03e5d4bd9864bfc90e2c9b59f68afa2, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:48.103208 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9e9bf-1747-41b9-bcd6-ac5ad4791325 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:48.116807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1035/2035] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:48 2022] PUT /identity/v3/projects/26701c393ba9426882a37c3ce997d6c5/users/c03e5d4bd9864bfc90e2c9b59f68afa2/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:48.120718 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533088b9-d50d-499b-a8f0-bca282196d4d admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:48.130790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533088b9-d50d-499b-a8f0-bca282196d4d admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:48.191765 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd01c5c-6e4d-4784-8052-6358659620e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:48.192450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd01c5c-6e4d-4784-8052-6358659620e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:48.192736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd01c5c-6e4d-4784-8052-6358659620e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:48.193037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd01c5c-6e4d-4784-8052-6358659620e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:48.193774 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd01c5c-6e4d-4784-8052-6358659620e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:48.195546 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd01c5c-6e4d-4784-8052-6358659620e2 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:48.205766 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1001/2036] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:48.210350 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9e9bf-1747-41b9-bcd6-ac5ad4791325 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:48.221761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9e9bf-1747-41b9-bcd6-ac5ad4791325 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:48.232559 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800b02a-8430-4952-bbd2-b614b4ee73a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:48.233622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b02a-8430-4952-bbd2-b614b4ee73a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:48.234791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b02a-8430-4952-bbd2-b614b4ee73a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:48.234791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b02a-8430-4952-bbd2-b614b4ee73a2 admin admin] PATH_INFO: `/v3/projects/26701c393ba9426882a37c3ce997d6c5/users/c03e5d4bd9864bfc90e2c9b59f68afa2/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:48.236422 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800b02a-8430-4952-bbd2-b614b4ee73a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26701c393ba9426882a37c3ce997d6c5, user_id=c03e5d4bd9864bfc90e2c9b59f68afa2, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:48.239188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800b02a-8430-4952-bbd2-b614b4ee73a2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:48.250478 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1036/2037] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:48 2022] PUT /identity/v3/projects/26701c393ba9426882a37c3ce997d6c5/users/c03e5d4bd9864bfc90e2c9b59f68afa2/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:48.261753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9b53d-1ef2-47dc-919e-ed017d8fb33a None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:48.262047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9b53d-1ef2-47dc-919e-ed017d8fb33a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:48.262338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9b53d-1ef2-47dc-919e-ed017d8fb33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:48.289683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-d0a9b53d-1ef2-47dc-919e-ed017d8fb33a None None] MFA Rules not processed for user `c03e5d4bd9864bfc90e2c9b59f68afa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:48.290874 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d0a9b53d-1ef2-47dc-919e-ed017d8fb33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:48.356192 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1002/2038] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:48.367686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800b02a-8430-4952-bbd2-b614b4ee73a2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:48.418960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800b02a-8430-4952-bbd2-b614b4ee73a2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:48.422587 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f9591-d850-476b-b9ea-77e69cd43add service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:48.423221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f9591-d850-476b-b9ea-77e69cd43add service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:48.423499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f9591-d850-476b-b9ea-77e69cd43add service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:48.423772 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f9591-d850-476b-b9ea-77e69cd43add service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:48.433187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f9591-d850-476b-b9ea-77e69cd43add service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:48.434599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f9591-d850-476b-b9ea-77e69cd43add service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:48.444054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1037/2039] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:49.702789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9b53d-1ef2-47dc-919e-ed017d8fb33a None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:49.767800 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9b53d-1ef2-47dc-919e-ed017d8fb33a None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:49.772607 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f616282-eaba-4d38-9909-78e5d91e8fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:49.773510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f616282-eaba-4d38-9909-78e5d91e8fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:49.773787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f616282-eaba-4d38-9909-78e5d91e8fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:49.774057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f616282-eaba-4d38-9909-78e5d91e8fce admin admin] PATH_INFO: `/v3/users/62054848574b43979cad909400f90f01` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:49.775235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f616282-eaba-4d38-9909-78e5d91e8fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=62054848574b43979cad909400f90f01)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:49.777169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f616282-eaba-4d38-9909-78e5d91e8fce admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:49.823779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9f616282-eaba-4d38-9909-78e5d91e8fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62054848574b43979cad909400f90f01'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:49.824487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9f616282-eaba-4d38-9909-78e5d91e8fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62054848574b43979cad909400f90f01'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:49.836235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9f616282-eaba-4d38-9909-78e5d91e8fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62054848574b43979cad909400f90f01'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:49.842868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9f616282-eaba-4d38-9909-78e5d91e8fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62054848574b43979cad909400f90f01'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:49.849810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9f616282-eaba-4d38-9909-78e5d91e8fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62054848574b43979cad909400f90f01'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:49.855541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1003/2040] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:49 2022] DELETE /identity/v3/users/62054848574b43979cad909400f90f01 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:49.860016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d11db2-379d-43bc-bc92-2e450a377314 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:49.860534 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d11db2-379d-43bc-bc92-2e450a377314 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:49.860631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d11db2-379d-43bc-bc92-2e450a377314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:49.878944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-15d11db2-379d-43bc-bc92-2e450a377314 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:49.880046 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-15d11db2-379d-43bc-bc92-2e450a377314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:49.937035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1038/2041] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:49.947161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f616282-eaba-4d38-9909-78e5d91e8fce admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:49.948517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9f616282-eaba-4d38-9909-78e5d91e8fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:50.004077 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f616282-eaba-4d38-9909-78e5d91e8fce admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:50.008366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca31e22-8d34-4978-99b8-9fcba74aea68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:50.009034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca31e22-8d34-4978-99b8-9fcba74aea68 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:50.009319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca31e22-8d34-4978-99b8-9fcba74aea68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:50.009595 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca31e22-8d34-4978-99b8-9fcba74aea68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:50.018613 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca31e22-8d34-4978-99b8-9fcba74aea68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:50.020057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca31e22-8d34-4978-99b8-9fcba74aea68 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:50.029680 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1004/2042] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:50.286946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d11db2-379d-43bc-bc92-2e450a377314 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:50.289470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-15d11db2-379d-43bc-bc92-2e450a377314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:50.309640 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d11db2-379d-43bc-bc92-2e450a377314 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:50.314973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:50.315938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:50.316296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:50.316648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] PATH_INFO: `/v3/projects/8a3045e2a6614624901ce5b64487f785` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:50.326134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a3045e2a6614624901ce5b64487f785)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:50.328605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:50.379988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a3045e2a6614624901ce5b64487f785', 'request_id': 'req-878e9254-3bff-4779-b939-faa159e72f75'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:50.383838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a3045e2a6614624901ce5b64487f785', 'request_id': 'req-878e9254-3bff-4779-b939-faa159e72f75'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:50.389976 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a3045e2a6614624901ce5b64487f785', 'request_id': 'req-878e9254-3bff-4779-b939-faa159e72f75'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:50.403169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] The token cache is being invalidate because project 8a3045e2a6614624901ce5b64487f785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:50.403453 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:50.404140 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:50.405814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1039/2043] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:50 2022] DELETE /identity/v3/projects/8a3045e2a6614624901ce5b64487f785 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:50.409815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca31e22-8d34-4978-99b8-9fcba74aea68 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:50.419632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca31e22-8d34-4978-99b8-9fcba74aea68 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:50.478412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7e7e7-f586-449b-9edc-f2543701efe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:50.479292 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7e7e7-f586-449b-9edc-f2543701efe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:50.479575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7e7e7-f586-449b-9edc-f2543701efe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:50.479853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7e7e7-f586-449b-9edc-f2543701efe0 admin admin] PATH_INFO: `/v3/users/c03e5d4bd9864bfc90e2c9b59f68afa2` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:50.481086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7e7e7-f586-449b-9edc-f2543701efe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c03e5d4bd9864bfc90e2c9b59f68afa2)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:50.482989 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7e7e7-f586-449b-9edc-f2543701efe0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:50.532583 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5df7e7e7-f586-449b-9edc-f2543701efe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c03e5d4bd9864bfc90e2c9b59f68afa2'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:50.533372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5df7e7e7-f586-449b-9edc-f2543701efe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c03e5d4bd9864bfc90e2c9b59f68afa2'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:50.546829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5df7e7e7-f586-449b-9edc-f2543701efe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c03e5d4bd9864bfc90e2c9b59f68afa2'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:50.554694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5df7e7e7-f586-449b-9edc-f2543701efe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c03e5d4bd9864bfc90e2c9b59f68afa2'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:50.563013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5df7e7e7-f586-449b-9edc-f2543701efe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c03e5d4bd9864bfc90e2c9b59f68afa2'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:50.570091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1005/2044] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:50 2022] DELETE /identity/v3/users/c03e5d4bd9864bfc90e2c9b59f68afa2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:50.901059 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:50.902506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:50.915816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e9254-3bff-4779-b939-faa159e72f75 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:50.976562 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:50.977509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:50.977801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:50.978079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8 admin admin] PATH_INFO: `/v3/projects/26701c393ba9426882a37c3ce997d6c5` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:50.979475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26701c393ba9426882a37c3ce997d6c5)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:50.981450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:51.026949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26701c393ba9426882a37c3ce997d6c5', 'request_id': 'req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:51.032786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26701c393ba9426882a37c3ce997d6c5', 'request_id': 'req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:51.039490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26701c393ba9426882a37c3ce997d6c5', 'request_id': 'req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:51.052605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8 admin admin] The token cache is being invalidate because project 26701c393ba9426882a37c3ce997d6c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:51.052896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:51.054124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-25e03fc2-c682-47bc-ab90-1e42bff5c0d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:51.055656 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1040/2045] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:50 2022] DELETE /identity/v3/projects/26701c393ba9426882a37c3ce997d6c5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:51.061802 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacef09-fa0d-44c0-bb6e-ad5c66a2865e None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:51.062298 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacef09-fa0d-44c0-bb6e-ad5c66a2865e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:51.062705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacef09-fa0d-44c0-bb6e-ad5c66a2865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:51.083262 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-bfacef09-fa0d-44c0-bb6e-ad5c66a2865e None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:51.084493 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-bfacef09-fa0d-44c0-bb6e-ad5c66a2865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:51.145325 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1006/2046] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:51.153650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823190e-5878-4bad-8e96-6c6a3bc89c65 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:51.153945 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823190e-5878-4bad-8e96-6c6a3bc89c65 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:51.154229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823190e-5878-4bad-8e96-6c6a3bc89c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:51.172455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f823190e-5878-4bad-8e96-6c6a3bc89c65 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:51.173597 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f823190e-5878-4bad-8e96-6c6a3bc89c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:51.182163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1041/2047] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:51.186418 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacef09-fa0d-44c0-bb6e-ad5c66a2865e None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:51.197437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacef09-fa0d-44c0-bb6e-ad5c66a2865e None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:51.201974 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce5950-0a9d-4511-855a-767315adfb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:51.202622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce5950-0a9d-4511-855a-767315adfb66 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:51.202903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce5950-0a9d-4511-855a-767315adfb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:51.203176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce5950-0a9d-4511-855a-767315adfb66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:51.203890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce5950-0a9d-4511-855a-767315adfb66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:28:51.204193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce5950-0a9d-4511-855a-767315adfb66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:51.205799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce5950-0a9d-4511-855a-767315adfb66 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:51.217849 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1007/2048] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:28:51.222039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823190e-5878-4bad-8e96-6c6a3bc89c65 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:51.231910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823190e-5878-4bad-8e96-6c6a3bc89c65 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:51.237069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef368b-6c76-41a5-b7cc-2d89c76dcda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:51.237719 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef368b-6c76-41a5-b7cc-2d89c76dcda7 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:51.238004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef368b-6c76-41a5-b7cc-2d89c76dcda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:51.238283 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef368b-6c76-41a5-b7cc-2d89c76dcda7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:51.239011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef368b-6c76-41a5-b7cc-2d89c76dcda7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:51.240941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef368b-6c76-41a5-b7cc-2d89c76dcda7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:51.264490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1042/2049] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:51 2022] POST /identity/v3/projects => generated 359 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:51.268427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce5950-0a9d-4511-855a-767315adfb66 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:51.278923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce5950-0a9d-4511-855a-767315adfb66 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:51.332434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006b07e-da26-4e8d-bce4-886e2666e807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:51.333134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006b07e-da26-4e8d-bce4-886e2666e807 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:51.333419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006b07e-da26-4e8d-bce4-886e2666e807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:51.333691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006b07e-da26-4e8d-bce4-886e2666e807 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:51.335476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006b07e-da26-4e8d-bce4-886e2666e807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:51.337760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006b07e-da26-4e8d-bce4-886e2666e807 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:51.360966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1008/2050] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:51 2022] POST /identity/v3/users => generated 280 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:51.362901 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef368b-6c76-41a5-b7cc-2d89c76dcda7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:51.373375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef368b-6c76-41a5-b7cc-2d89c76dcda7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:51.378120 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4899994-ed89-4264-82bb-ec2d5c59d3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:51.378877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899994-ed89-4264-82bb-ec2d5c59d3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:51.379236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899994-ed89-4264-82bb-ec2d5c59d3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:51.379594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899994-ed89-4264-82bb-ec2d5c59d3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:51.380398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4899994-ed89-4264-82bb-ec2d5c59d3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:51.382108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4899994-ed89-4264-82bb-ec2d5c59d3d8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:51.392670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1043/2051] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:51.397046 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006b07e-da26-4e8d-bce4-886e2666e807 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:51.407623 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006b07e-da26-4e8d-bce4-886e2666e807 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:51.412561 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71646ae2-c330-43fd-9a1f-cfbfa7955361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:51.414003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71646ae2-c330-43fd-9a1f-cfbfa7955361 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:51.414358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71646ae2-c330-43fd-9a1f-cfbfa7955361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:51.414705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71646ae2-c330-43fd-9a1f-cfbfa7955361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:51.415513 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71646ae2-c330-43fd-9a1f-cfbfa7955361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:51.417207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71646ae2-c330-43fd-9a1f-cfbfa7955361 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:51.427285 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1009/2052] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:51.431369 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4899994-ed89-4264-82bb-ec2d5c59d3d8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:51.441062 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4899994-ed89-4264-82bb-ec2d5c59d3d8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:51.445948 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2bebc-e177-4a32-a323-4e7901533b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:51.446813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2bebc-e177-4a32-a323-4e7901533b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:51.447097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2bebc-e177-4a32-a323-4e7901533b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:51.447370 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2bebc-e177-4a32-a323-4e7901533b8c admin admin] PATH_INFO: `/v3/projects/1c1a77d0294d4cde817172c9950009ab/users/0388e211175240b581045c0a7f043c60/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:51.463798 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2bebc-e177-4a32-a323-4e7901533b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1a77d0294d4cde817172c9950009ab, user_id=0388e211175240b581045c0a7f043c60, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:51.466525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2bebc-e177-4a32-a323-4e7901533b8c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:51.480221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1044/2053] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:51 2022] PUT /identity/v3/projects/1c1a77d0294d4cde817172c9950009ab/users/0388e211175240b581045c0a7f043c60/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:51.490417 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68962bce-d9a0-4aff-b992-faf3de4426e1 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:51.490715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68962bce-d9a0-4aff-b992-faf3de4426e1 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:51.491618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68962bce-d9a0-4aff-b992-faf3de4426e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:51.518604 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-68962bce-d9a0-4aff-b992-faf3de4426e1 None None] MFA Rules not processed for user `0388e211175240b581045c0a7f043c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:51.519796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-68962bce-d9a0-4aff-b992-faf3de4426e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:51.580907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1010/2054] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:51 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:51.611339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2bebc-e177-4a32-a323-4e7901533b8c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:51.613044 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d6e2bebc-e177-4a32-a323-4e7901533b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:51.666947 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2bebc-e177-4a32-a323-4e7901533b8c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:51.670593 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00168d-e429-4b05-afaa-2179496dcff8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:51.671230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00168d-e429-4b05-afaa-2179496dcff8 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:51.671511 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00168d-e429-4b05-afaa-2179496dcff8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:51.671783 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00168d-e429-4b05-afaa-2179496dcff8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:51.680469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00168d-e429-4b05-afaa-2179496dcff8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:51.681855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00168d-e429-4b05-afaa-2179496dcff8 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:51.697375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1045/2055] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:51 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:51.711158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68962bce-d9a0-4aff-b992-faf3de4426e1 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:51.771779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68962bce-d9a0-4aff-b992-faf3de4426e1 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:51.776695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4b6fa-1f83-4e02-a781-cb57ae4b2e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:51.777582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4b6fa-1f83-4e02-a781-cb57ae4b2e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:51.777864 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4b6fa-1f83-4e02-a781-cb57ae4b2e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:51.778139 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4b6fa-1f83-4e02-a781-cb57ae4b2e4b admin admin] PATH_INFO: `/v3/users/0388e211175240b581045c0a7f043c60` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:51.779319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4b6fa-1f83-4e02-a781-cb57ae4b2e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0388e211175240b581045c0a7f043c60)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:51.781541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4b6fa-1f83-4e02-a781-cb57ae4b2e4b admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:51.827324 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-80d4b6fa-1f83-4e02-a781-cb57ae4b2e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0388e211175240b581045c0a7f043c60'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:51.827993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-80d4b6fa-1f83-4e02-a781-cb57ae4b2e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0388e211175240b581045c0a7f043c60'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:51.840018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-80d4b6fa-1f83-4e02-a781-cb57ae4b2e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0388e211175240b581045c0a7f043c60'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:51.846867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-80d4b6fa-1f83-4e02-a781-cb57ae4b2e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0388e211175240b581045c0a7f043c60'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:51.854502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-80d4b6fa-1f83-4e02-a781-cb57ae4b2e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0388e211175240b581045c0a7f043c60'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:51.860597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1011/2056] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:51 2022] DELETE /identity/v3/users/0388e211175240b581045c0a7f043c60 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:51.864850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04e98f-7c92-4deb-bd45-718a7b8666b3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:51.865196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04e98f-7c92-4deb-bd45-718a7b8666b3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:51.865460 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04e98f-7c92-4deb-bd45-718a7b8666b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:51.883558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ed04e98f-7c92-4deb-bd45-718a7b8666b3 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:51.885008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ed04e98f-7c92-4deb-bd45-718a7b8666b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:51.941615 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1046/2057] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:51.951304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4b6fa-1f83-4e02-a781-cb57ae4b2e4b admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:51.952717 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-80d4b6fa-1f83-4e02-a781-cb57ae4b2e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:52.008235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4b6fa-1f83-4e02-a781-cb57ae4b2e4b admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:52.011843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058d0a6-f2d9-4f58-ae50-fee6fb0ab8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:52.012482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058d0a6-f2d9-4f58-ae50-fee6fb0ab8ae service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:52.012767 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058d0a6-f2d9-4f58-ae50-fee6fb0ab8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:52.013075 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058d0a6-f2d9-4f58-ae50-fee6fb0ab8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:52.021883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058d0a6-f2d9-4f58-ae50-fee6fb0ab8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:52.023816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058d0a6-f2d9-4f58-ae50-fee6fb0ab8ae service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:52.033073 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1012/2058] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:52.286464 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04e98f-7c92-4deb-bd45-718a7b8666b3 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:52.288410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ed04e98f-7c92-4deb-bd45-718a7b8666b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:52.305096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04e98f-7c92-4deb-bd45-718a7b8666b3 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:52.310628 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e488567-4efe-48d4-a625-571ea9fe1216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:52.311557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488567-4efe-48d4-a625-571ea9fe1216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:52.312074 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488567-4efe-48d4-a625-571ea9fe1216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:52.312504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e488567-4efe-48d4-a625-571ea9fe1216 admin admin] PATH_INFO: `/v3/projects/1c1a77d0294d4cde817172c9950009ab` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:52.313977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e488567-4efe-48d4-a625-571ea9fe1216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1a77d0294d4cde817172c9950009ab)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:52.315876 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e488567-4efe-48d4-a625-571ea9fe1216 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:52.364550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1e488567-4efe-48d4-a625-571ea9fe1216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1a77d0294d4cde817172c9950009ab', 'request_id': 'req-1e488567-4efe-48d4-a625-571ea9fe1216'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:52.370153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1e488567-4efe-48d4-a625-571ea9fe1216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1a77d0294d4cde817172c9950009ab', 'request_id': 'req-1e488567-4efe-48d4-a625-571ea9fe1216'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:52.376772 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1e488567-4efe-48d4-a625-571ea9fe1216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1a77d0294d4cde817172c9950009ab', 'request_id': 'req-1e488567-4efe-48d4-a625-571ea9fe1216'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:52.388951 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1e488567-4efe-48d4-a625-571ea9fe1216 admin admin] The token cache is being invalidate because project 1c1a77d0294d4cde817172c9950009ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:52.389267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1e488567-4efe-48d4-a625-571ea9fe1216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:52.389888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1e488567-4efe-48d4-a625-571ea9fe1216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:52.391413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1047/2059] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:52 2022] DELETE /identity/v3/projects/1c1a77d0294d4cde817172c9950009ab => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:52.396132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf5bd7-65be-4b95-8dbc-cb54dc8682ba None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:52.396603 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf5bd7-65be-4b95-8dbc-cb54dc8682ba None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:52.396694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf5bd7-65be-4b95-8dbc-cb54dc8682ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:52.414406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-aadf5bd7-65be-4b95-8dbc-cb54dc8682ba None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:52.415581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-aadf5bd7-65be-4b95-8dbc-cb54dc8682ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:52.472129 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1013/2060] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:52.480679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8cf2e-448d-4ab8-b2cf-b3ee0c954400 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:52.480954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8cf2e-448d-4ab8-b2cf-b3ee0c954400 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:52.481261 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8cf2e-448d-4ab8-b2cf-b3ee0c954400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:52.498902 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f3a8cf2e-448d-4ab8-b2cf-b3ee0c954400 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:52.500138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f3a8cf2e-448d-4ab8-b2cf-b3ee0c954400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:52.508714 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1048/2061] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:52.512802 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf5bd7-65be-4b95-8dbc-cb54dc8682ba None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:52.523382 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf5bd7-65be-4b95-8dbc-cb54dc8682ba None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:52.528166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a3d8a-57f4-4377-b606-0b37bcb16935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:52.528846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a3d8a-57f4-4377-b606-0b37bcb16935 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:52.529164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a3d8a-57f4-4377-b606-0b37bcb16935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:52.529440 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a3d8a-57f4-4377-b606-0b37bcb16935 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:52.530163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a3d8a-57f4-4377-b606-0b37bcb16935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:28:52.530474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a3d8a-57f4-4377-b606-0b37bcb16935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:52.532046 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a3d8a-57f4-4377-b606-0b37bcb16935 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:52.546710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1014/2062] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:28:52.548088 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8cf2e-448d-4ab8-b2cf-b3ee0c954400 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:52.557332 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8cf2e-448d-4ab8-b2cf-b3ee0c954400 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:52.562113 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf433b09-6077-41e6-8e0a-d326104b0060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:52.562838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf433b09-6077-41e6-8e0a-d326104b0060 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:52.563193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf433b09-6077-41e6-8e0a-d326104b0060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:52.563540 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf433b09-6077-41e6-8e0a-d326104b0060 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:52.564307 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf433b09-6077-41e6-8e0a-d326104b0060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:52.566324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf433b09-6077-41e6-8e0a-d326104b0060 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:52.593298 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1049/2063] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:52 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:52.597279 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a3d8a-57f4-4377-b606-0b37bcb16935 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:52.606883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a3d8a-57f4-4377-b606-0b37bcb16935 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:52.663154 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3df3a-036e-4f06-a025-38a7e949fc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:52.663835 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3df3a-036e-4f06-a025-38a7e949fc6c admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:52.664114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3df3a-036e-4f06-a025-38a7e949fc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:52.664386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3df3a-036e-4f06-a025-38a7e949fc6c admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:52.665102 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3df3a-036e-4f06-a025-38a7e949fc6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:52.667135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3df3a-036e-4f06-a025-38a7e949fc6c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:52.686881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1015/2064] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:52 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:52.691098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf433b09-6077-41e6-8e0a-d326104b0060 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:52.702312 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf433b09-6077-41e6-8e0a-d326104b0060 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:52.707163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc39e8-cf5a-4ee5-ae3c-f97187c4ce18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:52.707812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc39e8-cf5a-4ee5-ae3c-f97187c4ce18 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:52.708092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc39e8-cf5a-4ee5-ae3c-f97187c4ce18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:52.708363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc39e8-cf5a-4ee5-ae3c-f97187c4ce18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:52.709107 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc39e8-cf5a-4ee5-ae3c-f97187c4ce18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:52.711236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc39e8-cf5a-4ee5-ae3c-f97187c4ce18 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:52.721109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1050/2065] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:52.724849 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3df3a-036e-4f06-a025-38a7e949fc6c admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:52.735390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3df3a-036e-4f06-a025-38a7e949fc6c admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:52.740161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e3824-10a8-4ef8-a02b-60d83c5daca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:52.741393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e3824-10a8-4ef8-a02b-60d83c5daca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:52.741684 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e3824-10a8-4ef8-a02b-60d83c5daca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:52.741991 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e3824-10a8-4ef8-a02b-60d83c5daca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:52.742728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e3824-10a8-4ef8-a02b-60d83c5daca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:52.744331 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e3824-10a8-4ef8-a02b-60d83c5daca2 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:52.754892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1016/2066] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:52.759589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc39e8-cf5a-4ee5-ae3c-f97187c4ce18 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:52.769237 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc39e8-cf5a-4ee5-ae3c-f97187c4ce18 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:52.774214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8aeaeb-164c-42a4-9bef-510caee0070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:52.775085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aeaeb-164c-42a4-9bef-510caee0070d admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:52.775363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aeaeb-164c-42a4-9bef-510caee0070d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:52.775636 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8aeaeb-164c-42a4-9bef-510caee0070d admin admin] PATH_INFO: `/v3/projects/a24528148d9444038c71b83c90aa026e/users/968e45f60cb74bd9b16b2c74801071fb/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:52.792651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8aeaeb-164c-42a4-9bef-510caee0070d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24528148d9444038c71b83c90aa026e, user_id=968e45f60cb74bd9b16b2c74801071fb, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:52.796246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8aeaeb-164c-42a4-9bef-510caee0070d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:52.809938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1051/2067] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:52 2022] PUT /identity/v3/projects/a24528148d9444038c71b83c90aa026e/users/968e45f60cb74bd9b16b2c74801071fb/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:52.814963 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d0fef-91a4-47e5-b4f4-6260b8c94c99 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:52.815256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d0fef-91a4-47e5-b4f4-6260b8c94c99 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:52.815569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d0fef-91a4-47e5-b4f4-6260b8c94c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:52.833606 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-895d0fef-91a4-47e5-b4f4-6260b8c94c99 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:52.835403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-895d0fef-91a4-47e5-b4f4-6260b8c94c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:52.893517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1017/2068] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:28:52.903513 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8aeaeb-164c-42a4-9bef-510caee0070d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:52.905210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ff8aeaeb-164c-42a4-9bef-510caee0070d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:52.962017 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8aeaeb-164c-42a4-9bef-510caee0070d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:52.965716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123aebc-db4a-4e8e-91b5-0bc6e1b95940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:52.966358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123aebc-db4a-4e8e-91b5-0bc6e1b95940 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:52.966640 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123aebc-db4a-4e8e-91b5-0bc6e1b95940 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:52.966941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123aebc-db4a-4e8e-91b5-0bc6e1b95940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:52.977111 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123aebc-db4a-4e8e-91b5-0bc6e1b95940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:52.978519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123aebc-db4a-4e8e-91b5-0bc6e1b95940 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:52.987884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1052/2069] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:53.571599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bf713-748c-4562-b3fc-28129038bef7 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:53.572147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bf713-748c-4562-b3fc-28129038bef7 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:53.572147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bf713-748c-4562-b3fc-28129038bef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:53.598199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-f15bf713-748c-4562-b3fc-28129038bef7 None None] MFA Rules not processed for user `968e45f60cb74bd9b16b2c74801071fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:53.599463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f15bf713-748c-4562-b3fc-28129038bef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:53.664871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1018/2070] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:53.675350 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123aebc-db4a-4e8e-91b5-0bc6e1b95940 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:53.676740 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6123aebc-db4a-4e8e-91b5-0bc6e1b95940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:53.745716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123aebc-db4a-4e8e-91b5-0bc6e1b95940 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:53.750016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc808d0-df67-4f90-b739-3e474264a7f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:53.750665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc808d0-df67-4f90-b739-3e474264a7f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:53.751073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc808d0-df67-4f90-b739-3e474264a7f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:53.751356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc808d0-df67-4f90-b739-3e474264a7f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:53.761631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc808d0-df67-4f90-b739-3e474264a7f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:53.763156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc808d0-df67-4f90-b739-3e474264a7f7 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:53.773318 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1053/2071] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:54.969620 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bf713-748c-4562-b3fc-28129038bef7 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:54.971073 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f15bf713-748c-4562-b3fc-28129038bef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:54.990477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bf713-748c-4562-b3fc-28129038bef7 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:55.004492 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c718a-0b1f-48b8-8962-e499360cb849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:55.005529 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c718a-0b1f-48b8-8962-e499360cb849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:55.005873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c718a-0b1f-48b8-8962-e499360cb849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:55.006153 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c718a-0b1f-48b8-8962-e499360cb849 admin admin] PATH_INFO: `/v3/users/3bf23da251f64f01bce23135fdd5e4f4` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:55.009167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c718a-0b1f-48b8-8962-e499360cb849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf23da251f64f01bce23135fdd5e4f4)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:55.011132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c718a-0b1f-48b8-8962-e499360cb849 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:55.061907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-db9c718a-0b1f-48b8-8962-e499360cb849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf23da251f64f01bce23135fdd5e4f4'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.062558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-db9c718a-0b1f-48b8-8962-e499360cb849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf23da251f64f01bce23135fdd5e4f4'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.075337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-db9c718a-0b1f-48b8-8962-e499360cb849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf23da251f64f01bce23135fdd5e4f4'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.083277 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-db9c718a-0b1f-48b8-8962-e499360cb849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf23da251f64f01bce23135fdd5e4f4'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.090868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-db9c718a-0b1f-48b8-8962-e499360cb849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf23da251f64f01bce23135fdd5e4f4'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.097216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc808d0-df67-4f90-b739-3e474264a7f7 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:55.098761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6cc808d0-df67-4f90-b739-3e474264a7f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:55.101191 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1019/2072] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:54 2022] DELETE /identity/v3/users/3bf23da251f64f01bce23135fdd5e4f4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:55.105488 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d723c-f88a-45f5-98fc-dc7fe76ea36d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:55.105785 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d723c-f88a-45f5-98fc-dc7fe76ea36d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:55.106068 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d723c-f88a-45f5-98fc-dc7fe76ea36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:55.113866 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc808d0-df67-4f90-b739-3e474264a7f7 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:55.124891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-2d3d723c-f88a-45f5-98fc-dc7fe76ea36d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:55.126138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2d3d723c-f88a-45f5-98fc-dc7fe76ea36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:55.169671 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f966906-2e0c-4b16-aa78-cba313a238e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:55.170570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f966906-2e0c-4b16-aa78-cba313a238e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:55.170858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f966906-2e0c-4b16-aa78-cba313a238e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:55.171138 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f966906-2e0c-4b16-aa78-cba313a238e0 admin admin] PATH_INFO: `/v3/users/ed12a733cde84fabad93d468146706b7` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:55.172375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f966906-2e0c-4b16-aa78-cba313a238e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed12a733cde84fabad93d468146706b7)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:55.174338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f966906-2e0c-4b16-aa78-cba313a238e0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:55.184681 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1020/2073] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:28:55.186027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071aa02-7936-42ca-9cfe-e95e44dcd036 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:55.186327 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071aa02-7936-42ca-9cfe-e95e44dcd036 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:55.186612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071aa02-7936-42ca-9cfe-e95e44dcd036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:55.205920 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-8071aa02-7936-42ca-9cfe-e95e44dcd036 None None] MFA Rules not processed for user `968e45f60cb74bd9b16b2c74801071fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:55.207319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-8071aa02-7936-42ca-9cfe-e95e44dcd036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:55.218997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4f966906-2e0c-4b16-aa78-cba313a238e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed12a733cde84fabad93d468146706b7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.230370 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4f966906-2e0c-4b16-aa78-cba313a238e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed12a733cde84fabad93d468146706b7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.237029 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4f966906-2e0c-4b16-aa78-cba313a238e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed12a733cde84fabad93d468146706b7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.237659 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4f966906-2e0c-4b16-aa78-cba313a238e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed12a733cde84fabad93d468146706b7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.245401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4f966906-2e0c-4b16-aa78-cba313a238e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed12a733cde84fabad93d468146706b7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.251220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1054/2074] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:55 2022] DELETE /identity/v3/users/ed12a733cde84fabad93d468146706b7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:55.251993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f966906-2e0c-4b16-aa78-cba313a238e0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:55.255232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4f966906-2e0c-4b16-aa78-cba313a238e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:55.262060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1021/2075] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:55.262920 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b654fc-e54c-4da9-9598-839dc4b433ae None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:55.263221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b654fc-e54c-4da9-9598-839dc4b433ae None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:55.263495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b654fc-e54c-4da9-9598-839dc4b433ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:55.285961 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-53b654fc-e54c-4da9-9598-839dc4b433ae None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:55.287412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-53b654fc-e54c-4da9-9598-839dc4b433ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:55.324666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f966906-2e0c-4b16-aa78-cba313a238e0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:55.328407 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8ea7a-0bb8-4c6c-90b3-c78ca340f59a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:55.329121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8ea7a-0bb8-4c6c-90b3-c78ca340f59a service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:55.329354 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8ea7a-0bb8-4c6c-90b3-c78ca340f59a service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:55.329632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8ea7a-0bb8-4c6c-90b3-c78ca340f59a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:55.332152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-20e8ea7a-0bb8-4c6c-90b3-c78ca340f59a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:55.357856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1022/2076] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:55.367764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b654fc-e54c-4da9-9598-839dc4b433ae None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:55.378194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b654fc-e54c-4da9-9598-839dc4b433ae None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:55.382080 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde257e-de84-4904-9d24-8c46d38e7abe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:55.382732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde257e-de84-4904-9d24-8c46d38e7abe service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:55.383020 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde257e-de84-4904-9d24-8c46d38e7abe service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:55.383300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde257e-de84-4904-9d24-8c46d38e7abe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:55.396359 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde257e-de84-4904-9d24-8c46d38e7abe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:55.398123 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde257e-de84-4904-9d24-8c46d38e7abe service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:55.400367 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8ea7a-0bb8-4c6c-90b3-c78ca340f59a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:55.402024 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8ea7a-0bb8-4c6c-90b3-c78ca340f59a service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:55.407993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1023/2077] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:28:55.412225 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1055/2078] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:55.660247 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde257e-de84-4904-9d24-8c46d38e7abe service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:55.661846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2fde257e-de84-4904-9d24-8c46d38e7abe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:55.676754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde257e-de84-4904-9d24-8c46d38e7abe service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:55.682386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd922ec-e20c-4054-b390-c7e951aa114f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:55.683281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd922ec-e20c-4054-b390-c7e951aa114f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:55.683569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd922ec-e20c-4054-b390-c7e951aa114f admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:55.683849 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd922ec-e20c-4054-b390-c7e951aa114f admin admin] PATH_INFO: `/v3/users/bbe0ff9b94af473dab335ca578b470f1` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:55.685151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd922ec-e20c-4054-b390-c7e951aa114f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbe0ff9b94af473dab335ca578b470f1)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:55.687109 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd922ec-e20c-4054-b390-c7e951aa114f admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:55.744534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bcd922ec-e20c-4054-b390-c7e951aa114f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbe0ff9b94af473dab335ca578b470f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.745398 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bcd922ec-e20c-4054-b390-c7e951aa114f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbe0ff9b94af473dab335ca578b470f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.759256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bcd922ec-e20c-4054-b390-c7e951aa114f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbe0ff9b94af473dab335ca578b470f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.766675 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bcd922ec-e20c-4054-b390-c7e951aa114f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbe0ff9b94af473dab335ca578b470f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.775634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bcd922ec-e20c-4054-b390-c7e951aa114f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbe0ff9b94af473dab335ca578b470f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:55.785058 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1024/2079] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:55 2022] DELETE /identity/v3/users/bbe0ff9b94af473dab335ca578b470f1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:55.787436 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0abe2-904e-43b4-8691-4b5789c2bda4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:55.788302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0abe2-904e-43b4-8691-4b5789c2bda4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:55.788589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd0abe2-904e-43b4-8691-4b5789c2bda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:55.807541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8dd0abe2-904e-43b4-8691-4b5789c2bda4 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:55.808926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8dd0abe2-904e-43b4-8691-4b5789c2bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:55.874734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1056/2080] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:55.888308 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd922ec-e20c-4054-b390-c7e951aa114f admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:55.890032 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-bcd922ec-e20c-4054-b390-c7e951aa114f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:55.906603 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0abe2-904e-43b4-8691-4b5789c2bda4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:55.908038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8dd0abe2-904e-43b4-8691-4b5789c2bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:55.924316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd0abe2-904e-43b4-8691-4b5789c2bda4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:55.930813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:55.932991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:55.933288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:55.933562 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] PATH_INFO: `/v3/projects/dfb02902e5b849c388f6c1a3d70b5904` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:55.936348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb02902e5b849c388f6c1a3d70b5904)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:55.938759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:55.992475 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd922ec-e20c-4054-b390-c7e951aa114f admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:56.002412 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb02902e5b849c388f6c1a3d70b5904', 'request_id': 'req-c67c622c-9a2f-4a82-bd04-96fb8d00c668'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.010026 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb02902e5b849c388f6c1a3d70b5904', 'request_id': 'req-c67c622c-9a2f-4a82-bd04-96fb8d00c668'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.016276 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb02902e5b849c388f6c1a3d70b5904', 'request_id': 'req-c67c622c-9a2f-4a82-bd04-96fb8d00c668'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.041571 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] The token cache is being invalidate because project dfb02902e5b849c388f6c1a3d70b5904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:56.041957 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.042688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.047943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1057/2081] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:55 2022] DELETE /identity/v3/projects/dfb02902e5b849c388f6c1a3d70b5904 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:56.047943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:56.047943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:56.062888 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bc047-9e77-4771-9944-9a850774627d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:56.063694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bc047-9e77-4771-9944-9a850774627d service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:56.064048 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bc047-9e77-4771-9944-9a850774627d service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:56.064716 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bc047-9e77-4771-9944-9a850774627d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:56.066874 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-cc6bc047-9e77-4771-9944-9a850774627d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:56.160054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c622c-9a2f-4a82-bd04-96fb8d00c668 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:56.167310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bc047-9e77-4771-9944-9a850774627d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:56.169014 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bc047-9e77-4771-9944-9a850774627d service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:56.174448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:56.175577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:56.176344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:56.177127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] PATH_INFO: `/v3/projects/6a85e80a428e438caa16b6c3848f387d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:56.180579 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a85e80a428e438caa16b6c3848f387d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:56.182739 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:56.194389 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1025/2082] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:56.196450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e6c3-2f12-4483-b609-2b2f9721ebe8 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:56.196849 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e6c3-2f12-4483-b609-2b2f9721ebe8 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:56.197349 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e6c3-2f12-4483-b609-2b2f9721ebe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:56.219630 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-15a5e6c3-2f12-4483-b609-2b2f9721ebe8 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:56.220847 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-15a5e6c3-2f12-4483-b609-2b2f9721ebe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:56.238362 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a85e80a428e438caa16b6c3848f387d', 'request_id': 'req-422d5cde-068b-4b96-9dab-779b83c92b79'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.247621 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a85e80a428e438caa16b6c3848f387d', 'request_id': 'req-422d5cde-068b-4b96-9dab-779b83c92b79'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.257639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a85e80a428e438caa16b6c3848f387d', 'request_id': 'req-422d5cde-068b-4b96-9dab-779b83c92b79'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.279437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] The token cache is being invalidate because project 6a85e80a428e438caa16b6c3848f387d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:56.279845 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.281006 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.285044 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1058/2083] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:56 2022] DELETE /identity/v3/projects/6a85e80a428e438caa16b6c3848f387d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:56.294310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:56.296379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:56.301319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1026/2084] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:56.310506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c16b-c964-4546-8e39-e7151ed5612d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:56.310932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c16b-c964-4546-8e39-e7151ed5612d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:56.311102 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c16b-c964-4546-8e39-e7151ed5612d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:56.318602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d5cde-068b-4b96-9dab-779b83c92b79 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:56.324390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f9b16-9a74-433b-8312-def7fa005ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:56.325400 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f9b16-9a74-433b-8312-def7fa005ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:56.325687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f9b16-9a74-433b-8312-def7fa005ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:56.325971 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f9b16-9a74-433b-8312-def7fa005ccb admin admin] PATH_INFO: `/v3/users/95e32a0229cd45c3927c70390974efd1` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:56.327737 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f9b16-9a74-433b-8312-def7fa005ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=95e32a0229cd45c3927c70390974efd1)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:56.330224 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f9b16-9a74-433b-8312-def7fa005ccb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:56.332940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-4406c16b-c964-4546-8e39-e7151ed5612d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:56.334202 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-4406c16b-c964-4546-8e39-e7151ed5612d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:56.342630 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1027/2085] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:28:56.346970 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406c16b-c964-4546-8e39-e7151ed5612d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:56.356949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406c16b-c964-4546-8e39-e7151ed5612d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:56.363618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb3ff4-8df7-4354-8bb0-1ce85340812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:56.364253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb3ff4-8df7-4354-8bb0-1ce85340812b admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:56.364603 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb3ff4-8df7-4354-8bb0-1ce85340812b admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:56.364818 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb3ff4-8df7-4354-8bb0-1ce85340812b admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:56.366616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb3ff4-8df7-4354-8bb0-1ce85340812b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:28:56.367426 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb3ff4-8df7-4354-8bb0-1ce85340812b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:56.368527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb3ff4-8df7-4354-8bb0-1ce85340812b admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:56.386313 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1028/2086] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:28:56.387260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb3ff4-8df7-4354-8bb0-1ce85340812b admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:56.400219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb3ff4-8df7-4354-8bb0-1ce85340812b admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:56.400309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc1f9b16-9a74-433b-8312-def7fa005ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95e32a0229cd45c3927c70390974efd1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.410724 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13d505-5bec-479b-9af3-272ed8a5ca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:56.411666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13d505-5bec-479b-9af3-272ed8a5ca62 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:56.411960 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13d505-5bec-479b-9af3-272ed8a5ca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:56.412252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e13d505-5bec-479b-9af3-272ed8a5ca62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:56.414956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13d505-5bec-479b-9af3-272ed8a5ca62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:56.417434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e13d505-5bec-479b-9af3-272ed8a5ca62 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:56.417848 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc1f9b16-9a74-433b-8312-def7fa005ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95e32a0229cd45c3927c70390974efd1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.434162 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc1f9b16-9a74-433b-8312-def7fa005ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95e32a0229cd45c3927c70390974efd1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.435751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc1f9b16-9a74-433b-8312-def7fa005ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95e32a0229cd45c3927c70390974efd1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.447090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc1f9b16-9a74-433b-8312-def7fa005ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95e32a0229cd45c3927c70390974efd1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.457869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1059/2087] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:56 2022] DELETE /identity/v3/users/95e32a0229cd45c3927c70390974efd1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:56.458083 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1029/2088] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:56 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:56.460926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f9b16-9a74-433b-8312-def7fa005ccb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:56.462411 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fc1f9b16-9a74-433b-8312-def7fa005ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:56.555182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13d505-5bec-479b-9af3-272ed8a5ca62 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:56.557204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5e13d505-5bec-479b-9af3-272ed8a5ca62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:56.567458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f9b16-9a74-433b-8312-def7fa005ccb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:56.635930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e13d505-5bec-479b-9af3-272ed8a5ca62 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:56.647403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:56.648242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:56.648368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607159d-424e-49d6-8da3-a8697ebb17db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:56.648569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:56.648857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] PATH_INFO: `/v3/projects/4ab4b09d92cc430db74358a286d243e4` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:56.649235 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607159d-424e-49d6-8da3-a8697ebb17db admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:56.649638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607159d-424e-49d6-8da3-a8697ebb17db admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:56.649982 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607159d-424e-49d6-8da3-a8697ebb17db admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:56.650167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab4b09d92cc430db74358a286d243e4)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:56.650815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607159d-424e-49d6-8da3-a8697ebb17db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:56.652194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:56.653004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607159d-424e-49d6-8da3-a8697ebb17db admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:56.679150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1060/2089] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:56 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:56.680822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607159d-424e-49d6-8da3-a8697ebb17db admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:56.691577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607159d-424e-49d6-8da3-a8697ebb17db admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:56.710937 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab4b09d92cc430db74358a286d243e4', 'request_id': 'req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.719554 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab4b09d92cc430db74358a286d243e4', 'request_id': 'req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.726737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab4b09d92cc430db74358a286d243e4', 'request_id': 'req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.737716 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] The token cache is being invalidate because project 4ab4b09d92cc430db74358a286d243e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:56.738089 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.738937 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.740827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1030/2090] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:56 2022] DELETE /identity/v3/projects/4ab4b09d92cc430db74358a286d243e4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:56.744583 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:56.746138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:56.756660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864b3d8-59ff-41f2-99f5-0fed2c0c87dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:56.757380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864b3d8-59ff-41f2-99f5-0fed2c0c87dd admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:56.757668 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864b3d8-59ff-41f2-99f5-0fed2c0c87dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:56.757943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864b3d8-59ff-41f2-99f5-0fed2c0c87dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:56.758914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864b3d8-59ff-41f2-99f5-0fed2c0c87dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:56.760754 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864b3d8-59ff-41f2-99f5-0fed2c0c87dd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:56.775188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1061/2091] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:56.779203 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864b3d8-59ff-41f2-99f5-0fed2c0c87dd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:56.781156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a864b3d8-59ff-41f2-99f5-0fed2c0c87dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:56.793996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864b3d8-59ff-41f2-99f5-0fed2c0c87dd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:56.799311 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adca5ca-a058-440d-aef1-dafc978072bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:56.799914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adca5ca-a058-440d-aef1-dafc978072bb admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:56.800193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adca5ca-a058-440d-aef1-dafc978072bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:56.800474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adca5ca-a058-440d-aef1-dafc978072bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:56.801218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adca5ca-a058-440d-aef1-dafc978072bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:56.802812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adca5ca-a058-440d-aef1-dafc978072bb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:56.813460 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1062/2092] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:56.817460 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adca5ca-a058-440d-aef1-dafc978072bb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:56.819681 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0adca5ca-a058-440d-aef1-dafc978072bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:56.821853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b9e05-d21b-4e6d-aed5-51fe631d1ac0 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:56.827330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aa92e-8bfb-439b-a849-b71beea4098a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:56.828203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa92e-8bfb-439b-a849-b71beea4098a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:56.828489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa92e-8bfb-439b-a849-b71beea4098a admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:56.828771 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa92e-8bfb-439b-a849-b71beea4098a admin admin] PATH_INFO: `/v3/users/0abd96584bf34dd08e643ccde334f907` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:56.830027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404aa92e-8bfb-439b-a849-b71beea4098a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0abd96584bf34dd08e643ccde334f907)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:56.831971 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404aa92e-8bfb-439b-a849-b71beea4098a admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:56.832577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adca5ca-a058-440d-aef1-dafc978072bb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:56.837373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:56.838271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:56.838556 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:56.838831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] PATH_INFO: `/v3/projects/a6ec3f96e55c41f9a8b09618b8798bad` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:56.840047 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ec3f96e55c41f9a8b09618b8798bad)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:56.841925 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:56.884856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-404aa92e-8bfb-439b-a849-b71beea4098a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0abd96584bf34dd08e643ccde334f907'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.885770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-404aa92e-8bfb-439b-a849-b71beea4098a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0abd96584bf34dd08e643ccde334f907'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.896353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ec3f96e55c41f9a8b09618b8798bad', 'request_id': 'req-72c76fc7-e860-437c-972d-372b97f64c83'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.897894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-404aa92e-8bfb-439b-a849-b71beea4098a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0abd96584bf34dd08e643ccde334f907'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.901896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ec3f96e55c41f9a8b09618b8798bad', 'request_id': 'req-72c76fc7-e860-437c-972d-372b97f64c83'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.904610 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-404aa92e-8bfb-439b-a849-b71beea4098a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0abd96584bf34dd08e643ccde334f907'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.908276 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ec3f96e55c41f9a8b09618b8798bad', 'request_id': 'req-72c76fc7-e860-437c-972d-372b97f64c83'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.912275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-404aa92e-8bfb-439b-a849-b71beea4098a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0abd96584bf34dd08e643ccde334f907'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.919036 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1031/2093] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:56 2022] DELETE /identity/v3/users/0abd96584bf34dd08e643ccde334f907 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:56.919787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aa92e-8bfb-439b-a849-b71beea4098a admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:56.920639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] The token cache is being invalidate because project a6ec3f96e55c41f9a8b09618b8798bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:56.920929 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.921117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-404aa92e-8bfb-439b-a849-b71beea4098a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:56.921654 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:56.926617 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1063/2094] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:56 2022] DELETE /identity/v3/projects/a6ec3f96e55c41f9a8b09618b8798bad => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:56.931595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:56.933151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:56.996947 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aa92e-8bfb-439b-a849-b71beea4098a admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:57.003191 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4272f-7825-4fe8-b00e-981aedb6d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:57.004148 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4272f-7825-4fe8-b00e-981aedb6d421 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.004438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4272f-7825-4fe8-b00e-981aedb6d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.004715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4272f-7825-4fe8-b00e-981aedb6d421 admin admin] PATH_INFO: `/v3/projects/52b0cfc470434f328592d355e5df2324/users/0ab6d3c00b7c46318e28a8c8bb1a5ca0/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.014554 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c76fc7-e860-437c-972d-372b97f64c83 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:57.019392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885090b-8f3e-45a9-9fd9-a14f9623553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:57.020270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885090b-8f3e-45a9-9fd9-a14f9623553a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.020556 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885090b-8f3e-45a9-9fd9-a14f9623553a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.020834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885090b-8f3e-45a9-9fd9-a14f9623553a admin admin] PATH_INFO: `/v3/users/5ac0d3de62e44ebcadf1fe14fab405d4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.022687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885090b-8f3e-45a9-9fd9-a14f9623553a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac0d3de62e44ebcadf1fe14fab405d4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:57.023064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4272f-7825-4fe8-b00e-981aedb6d421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b0cfc470434f328592d355e5df2324, user_id=0ab6d3c00b7c46318e28a8c8bb1a5ca0, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:57.024641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885090b-8f3e-45a9-9fd9-a14f9623553a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:57.026225 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4272f-7825-4fe8-b00e-981aedb6d421 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:57.040857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1032/2095] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:56 2022] PUT /identity/v3/projects/52b0cfc470434f328592d355e5df2324/users/0ab6d3c00b7c46318e28a8c8bb1a5ca0/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:57.052890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976de27-a6d4-424f-81cb-0a09469d8b36 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.053477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976de27-a6d4-424f-81cb-0a09469d8b36 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.054261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976de27-a6d4-424f-81cb-0a09469d8b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.085510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e885090b-8f3e-45a9-9fd9-a14f9623553a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac0d3de62e44ebcadf1fe14fab405d4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.100707 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e885090b-8f3e-45a9-9fd9-a14f9623553a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac0d3de62e44ebcadf1fe14fab405d4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.102046 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6976de27-a6d4-424f-81cb-0a09469d8b36 None None] MFA Rules not processed for user `0ab6d3c00b7c46318e28a8c8bb1a5ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:57.103265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6976de27-a6d4-424f-81cb-0a09469d8b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:57.108133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e885090b-8f3e-45a9-9fd9-a14f9623553a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac0d3de62e44ebcadf1fe14fab405d4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.109547 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e885090b-8f3e-45a9-9fd9-a14f9623553a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac0d3de62e44ebcadf1fe14fab405d4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.118165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-e885090b-8f3e-45a9-9fd9-a14f9623553a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac0d3de62e44ebcadf1fe14fab405d4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.126333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1064/2096] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:28:56 2022] DELETE /identity/v3/users/5ac0d3de62e44ebcadf1fe14fab405d4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:28:57.175752 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1033/2097] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:28:57.180199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885090b-8f3e-45a9-9fd9-a14f9623553a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:57.182321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e885090b-8f3e-45a9-9fd9-a14f9623553a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:57.229248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976de27-a6d4-424f-81cb-0a09469d8b36 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:57.231085 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6976de27-a6d4-424f-81cb-0a09469d8b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:57.287994 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885090b-8f3e-45a9-9fd9-a14f9623553a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:57.293352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864d7d7-c028-4a2f-bcbb-57b5dbc06214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:57.294371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864d7d7-c028-4a2f-bcbb-57b5dbc06214 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.294807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864d7d7-c028-4a2f-bcbb-57b5dbc06214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.295187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864d7d7-c028-4a2f-bcbb-57b5dbc06214 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.297214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864d7d7-c028-4a2f-bcbb-57b5dbc06214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:57.299327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864d7d7-c028-4a2f-bcbb-57b5dbc06214 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:57.343551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1065/2098] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:57 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:57.348045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864d7d7-c028-4a2f-bcbb-57b5dbc06214 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:57.354695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976de27-a6d4-424f-81cb-0a09469d8b36 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:57.425066 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:57.426217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.427134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.427579 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] PATH_INFO: `/v3/projects/bb4fc4a6af604b5ba178c9b774bb37fb` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.429684 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb4fc4a6af604b5ba178c9b774bb37fb)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:57.431757 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:57.446183 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864d7d7-c028-4a2f-bcbb-57b5dbc06214 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:57.464283 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e131b-d928-4db2-93be-a3dacc8e19fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:57.466161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e131b-d928-4db2-93be-a3dacc8e19fc admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.466731 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e131b-d928-4db2-93be-a3dacc8e19fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.467313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e131b-d928-4db2-93be-a3dacc8e19fc admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.472888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e131b-d928-4db2-93be-a3dacc8e19fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:57.475126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e131b-d928-4db2-93be-a3dacc8e19fc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:57.498767 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1066/2099] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:57 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:57.499773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e131b-d928-4db2-93be-a3dacc8e19fc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:57.502470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-647e131b-d928-4db2-93be-a3dacc8e19fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:57.503176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb4fc4a6af604b5ba178c9b774bb37fb', 'request_id': 'req-770b2b3f-2b59-4595-b304-0a809cf04312'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.513383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb4fc4a6af604b5ba178c9b774bb37fb', 'request_id': 'req-770b2b3f-2b59-4595-b304-0a809cf04312'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.517833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e131b-d928-4db2-93be-a3dacc8e19fc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:57.520501 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb4fc4a6af604b5ba178c9b774bb37fb', 'request_id': 'req-770b2b3f-2b59-4595-b304-0a809cf04312'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.531515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] The token cache is being invalidate because project bb4fc4a6af604b5ba178c9b774bb37fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:57.531794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.532441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.534025 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1034/2100] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:57 2022] DELETE /identity/v3/projects/bb4fc4a6af604b5ba178c9b774bb37fb => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:57.537229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:57.538719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:57.577402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:57.578197 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.578452 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.578724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] PATH_INFO: `/v3/projects/5a5e2fb35301437da13196efc465eb37` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.579892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5e2fb35301437da13196efc465eb37)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:57.581855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:57.600491 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b2b3f-2b59-4595-b304-0a809cf04312 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:57.605209 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0318169-a12a-453b-b4c9-9f6e9903f651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:57.605871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0318169-a12a-453b-b4c9-9f6e9903f651 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.606150 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0318169-a12a-453b-b4c9-9f6e9903f651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.606549 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0318169-a12a-453b-b4c9-9f6e9903f651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.607384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0318169-a12a-453b-b4c9-9f6e9903f651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:57.609174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0318169-a12a-453b-b4c9-9f6e9903f651 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:57.619339 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1035/2101] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:57.620690 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adcdb0-156b-43df-b462-7abf110642a8 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.620998 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adcdb0-156b-43df-b462-7abf110642a8 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.621287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adcdb0-156b-43df-b462-7abf110642a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.628702 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5e2fb35301437da13196efc465eb37', 'request_id': 'req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.635890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5e2fb35301437da13196efc465eb37', 'request_id': 'req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.639632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-24adcdb0-156b-43df-b462-7abf110642a8 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:57.640848 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-24adcdb0-156b-43df-b462-7abf110642a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:57.643238 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5e2fb35301437da13196efc465eb37', 'request_id': 'req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.655611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] The token cache is being invalidate because project 5a5e2fb35301437da13196efc465eb37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:28:57.655893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.656520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:28:57.658291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1067/2102] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:28:57 2022] DELETE /identity/v3/projects/5a5e2fb35301437da13196efc465eb37 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:57.658915 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:57.660174 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:57.706354 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1036/2103] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:57.707644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187b83-a13a-4ced-b581-1d63a1ff2fba None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.707938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187b83-a13a-4ced-b581-1d63a1ff2fba None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.708213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab187b83-a13a-4ced-b581-1d63a1ff2fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.725254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8997fc-87a7-4ceb-a93a-8aed175a43a4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:57.729505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-ab187b83-a13a-4ced-b581-1d63a1ff2fba None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:57.729975 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab511e-cd46-499a-9037-522c630a8a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:57.730648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab511e-cd46-499a-9037-522c630a8a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.730753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ab187b83-a13a-4ced-b581-1d63a1ff2fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:57.730931 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab511e-cd46-499a-9037-522c630a8a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.731211 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab511e-cd46-499a-9037-522c630a8a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.731972 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab511e-cd46-499a-9037-522c630a8a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:57.733967 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab511e-cd46-499a-9037-522c630a8a5a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:57.744371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1068/2104] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:57.745712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64399e4-8aaa-469e-bc07-0b1fd937dff5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.746012 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64399e4-8aaa-469e-bc07-0b1fd937dff5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.746287 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64399e4-8aaa-469e-bc07-0b1fd937dff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.751610 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1037/2105] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:57.751610 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab187b83-a13a-4ced-b581-1d63a1ff2fba None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:57.762300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab187b83-a13a-4ced-b581-1d63a1ff2fba None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:57.764788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b64399e4-8aaa-469e-bc07-0b1fd937dff5 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:57.766054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b64399e4-8aaa-469e-bc07-0b1fd937dff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:57.767194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb2a57-38d5-4d4d-87b8-442034c00424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:57.768078 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb2a57-38d5-4d4d-87b8-442034c00424 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.768354 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb2a57-38d5-4d4d-87b8-442034c00424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.768624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb2a57-38d5-4d4d-87b8-442034c00424 admin admin] PATH_INFO: `/v3/projects/449743883078408a8189b340a8f376db/users/17e8214342554684bccecb69c1b63eb7/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.774722 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1069/2106] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:57.775944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c72352-bd2a-4833-996e-1a46083ea068 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.776236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c72352-bd2a-4833-996e-1a46083ea068 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.776515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c72352-bd2a-4833-996e-1a46083ea068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.784245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb2a57-38d5-4d4d-87b8-442034c00424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449743883078408a8189b340a8f376db, user_id=17e8214342554684bccecb69c1b63eb7, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:57.786349 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb2a57-38d5-4d4d-87b8-442034c00424 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:57.794616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-07c72352-bd2a-4833-996e-1a46083ea068 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:57.795796 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-07c72352-bd2a-4833-996e-1a46083ea068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:57.799039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1038/2107] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:57 2022] PUT /identity/v3/projects/449743883078408a8189b340a8f376db/users/17e8214342554684bccecb69c1b63eb7/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:57.799829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb2a57-38d5-4d4d-87b8-442034c00424 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:57.859426 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb2a57-38d5-4d4d-87b8-442034c00424 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:57.862115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1070/2108] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:57.863457 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195abfc-864c-49d8-b859-bb46b47af559 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.863751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195abfc-864c-49d8-b859-bb46b47af559 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.863955 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622e7c5-3446-4dd7-a5b4-c8b0e343de38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:57.864072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195abfc-864c-49d8-b859-bb46b47af559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.864666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622e7c5-3446-4dd7-a5b4-c8b0e343de38 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.865092 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622e7c5-3446-4dd7-a5b4-c8b0e343de38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.865459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622e7c5-3446-4dd7-a5b4-c8b0e343de38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.866120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622e7c5-3446-4dd7-a5b4-c8b0e343de38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:28:57.866426 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622e7c5-3446-4dd7-a5b4-c8b0e343de38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:57.868014 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622e7c5-3446-4dd7-a5b4-c8b0e343de38 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:57.883176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1039/2109] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:28:57.883176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622e7c5-3446-4dd7-a5b4-c8b0e343de38 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:57.889759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f195abfc-864c-49d8-b859-bb46b47af559 None None] MFA Rules not processed for user `17e8214342554684bccecb69c1b63eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:57.889892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622e7c5-3446-4dd7-a5b4-c8b0e343de38 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:57.890941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f195abfc-864c-49d8-b859-bb46b47af559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:57.894374 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53926c36-6f37-47dc-abc7-87b4fc1d49da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:57.894997 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53926c36-6f37-47dc-abc7-87b4fc1d49da admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.895277 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53926c36-6f37-47dc-abc7-87b4fc1d49da admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.895552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53926c36-6f37-47dc-abc7-87b4fc1d49da admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.896257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53926c36-6f37-47dc-abc7-87b4fc1d49da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:28:57.896563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53926c36-6f37-47dc-abc7-87b4fc1d49da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:57.898772 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53926c36-6f37-47dc-abc7-87b4fc1d49da admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:57.915470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1040/2110] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:28:57.915470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53926c36-6f37-47dc-abc7-87b4fc1d49da admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:57.921163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53926c36-6f37-47dc-abc7-87b4fc1d49da admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:57.926386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d619a6d-d7c4-47e4-ab3f-c8bb35896958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:57.927035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d619a6d-d7c4-47e4-ab3f-c8bb35896958 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:57.927316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d619a6d-d7c4-47e4-ab3f-c8bb35896958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:57.927586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d619a6d-d7c4-47e4-ab3f-c8bb35896958 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:57.928290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d619a6d-d7c4-47e4-ab3f-c8bb35896958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:57.930196 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d619a6d-d7c4-47e4-ab3f-c8bb35896958 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:57.953894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1071/2111] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:57.954715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195abfc-864c-49d8-b859-bb46b47af559 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:57.956021 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1041/2112] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:57 2022] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:57.958238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d619a6d-d7c4-47e4-ab3f-c8bb35896958 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:57.968418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195abfc-864c-49d8-b859-bb46b47af559 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.019860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d619a6d-d7c4-47e4-ab3f-c8bb35896958 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.026197 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc9e1f-5dc1-4fc7-868a-51cf76a45ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.026872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc9e1f-5dc1-4fc7-868a-51cf76a45ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.027648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc9e1f-5dc1-4fc7-868a-51cf76a45ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.027940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc9e1f-5dc1-4fc7-868a-51cf76a45ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.029080 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc9e1f-5dc1-4fc7-868a-51cf76a45ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.032386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc9e1f-5dc1-4fc7-868a-51cf76a45ee1 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.033859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a31233-15ed-4ffc-820a-baf8f9835986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.035002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a31233-15ed-4ffc-820a-baf8f9835986 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.035356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a31233-15ed-4ffc-820a-baf8f9835986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.035458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a31233-15ed-4ffc-820a-baf8f9835986 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.036085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a31233-15ed-4ffc-820a-baf8f9835986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.038071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a31233-15ed-4ffc-820a-baf8f9835986 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.060112 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1042/2113] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:57 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:58.061068 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc9e1f-5dc1-4fc7-868a-51cf76a45ee1 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.064171 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1072/2114] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:57 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:58.064966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a31233-15ed-4ffc-820a-baf8f9835986 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.124173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc9e1f-5dc1-4fc7-868a-51cf76a45ee1 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.126858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a31233-15ed-4ffc-820a-baf8f9835986 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.128853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cd968-0413-4f4a-a9c5-90c6b4bff1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.129552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cd968-0413-4f4a-a9c5-90c6b4bff1ae admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.129840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cd968-0413-4f4a-a9c5-90c6b4bff1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.130119 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cd968-0413-4f4a-a9c5-90c6b4bff1ae admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.130813 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cd968-0413-4f4a-a9c5-90c6b4bff1ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.132528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4f348-9f29-488c-8ade-ae61d06ec12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.133201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4f348-9f29-488c-8ade-ae61d06ec12f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.133338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cd968-0413-4f4a-a9c5-90c6b4bff1ae admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.133480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4f348-9f29-488c-8ade-ae61d06ec12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.133750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4f348-9f29-488c-8ade-ae61d06ec12f admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.134429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4f348-9f29-488c-8ade-ae61d06ec12f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.136319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4f348-9f29-488c-8ade-ae61d06ec12f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.157548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1043/2115] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:58 2022] POST /identity/v3/users => generated 305 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:58.157548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cd968-0413-4f4a-a9c5-90c6b4bff1ae admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.157807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1073/2116] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:58 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:58.158676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4f348-9f29-488c-8ade-ae61d06ec12f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.164704 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cd968-0413-4f4a-a9c5-90c6b4bff1ae admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.169237 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf6ea6-f5bf-4256-be25-e22f0a2f43a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.169885 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6ea6-f5bf-4256-be25-e22f0a2f43a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.169998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4f348-9f29-488c-8ade-ae61d06ec12f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.170168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6ea6-f5bf-4256-be25-e22f0a2f43a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.170443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6ea6-f5bf-4256-be25-e22f0a2f43a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.171193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf6ea6-f5bf-4256-be25-e22f0a2f43a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.173029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf6ea6-f5bf-4256-be25-e22f0a2f43a7 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.174840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569d95b-d758-4aef-ad7d-6b06f45a93fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.175482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569d95b-d758-4aef-ad7d-6b06f45a93fc admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.175768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569d95b-d758-4aef-ad7d-6b06f45a93fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.176044 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e569d95b-d758-4aef-ad7d-6b06f45a93fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.176761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569d95b-d758-4aef-ad7d-6b06f45a93fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.178929 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e569d95b-d758-4aef-ad7d-6b06f45a93fc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.189930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1074/2117] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:58.189930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569d95b-d758-4aef-ad7d-6b06f45a93fc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.193660 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1044/2118] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:58 2022] POST /identity/v3/users => generated 287 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:58.195037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf6ea6-f5bf-4256-be25-e22f0a2f43a7 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.203787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e569d95b-d758-4aef-ad7d-6b06f45a93fc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.204401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf6ea6-f5bf-4256-be25-e22f0a2f43a7 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.208320 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db50118-1237-4c4e-b93d-150b3bfdb3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.209009 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52b9da-8b6a-4fd3-9d85-8a3ace14bfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.209124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db50118-1237-4c4e-b93d-150b3bfdb3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.209291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db50118-1237-4c4e-b93d-150b3bfdb3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.209598 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db50118-1237-4c4e-b93d-150b3bfdb3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.209773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52b9da-8b6a-4fd3-9d85-8a3ace14bfde admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.210056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52b9da-8b6a-4fd3-9d85-8a3ace14bfde admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.210316 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db50118-1237-4c4e-b93d-150b3bfdb3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.210412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52b9da-8b6a-4fd3-9d85-8a3ace14bfde admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.211034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52b9da-8b6a-4fd3-9d85-8a3ace14bfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.211898 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db50118-1237-4c4e-b93d-150b3bfdb3c9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.212623 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52b9da-8b6a-4fd3-9d85-8a3ace14bfde admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.222478 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1075/2119] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:58.226333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1045/2120] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:58.226475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db50118-1237-4c4e-b93d-150b3bfdb3c9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.229869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52b9da-8b6a-4fd3-9d85-8a3ace14bfde admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.235139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db50118-1237-4c4e-b93d-150b3bfdb3c9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.239887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f48de-a3eb-4fc3-be85-fd5b66b80634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.241142 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52b9da-8b6a-4fd3-9d85-8a3ace14bfde admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.241254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f48de-a3eb-4fc3-be85-fd5b66b80634 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.241493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f48de-a3eb-4fc3-be85-fd5b66b80634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.241924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f48de-a3eb-4fc3-be85-fd5b66b80634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.242775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f48de-a3eb-4fc3-be85-fd5b66b80634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.244768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f48de-a3eb-4fc3-be85-fd5b66b80634 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.246290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374675da-314b-4ef2-9655-7198c63e73b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.247164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374675da-314b-4ef2-9655-7198c63e73b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.247444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374675da-314b-4ef2-9655-7198c63e73b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.247720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374675da-314b-4ef2-9655-7198c63e73b6 admin admin] PATH_INFO: `/v3/projects/051a23b25111477cbda991ac9fa71cb0/users/0c62648fdc564fa492cc10342899c16e/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.255528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1076/2121] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:58.257169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f48de-a3eb-4fc3-be85-fd5b66b80634 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.266757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f48de-a3eb-4fc3-be85-fd5b66b80634 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.270677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374675da-314b-4ef2-9655-7198c63e73b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051a23b25111477cbda991ac9fa71cb0, user_id=0c62648fdc564fa492cc10342899c16e, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.273812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374675da-314b-4ef2-9655-7198c63e73b6 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.274381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465fd8f-87c0-4760-8914-45d1abe4d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.275477 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465fd8f-87c0-4760-8914-45d1abe4d479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.275947 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465fd8f-87c0-4760-8914-45d1abe4d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.276249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465fd8f-87c0-4760-8914-45d1abe4d479 admin admin] PATH_INFO: `/v3/projects/5d5d498df0d748b785db2c150e6d32e2/users/27aae77c95d04b9e8ae549748cb7cfd8/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.289018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1046/2122] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:58 2022] PUT /identity/v3/projects/051a23b25111477cbda991ac9fa71cb0/users/0c62648fdc564fa492cc10342899c16e/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:58.289842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374675da-314b-4ef2-9655-7198c63e73b6 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.296800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465fd8f-87c0-4760-8914-45d1abe4d479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5d498df0d748b785db2c150e6d32e2, user_id=27aae77c95d04b9e8ae549748cb7cfd8, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.299475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465fd8f-87c0-4760-8914-45d1abe4d479 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.314744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1077/2123] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:58 2022] PUT /identity/v3/projects/5d5d498df0d748b785db2c150e6d32e2/users/27aae77c95d04b9e8ae549748cb7cfd8/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:58.315812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465fd8f-87c0-4760-8914-45d1abe4d479 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.375849 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374675da-314b-4ef2-9655-7198c63e73b6 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.392255 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465fd8f-87c0-4760-8914-45d1abe4d479 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.397041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ad6e3-ad1f-4eb9-8f96-d777b54325ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.397993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ad6e3-ad1f-4eb9-8f96-d777b54325ba admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.398704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ad6e3-ad1f-4eb9-8f96-d777b54325ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.398704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ad6e3-ad1f-4eb9-8f96-d777b54325ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.399249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ad6e3-ad1f-4eb9-8f96-d777b54325ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.402454 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ad6e3-ad1f-4eb9-8f96-d777b54325ba admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.416152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1078/2124] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:58.418358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1105d-a48c-42d6-933f-06c987dfef0e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.418865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1105d-a48c-42d6-933f-06c987dfef0e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.419676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1105d-a48c-42d6-933f-06c987dfef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.441384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbe3f8-014f-418d-8976-3496ccf419a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.442372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbe3f8-014f-418d-8976-3496ccf419a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.442657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbe3f8-014f-418d-8976-3496ccf419a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.442928 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbe3f8-014f-418d-8976-3496ccf419a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.443659 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbe3f8-014f-418d-8976-3496ccf419a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.445397 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbe3f8-014f-418d-8976-3496ccf419a2 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.458878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1047/2125] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:58.459284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7fd1105d-a48c-42d6-933f-06c987dfef0e None None] MFA Rules not processed for user `27aae77c95d04b9e8ae549748cb7cfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:58.459430 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbe3f8-014f-418d-8976-3496ccf419a2 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.459520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7fd1105d-a48c-42d6-933f-06c987dfef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:58.467121 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbe3f8-014f-418d-8976-3496ccf419a2 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.472884 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d60c2-e82b-4f57-963c-61904487cb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.473888 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d60c2-e82b-4f57-963c-61904487cb7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.474266 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d60c2-e82b-4f57-963c-61904487cb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.474618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d60c2-e82b-4f57-963c-61904487cb7e admin admin] PATH_INFO: `/v3/projects/051a23b25111477cbda991ac9fa71cb0/users/0c62648fdc564fa492cc10342899c16e/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.477398 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d60c2-e82b-4f57-963c-61904487cb7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=051a23b25111477cbda991ac9fa71cb0, user_id=0c62648fdc564fa492cc10342899c16e, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.480072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d60c2-e82b-4f57-963c-61904487cb7e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.499285 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1048/2126] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:58 2022] PUT /identity/v3/projects/051a23b25111477cbda991ac9fa71cb0/users/0c62648fdc564fa492cc10342899c16e/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:58.501485 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d60c2-e82b-4f57-963c-61904487cb7e admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.535940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1079/2127] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:58.541874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7993b-4570-400d-8168-ca100bd8f767 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.541874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7993b-4570-400d-8168-ca100bd8f767 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.541874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7993b-4570-400d-8168-ca100bd8f767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.572782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-76a7993b-4570-400d-8168-ca100bd8f767 None None] MFA Rules not processed for user `0c62648fdc564fa492cc10342899c16e`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:58.574263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-76a7993b-4570-400d-8168-ca100bd8f767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:58.579204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d60c2-e82b-4f57-963c-61904487cb7e admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.584120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9cece-d666-4cc4-b06a-dc192ca8705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.585167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9cece-d666-4cc4-b06a-dc192ca8705e admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.585444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9cece-d666-4cc4-b06a-dc192ca8705e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.585742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9cece-d666-4cc4-b06a-dc192ca8705e admin admin] PATH_INFO: `/v3/projects/f3ed2c03726d4eb5a0b5d72d27c53c94/users/c9839241725641a5b01c195ef5b3a422/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.604462 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9cece-d666-4cc4-b06a-dc192ca8705e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3ed2c03726d4eb5a0b5d72d27c53c94, user_id=c9839241725641a5b01c195ef5b3a422, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.607339 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9cece-d666-4cc4-b06a-dc192ca8705e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.622633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1049/2128] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:58 2022] PUT /identity/v3/projects/f3ed2c03726d4eb5a0b5d72d27c53c94/users/c9839241725641a5b01c195ef5b3a422/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:58.623745 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9cece-d666-4cc4-b06a-dc192ca8705e admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.650396 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1080/2129] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:58.651849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c691b5-4f45-49e2-8104-eb59c718ea7e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.652140 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c691b5-4f45-49e2-8104-eb59c718ea7e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.652630 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c691b5-4f45-49e2-8104-eb59c718ea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.681729 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e4c691b5-4f45-49e2-8104-eb59c718ea7e None None] MFA Rules not processed for user `c9839241725641a5b01c195ef5b3a422`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:58.682959 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e4c691b5-4f45-49e2-8104-eb59c718ea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:58.694991 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9cece-d666-4cc4-b06a-dc192ca8705e admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.699808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bd643-41fd-49c2-8530-12443d98d882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.700458 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bd643-41fd-49c2-8530-12443d98d882 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.700741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bd643-41fd-49c2-8530-12443d98d882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.701043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bd643-41fd-49c2-8530-12443d98d882 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.701727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bd643-41fd-49c2-8530-12443d98d882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.703623 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bd643-41fd-49c2-8530-12443d98d882 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.730746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1050/2130] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:58 2022] POST /identity/v3/projects => generated 407 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:58.731826 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bd643-41fd-49c2-8530-12443d98d882 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.733624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c00bd643-41fd-49c2-8530-12443d98d882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:58.748802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1081/2131] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:58.752348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c691b5-4f45-49e2-8104-eb59c718ea7e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.759576 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c691b5-4f45-49e2-8104-eb59c718ea7e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.789661 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bd643-41fd-49c2-8530-12443d98d882 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.793376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8b5cc-0939-474d-aca7-a6ceead6c8b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.794021 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8b5cc-0939-474d-aca7-a6ceead6c8b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.794305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8b5cc-0939-474d-aca7-a6ceead6c8b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.794584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b8b5cc-0939-474d-aca7-a6ceead6c8b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.796410 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-66b8b5cc-0939-474d-aca7-a6ceead6c8b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:58.815280 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66853f0-0d80-4af1-aaaf-0479ca6627ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.815963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66853f0-0d80-4af1-aaaf-0479ca6627ab admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.816246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66853f0-0d80-4af1-aaaf-0479ca6627ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.816554 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66853f0-0d80-4af1-aaaf-0479ca6627ab admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.817321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66853f0-0d80-4af1-aaaf-0479ca6627ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.819739 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66853f0-0d80-4af1-aaaf-0479ca6627ab admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.841834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1082/2132] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:58 2022] POST /identity/v3/users => generated 310 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:58.842688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66853f0-0d80-4af1-aaaf-0479ca6627ab admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.855119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66853f0-0d80-4af1-aaaf-0479ca6627ab admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.857908 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8b5cc-0939-474d-aca7-a6ceead6c8b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.859504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b8b5cc-0939-474d-aca7-a6ceead6c8b6 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.860201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e4dd8-4712-48ec-ab79-4e3597a849c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.860859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e4dd8-4712-48ec-ab79-4e3597a849c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.861180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e4dd8-4712-48ec-ab79-4e3597a849c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.861457 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e4dd8-4712-48ec-ab79-4e3597a849c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.862145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e4dd8-4712-48ec-ab79-4e3597a849c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.864051 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e4dd8-4712-48ec-ab79-4e3597a849c7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.868571 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1051/2133] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:28:58.869536 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8b5cc-0939-474d-aca7-a6ceead6c8b6 service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.880422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b8b5cc-0939-474d-aca7-a6ceead6c8b6 service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.888326 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae8dbb-0363-4175-bebb-9e6f2d1fe7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.889276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae8dbb-0363-4175-bebb-9e6f2d1fe7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.894353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae8dbb-0363-4175-bebb-9e6f2d1fe7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.894743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae8dbb-0363-4175-bebb-9e6f2d1fe7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.895516 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae8dbb-0363-4175-bebb-9e6f2d1fe7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.898109 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae8dbb-0363-4175-bebb-9e6f2d1fe7c1 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:58.902793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1083/2134] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:28:58 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:28:58.903844 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e4dd8-4712-48ec-ab79-4e3597a849c7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.926724 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1052/2135] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:58.941194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae8dbb-0363-4175-bebb-9e6f2d1fe7c1 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:58.963822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae8dbb-0363-4175-bebb-9e6f2d1fe7c1 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.984748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e4dd8-4712-48ec-ab79-4e3597a849c7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:58.991024 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccc499-b9ac-4a98-a768-7ea62190a4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:58.992064 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccc499-b9ac-4a98-a768-7ea62190a4cb admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:58.992289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccc499-b9ac-4a98-a768-7ea62190a4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:58.992563 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccc499-b9ac-4a98-a768-7ea62190a4cb admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:58.993358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccc499-b9ac-4a98-a768-7ea62190a4cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:58.997300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccc499-b9ac-4a98-a768-7ea62190a4cb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:59.029507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1084/2136] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:28:58 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:28:59.033794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccc499-b9ac-4a98-a768-7ea62190a4cb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:59.048101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d47dbc-f9cd-46e3-aeaa-08b14db21293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:59.049237 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d47dbc-f9cd-46e3-aeaa-08b14db21293 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:59.049358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccc499-b9ac-4a98-a768-7ea62190a4cb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:59.049699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d47dbc-f9cd-46e3-aeaa-08b14db21293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:59.050192 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d47dbc-f9cd-46e3-aeaa-08b14db21293 admin admin] PATH_INFO: `/v3/projects/aa841c28492042f9969bc36c69366f53/users/fb86c099666440e78e2e76a10e66a6c7/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:59.054719 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5fa70-2fe7-4f4a-8ce4-a0e2aea647f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:59.055394 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5fa70-2fe7-4f4a-8ce4-a0e2aea647f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:59.055674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5fa70-2fe7-4f4a-8ce4-a0e2aea647f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:59.055952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5fa70-2fe7-4f4a-8ce4-a0e2aea647f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:59.056985 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5fa70-2fe7-4f4a-8ce4-a0e2aea647f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:59.064911 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5fa70-2fe7-4f4a-8ce4-a0e2aea647f6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:59.068164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d47dbc-f9cd-46e3-aeaa-08b14db21293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa841c28492042f9969bc36c69366f53, user_id=fb86c099666440e78e2e76a10e66a6c7, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:59.078667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d47dbc-f9cd-46e3-aeaa-08b14db21293 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:59.086967 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1085/2137] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:59.094336 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5fa70-2fe7-4f4a-8ce4-a0e2aea647f6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:59.100048 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1053/2138] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:58 2022] PUT /identity/v3/projects/aa841c28492042f9969bc36c69366f53/users/fb86c099666440e78e2e76a10e66a6c7/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:59.113695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d47dbc-f9cd-46e3-aeaa-08b14db21293 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:59.125983 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5fa70-2fe7-4f4a-8ce4-a0e2aea647f6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:59.238012 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e80644-9363-4302-b303-96338b0a79b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:59.238896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e80644-9363-4302-b303-96338b0a79b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:59.239301 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e80644-9363-4302-b303-96338b0a79b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:59.239498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e80644-9363-4302-b303-96338b0a79b4 admin admin] PATH_INFO: `/v3/projects/90626a6321b64395904dc8169491595f/users/2ceb14ba5d6a4c689ac97fac53cd9b6c/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:59.266148 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e80644-9363-4302-b303-96338b0a79b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90626a6321b64395904dc8169491595f, user_id=2ceb14ba5d6a4c689ac97fac53cd9b6c, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:59.268861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e80644-9363-4302-b303-96338b0a79b4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:59.269333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d47dbc-f9cd-46e3-aeaa-08b14db21293 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:59.286300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43d4e7-9bb0-439c-ba55-61b81ab93d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:59.286993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43d4e7-9bb0-439c-ba55-61b81ab93d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:59.287283 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43d4e7-9bb0-439c-ba55-61b81ab93d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:59.288141 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd43d4e7-9bb0-439c-ba55-61b81ab93d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:59.288938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43d4e7-9bb0-439c-ba55-61b81ab93d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:59.295306 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd43d4e7-9bb0-439c-ba55-61b81ab93d01 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:59.306209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1086/2139] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:59 2022] PUT /identity/v3/projects/90626a6321b64395904dc8169491595f/users/2ceb14ba5d6a4c689ac97fac53cd9b6c/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:59.310001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e80644-9363-4302-b303-96338b0a79b4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:59.314616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1054/2140] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:28:59.315982 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43d4e7-9bb0-439c-ba55-61b81ab93d01 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:59.332249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd43d4e7-9bb0-439c-ba55-61b81ab93d01 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:59.396621 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e80644-9363-4302-b303-96338b0a79b4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:59.402108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba74f5-5464-43a0-834a-e32ca4291119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:59.402776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba74f5-5464-43a0-834a-e32ca4291119 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:59.403506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba74f5-5464-43a0-834a-e32ca4291119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:59.404497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba74f5-5464-43a0-834a-e32ca4291119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:59.404796 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba74f5-5464-43a0-834a-e32ca4291119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:59.407008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba74f5-5464-43a0-834a-e32ca4291119 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:59.414260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34350f7-80c8-460a-85cb-7ee4f6d08c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:59.415923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34350f7-80c8-460a-85cb-7ee4f6d08c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:59.416519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34350f7-80c8-460a-85cb-7ee4f6d08c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:59.417372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34350f7-80c8-460a-85cb-7ee4f6d08c85 admin admin] PATH_INFO: `/v3/projects/aa841c28492042f9969bc36c69366f53/users/fb86c099666440e78e2e76a10e66a6c7/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:59.419798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34350f7-80c8-460a-85cb-7ee4f6d08c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa841c28492042f9969bc36c69366f53, user_id=fb86c099666440e78e2e76a10e66a6c7, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:59.423485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1087/2141] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:28:59.425850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34350f7-80c8-460a-85cb-7ee4f6d08c85 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:59.430389 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba74f5-5464-43a0-834a-e32ca4291119 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:59.441079 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1055/2142] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:59 2022] PUT /identity/v3/projects/aa841c28492042f9969bc36c69366f53/users/fb86c099666440e78e2e76a10e66a6c7/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:59.453025 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba74f5-5464-43a0-834a-e32ca4291119 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:59.460104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef204ba-992d-48ef-a2c3-bbc91ef5bdbc None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:59.460104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef204ba-992d-48ef-a2c3-bbc91ef5bdbc None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:59.460104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef204ba-992d-48ef-a2c3-bbc91ef5bdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:59.507432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6ef204ba-992d-48ef-a2c3-bbc91ef5bdbc None None] MFA Rules not processed for user `fb86c099666440e78e2e76a10e66a6c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:59.507432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6ef204ba-992d-48ef-a2c3-bbc91ef5bdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:59.534980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8cbc9-5194-448d-ac83-6b280b909f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:59.536023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8cbc9-5194-448d-ac83-6b280b909f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:59.536410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8cbc9-5194-448d-ac83-6b280b909f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:59.536820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8cbc9-5194-448d-ac83-6b280b909f70 admin admin] PATH_INFO: `/v3/projects/90626a6321b64395904dc8169491595f/users/2ceb14ba5d6a4c689ac97fac53cd9b6c/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:59.539667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8cbc9-5194-448d-ac83-6b280b909f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90626a6321b64395904dc8169491595f, user_id=2ceb14ba5d6a4c689ac97fac53cd9b6c, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:59.543429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8cbc9-5194-448d-ac83-6b280b909f70 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:59.564186 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1088/2143] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:28:59 2022] PUT /identity/v3/projects/90626a6321b64395904dc8169491595f/users/2ceb14ba5d6a4c689ac97fac53cd9b6c/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:28:59.576514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706f192-6547-4104-8162-76202398974a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:59.576673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706f192-6547-4104-8162-76202398974a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:59.576893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706f192-6547-4104-8162-76202398974a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:59.622290 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f706f192-6547-4104-8162-76202398974a None None] MFA Rules not processed for user `2ceb14ba5d6a4c689ac97fac53cd9b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:28:59.624060 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f706f192-6547-4104-8162-76202398974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:59.653130 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1056/2144] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:59 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:59.664213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef204ba-992d-48ef-a2c3-bbc91ef5bdbc None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:59.665627 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6ef204ba-992d-48ef-a2c3-bbc91ef5bdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:28:59.729592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1089/2145] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:28:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:28:59.760635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef204ba-992d-48ef-a2c3-bbc91ef5bdbc None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:59.778850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706f192-6547-4104-8162-76202398974a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:28:59.821596 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bef87-d3e9-4841-b3e1-9df8d1dd71d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:59.823407 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bef87-d3e9-4841-b3e1-9df8d1dd71d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:59.823969 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bef87-d3e9-4841-b3e1-9df8d1dd71d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:59.825171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bef87-d3e9-4841-b3e1-9df8d1dd71d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:59.854771 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706f192-6547-4104-8162-76202398974a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:28:59.859953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d93d3-6c58-45b0-8348-b39c6548ec02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:28:59.860652 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d93d3-6c58-45b0-8348-b39c6548ec02 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:28:59.861775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d93d3-6c58-45b0-8348-b39c6548ec02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:28:59.862075 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d93d3-6c58-45b0-8348-b39c6548ec02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:28:59.917216 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33bef87-d3e9-4841-b3e1-9df8d1dd71d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:59.918722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33bef87-d3e9-4841-b3e1-9df8d1dd71d1 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:59.929378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1057/2146] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:59 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:28:59.931082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d93d3-6c58-45b0-8348-b39c6548ec02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:28:59.932581 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d93d3-6c58-45b0-8348-b39c6548ec02 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:28:59.942046 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1090/2147] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:28:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:29:00.153851 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bef87-d3e9-4841-b3e1-9df8d1dd71d1 service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:00.164648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bef87-d3e9-4841-b3e1-9df8d1dd71d1 service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:00.169320 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4d1bf-9653-467d-8303-3a3320e9a69f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:00.169925 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4d1bf-9653-467d-8303-3a3320e9a69f service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:00.170256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4d1bf-9653-467d-8303-3a3320e9a69f service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:00.170554 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4d1bf-9653-467d-8303-3a3320e9a69f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:00.257600 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4d1bf-9653-467d-8303-3a3320e9a69f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:00.260140 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4d1bf-9653-467d-8303-3a3320e9a69f service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:00.287317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1058/2148] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:00 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:00.628570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d93d3-6c58-45b0-8348-b39c6548ec02 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:00.640440 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d93d3-6c58-45b0-8348-b39c6548ec02 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:00.648205 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6244e8d-c16c-44e1-b2ea-d4dbe8e48322 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:00.648902 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6244e8d-c16c-44e1-b2ea-d4dbe8e48322 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:00.649354 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6244e8d-c16c-44e1-b2ea-d4dbe8e48322 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:00.649809 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6244e8d-c16c-44e1-b2ea-d4dbe8e48322 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:00.760364 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6244e8d-c16c-44e1-b2ea-d4dbe8e48322 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:00.763333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6244e8d-c16c-44e1-b2ea-d4dbe8e48322 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:00.777932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1091/2149] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:01.335817 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4d1bf-9653-467d-8303-3a3320e9a69f service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:01.344714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4d1bf-9653-467d-8303-3a3320e9a69f service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:01.348528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9415a86-5071-4435-a57f-a6179adbcdda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:01.349304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9415a86-5071-4435-a57f-a6179adbcdda service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:01.349590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9415a86-5071-4435-a57f-a6179adbcdda service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:01.349871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9415a86-5071-4435-a57f-a6179adbcdda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:01.409486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9415a86-5071-4435-a57f-a6179adbcdda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:01.411063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9415a86-5071-4435-a57f-a6179adbcdda service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:01.420906 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1059/2150] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:02.510688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6244e8d-c16c-44e1-b2ea-d4dbe8e48322 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:02.571571 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6244e8d-c16c-44e1-b2ea-d4dbe8e48322 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:02.576161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a41e4b-e346-4362-ac6f-fa998eea2349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:02.577049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a41e4b-e346-4362-ac6f-fa998eea2349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:02.577334 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a41e4b-e346-4362-ac6f-fa998eea2349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:02.577610 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a41e4b-e346-4362-ac6f-fa998eea2349 admin admin] PATH_INFO: `/v3/users/c9839241725641a5b01c195ef5b3a422` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:02.578802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a41e4b-e346-4362-ac6f-fa998eea2349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9839241725641a5b01c195ef5b3a422)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:02.580733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a41e4b-e346-4362-ac6f-fa998eea2349 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:02.626051 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b2a41e4b-e346-4362-ac6f-fa998eea2349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9839241725641a5b01c195ef5b3a422'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:02.637750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b2a41e4b-e346-4362-ac6f-fa998eea2349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9839241725641a5b01c195ef5b3a422'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:02.644273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b2a41e4b-e346-4362-ac6f-fa998eea2349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9839241725641a5b01c195ef5b3a422'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:02.645057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b2a41e4b-e346-4362-ac6f-fa998eea2349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9839241725641a5b01c195ef5b3a422'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:02.653646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b2a41e4b-e346-4362-ac6f-fa998eea2349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9839241725641a5b01c195ef5b3a422'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:02.659644 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1092/2151] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:02 2022] DELETE /identity/v3/users/c9839241725641a5b01c195ef5b3a422 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:02.666111 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f263c-bbbd-4f1c-b6cf-706922bd753e None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:02.667270 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f263c-bbbd-4f1c-b6cf-706922bd753e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:02.667649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f263c-bbbd-4f1c-b6cf-706922bd753e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:02.690710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-786f263c-bbbd-4f1c-b6cf-706922bd753e None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:02.692922 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-786f263c-bbbd-4f1c-b6cf-706922bd753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:02.763646 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1060/2152] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:02.774502 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a41e4b-e346-4362-ac6f-fa998eea2349 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:02.776045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b2a41e4b-e346-4362-ac6f-fa998eea2349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:02.839351 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a41e4b-e346-4362-ac6f-fa998eea2349 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:02.843308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd11b4-9dab-43e7-8443-9be8c5070a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:02.843908 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd11b4-9dab-43e7-8443-9be8c5070a9b service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:02.844188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd11b4-9dab-43e7-8443-9be8c5070a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:02.844460 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd11b4-9dab-43e7-8443-9be8c5070a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:02.854168 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd11b4-9dab-43e7-8443-9be8c5070a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:02.855588 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd11b4-9dab-43e7-8443-9be8c5070a9b service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:02.865384 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1093/2153] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:03.202559 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f263c-bbbd-4f1c-b6cf-706922bd753e None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:03.204199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-786f263c-bbbd-4f1c-b6cf-706922bd753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:03.217315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f263c-bbbd-4f1c-b6cf-706922bd753e None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:03.221874 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:03.222922 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:03.223644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:03.224056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] PATH_INFO: `/v3/projects/f3ed2c03726d4eb5a0b5d72d27c53c94` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:03.226353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3ed2c03726d4eb5a0b5d72d27c53c94)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:03.228499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:03.286673 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3ed2c03726d4eb5a0b5d72d27c53c94', 'request_id': 'req-714b1936-f17f-49db-a9ec-bedf1c9e69a2'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.296453 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3ed2c03726d4eb5a0b5d72d27c53c94', 'request_id': 'req-714b1936-f17f-49db-a9ec-bedf1c9e69a2'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.302269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3ed2c03726d4eb5a0b5d72d27c53c94', 'request_id': 'req-714b1936-f17f-49db-a9ec-bedf1c9e69a2'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.314034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] The token cache is being invalidate because project f3ed2c03726d4eb5a0b5d72d27c53c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:03.314329 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.314994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.316611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1061/2154] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:03 2022] DELETE /identity/v3/projects/f3ed2c03726d4eb5a0b5d72d27c53c94 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:03.320571 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd11b4-9dab-43e7-8443-9be8c5070a9b service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:03.330848 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd11b4-9dab-43e7-8443-9be8c5070a9b service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:03.388902 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d45ce-862c-4b6d-b946-dfc244112d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:03.389833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d45ce-862c-4b6d-b946-dfc244112d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:03.390118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d45ce-862c-4b6d-b946-dfc244112d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:03.390396 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d45ce-862c-4b6d-b946-dfc244112d17 admin admin] PATH_INFO: `/v3/users/2ceb14ba5d6a4c689ac97fac53cd9b6c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:03.391590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d45ce-862c-4b6d-b946-dfc244112d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ceb14ba5d6a4c689ac97fac53cd9b6c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:03.393559 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d45ce-862c-4b6d-b946-dfc244112d17 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:03.439874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-201d45ce-862c-4b6d-b946-dfc244112d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ceb14ba5d6a4c689ac97fac53cd9b6c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.451689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-201d45ce-862c-4b6d-b946-dfc244112d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ceb14ba5d6a4c689ac97fac53cd9b6c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.460432 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-201d45ce-862c-4b6d-b946-dfc244112d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ceb14ba5d6a4c689ac97fac53cd9b6c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.461190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-201d45ce-862c-4b6d-b946-dfc244112d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ceb14ba5d6a4c689ac97fac53cd9b6c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.468272 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-201d45ce-862c-4b6d-b946-dfc244112d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ceb14ba5d6a4c689ac97fac53cd9b6c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.477043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1094/2155] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:03 2022] DELETE /identity/v3/users/2ceb14ba5d6a4c689ac97fac53cd9b6c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:03.732887 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:03.734402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:03.751553 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b1936-f17f-49db-a9ec-bedf1c9e69a2 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:03.813715 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d01a7-281f-4159-bda3-9cee1c7e4ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:03.814586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d01a7-281f-4159-bda3-9cee1c7e4ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:03.814899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d01a7-281f-4159-bda3-9cee1c7e4ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:03.815175 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d01a7-281f-4159-bda3-9cee1c7e4ede admin admin] PATH_INFO: `/v3/projects/90626a6321b64395904dc8169491595f` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:03.816400 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d01a7-281f-4159-bda3-9cee1c7e4ede admin admin] RBAC: Authorizing `identity:delete_project(project_id=90626a6321b64395904dc8169491595f)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:03.818368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d01a7-281f-4159-bda3-9cee1c7e4ede admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:03.864104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a64d01a7-281f-4159-bda3-9cee1c7e4ede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90626a6321b64395904dc8169491595f', 'request_id': 'req-a64d01a7-281f-4159-bda3-9cee1c7e4ede'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.871599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a64d01a7-281f-4159-bda3-9cee1c7e4ede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90626a6321b64395904dc8169491595f', 'request_id': 'req-a64d01a7-281f-4159-bda3-9cee1c7e4ede'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.877040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a64d01a7-281f-4159-bda3-9cee1c7e4ede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90626a6321b64395904dc8169491595f', 'request_id': 'req-a64d01a7-281f-4159-bda3-9cee1c7e4ede'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.888552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a64d01a7-281f-4159-bda3-9cee1c7e4ede admin admin] The token cache is being invalidate because project 90626a6321b64395904dc8169491595f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:03.888839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a64d01a7-281f-4159-bda3-9cee1c7e4ede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.889516 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a64d01a7-281f-4159-bda3-9cee1c7e4ede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:03.891117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1062/2156] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:03 2022] DELETE /identity/v3/projects/90626a6321b64395904dc8169491595f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:03.895975 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70ef21-6c72-4c65-90dd-2c92ff1e62e0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:03.896429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70ef21-6c72-4c65-90dd-2c92ff1e62e0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:03.896562 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70ef21-6c72-4c65-90dd-2c92ff1e62e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:03.914975 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5f70ef21-6c72-4c65-90dd-2c92ff1e62e0 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:03.916112 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5f70ef21-6c72-4c65-90dd-2c92ff1e62e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:03.973520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1095/2157] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:03.981332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0d298-03cd-4bf3-b785-43edf4f2889a None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:03.981618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0d298-03cd-4bf3-b785-43edf4f2889a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:03.981891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0d298-03cd-4bf3-b785-43edf4f2889a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:04.000175 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-a8a0d298-03cd-4bf3-b785-43edf4f2889a None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:04.001393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a8a0d298-03cd-4bf3-b785-43edf4f2889a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:04.010086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1063/2158] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:04.014383 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70ef21-6c72-4c65-90dd-2c92ff1e62e0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:04.024345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70ef21-6c72-4c65-90dd-2c92ff1e62e0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:04.028936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308bf67-99ad-43fe-9798-f94cec7241fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:04.029571 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308bf67-99ad-43fe-9798-f94cec7241fb admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:04.029854 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308bf67-99ad-43fe-9798-f94cec7241fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:04.030129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308bf67-99ad-43fe-9798-f94cec7241fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:04.030881 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308bf67-99ad-43fe-9798-f94cec7241fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:29:04.031191 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308bf67-99ad-43fe-9798-f94cec7241fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:04.032833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308bf67-99ad-43fe-9798-f94cec7241fb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:04.044206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1096/2159] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:29:04.049087 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0d298-03cd-4bf3-b785-43edf4f2889a None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:04.059271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0d298-03cd-4bf3-b785-43edf4f2889a None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:04.063867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec33b8-2a20-40e6-a0a2-68a1ab1f7413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:04.064508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec33b8-2a20-40e6-a0a2-68a1ab1f7413 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:04.064789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec33b8-2a20-40e6-a0a2-68a1ab1f7413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:04.065120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec33b8-2a20-40e6-a0a2-68a1ab1f7413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:04.065810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec33b8-2a20-40e6-a0a2-68a1ab1f7413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:04.067704 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec33b8-2a20-40e6-a0a2-68a1ab1f7413 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:04.093959 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1064/2160] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:04 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:04.098007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308bf67-99ad-43fe-9798-f94cec7241fb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:04.107958 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308bf67-99ad-43fe-9798-f94cec7241fb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:04.162861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724a535-e31a-4576-a0ca-497a2150cc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:04.163532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724a535-e31a-4576-a0ca-497a2150cc2e admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:04.163814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724a535-e31a-4576-a0ca-497a2150cc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:04.164094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724a535-e31a-4576-a0ca-497a2150cc2e admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:04.164789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724a535-e31a-4576-a0ca-497a2150cc2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:04.166743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724a535-e31a-4576-a0ca-497a2150cc2e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:04.188021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1097/2161] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:04 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:29:04.189669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec33b8-2a20-40e6-a0a2-68a1ab1f7413 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:04.200491 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec33b8-2a20-40e6-a0a2-68a1ab1f7413 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:04.205304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebd9d2-28f7-4e1c-9228-0920a91b94c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:04.205960 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebd9d2-28f7-4e1c-9228-0920a91b94c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:04.206245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebd9d2-28f7-4e1c-9228-0920a91b94c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:04.206524 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebd9d2-28f7-4e1c-9228-0920a91b94c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:04.207284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebd9d2-28f7-4e1c-9228-0920a91b94c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:04.208916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebd9d2-28f7-4e1c-9228-0920a91b94c5 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:04.221443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1065/2162] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:04.225470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724a535-e31a-4576-a0ca-497a2150cc2e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:04.235326 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724a535-e31a-4576-a0ca-497a2150cc2e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:04.241238 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfea91e-d671-484f-8098-0991e34f4f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:04.241911 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfea91e-d671-484f-8098-0991e34f4f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:04.242184 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfea91e-d671-484f-8098-0991e34f4f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:04.242457 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfea91e-d671-484f-8098-0991e34f4f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:04.243177 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfea91e-d671-484f-8098-0991e34f4f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:04.244769 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfea91e-d671-484f-8098-0991e34f4f4b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:04.254642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1098/2163] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:04.259444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebd9d2-28f7-4e1c-9228-0920a91b94c5 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:04.269415 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebd9d2-28f7-4e1c-9228-0920a91b94c5 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:04.274412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a07f9-c986-4a01-86e1-147a4c688d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:04.275290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a07f9-c986-4a01-86e1-147a4c688d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:04.275569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a07f9-c986-4a01-86e1-147a4c688d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:04.275846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a07f9-c986-4a01-86e1-147a4c688d52 admin admin] PATH_INFO: `/v3/projects/00d5dc630aa047e2b28547fb11db324f/users/509c75788fdc46e6aa15096f8a43071c/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:04.290474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a07f9-c986-4a01-86e1-147a4c688d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d5dc630aa047e2b28547fb11db324f, user_id=509c75788fdc46e6aa15096f8a43071c, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:04.293137 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a07f9-c986-4a01-86e1-147a4c688d52 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:04.307081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1066/2164] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:04 2022] PUT /identity/v3/projects/00d5dc630aa047e2b28547fb11db324f/users/509c75788fdc46e6aa15096f8a43071c/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:04.318416 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a7e98-2b60-4637-9096-5ae4303285a4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:04.319253 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a7e98-2b60-4637-9096-5ae4303285a4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:04.319538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a7e98-2b60-4637-9096-5ae4303285a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:04.344983 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e63a7e98-2b60-4637-9096-5ae4303285a4 None None] MFA Rules not processed for user `509c75788fdc46e6aa15096f8a43071c`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:04.346204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e63a7e98-2b60-4637-9096-5ae4303285a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:04.410098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1099/2165] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:29:04.421293 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a07f9-c986-4a01-86e1-147a4c688d52 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:04.423072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-055a07f9-c986-4a01-86e1-147a4c688d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:04.478871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a07f9-c986-4a01-86e1-147a4c688d52 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:04.482725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aeec56-e460-4517-863b-c8a8b8787c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:04.483375 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aeec56-e460-4517-863b-c8a8b8787c1c service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:04.483664 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aeec56-e460-4517-863b-c8a8b8787c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:04.483934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aeec56-e460-4517-863b-c8a8b8787c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:04.493100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aeec56-e460-4517-863b-c8a8b8787c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:04.494550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aeec56-e460-4517-863b-c8a8b8787c1c service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:04.503595 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1067/2166] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:06.873528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcd0c3-2903-4131-b685-453267bb5b64 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:06.874001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcd0c3-2903-4131-b685-453267bb5b64 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:06.874093 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcd0c3-2903-4131-b685-453267bb5b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:06.892116 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-14bcd0c3-2903-4131-b685-453267bb5b64 None None] MFA Rules not processed for user `509c75788fdc46e6aa15096f8a43071c`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:06.893322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-14bcd0c3-2903-4131-b685-453267bb5b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:06.900238 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1100/2167] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:06.978832 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aeec56-e460-4517-863b-c8a8b8787c1c service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:06.980336 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-35aeec56-e460-4517-863b-c8a8b8787c1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:07.049778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aeec56-e460-4517-863b-c8a8b8787c1c service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:07.054473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038346d-3c39-40fb-8f81-cf037273d171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:07.055336 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038346d-3c39-40fb-8f81-cf037273d171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:07.055620 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038346d-3c39-40fb-8f81-cf037273d171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:07.055893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038346d-3c39-40fb-8f81-cf037273d171 admin admin] PATH_INFO: `/v3/users/eba6fdb492ac4490a577cd90f5f3f9ca` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:07.057238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038346d-3c39-40fb-8f81-cf037273d171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba6fdb492ac4490a577cd90f5f3f9ca)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:07.059221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038346d-3c39-40fb-8f81-cf037273d171 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:07.104646 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0038346d-3c39-40fb-8f81-cf037273d171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba6fdb492ac4490a577cd90f5f3f9ca'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:07.105333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0038346d-3c39-40fb-8f81-cf037273d171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba6fdb492ac4490a577cd90f5f3f9ca'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:07.116853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0038346d-3c39-40fb-8f81-cf037273d171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba6fdb492ac4490a577cd90f5f3f9ca'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:07.123477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0038346d-3c39-40fb-8f81-cf037273d171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba6fdb492ac4490a577cd90f5f3f9ca'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:07.132007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0038346d-3c39-40fb-8f81-cf037273d171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba6fdb492ac4490a577cd90f5f3f9ca'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:07.138179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1068/2168] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:06 2022] DELETE /identity/v3/users/eba6fdb492ac4490a577cd90f5f3f9ca => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:07.143190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f1692-3c38-4bc5-a443-85986c5dcbc4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:07.145294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f1692-3c38-4bc5-a443-85986c5dcbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:07.145294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f1692-3c38-4bc5-a443-85986c5dcbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:07.163334 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-701f1692-3c38-4bc5-a443-85986c5dcbc4 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:07.164544 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-701f1692-3c38-4bc5-a443-85986c5dcbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:07.221803 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1101/2169] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:07.231462 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038346d-3c39-40fb-8f81-cf037273d171 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:07.232894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0038346d-3c39-40fb-8f81-cf037273d171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:07.289532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038346d-3c39-40fb-8f81-cf037273d171 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:07.293782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a938fe-5bd5-4a3c-af86-a4950b8a30d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:07.294489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a938fe-5bd5-4a3c-af86-a4950b8a30d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:07.294844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a938fe-5bd5-4a3c-af86-a4950b8a30d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:07.295039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a938fe-5bd5-4a3c-af86-a4950b8a30d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:07.305149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a938fe-5bd5-4a3c-af86-a4950b8a30d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:07.306589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a938fe-5bd5-4a3c-af86-a4950b8a30d1 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:07.316907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1069/2170] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:07.430770 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f1692-3c38-4bc5-a443-85986c5dcbc4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:07.432493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-701f1692-3c38-4bc5-a443-85986c5dcbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:07.458175 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f1692-3c38-4bc5-a443-85986c5dcbc4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:07.470167 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275d6b3-166f-4399-9853-cd0509e1c4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:07.471104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275d6b3-166f-4399-9853-cd0509e1c4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:07.471447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275d6b3-166f-4399-9853-cd0509e1c4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:07.472634 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275d6b3-166f-4399-9853-cd0509e1c4ff admin admin] PATH_INFO: `/v3/users/0ab6d3c00b7c46318e28a8c8bb1a5ca0` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:07.477246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275d6b3-166f-4399-9853-cd0509e1c4ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab6d3c00b7c46318e28a8c8bb1a5ca0)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:07.480908 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275d6b3-166f-4399-9853-cd0509e1c4ff admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:07.558103 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a275d6b3-166f-4399-9853-cd0509e1c4ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab6d3c00b7c46318e28a8c8bb1a5ca0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:07.577938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a275d6b3-166f-4399-9853-cd0509e1c4ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab6d3c00b7c46318e28a8c8bb1a5ca0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:07.626862 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a275d6b3-166f-4399-9853-cd0509e1c4ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab6d3c00b7c46318e28a8c8bb1a5ca0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:07.627650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a275d6b3-166f-4399-9853-cd0509e1c4ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab6d3c00b7c46318e28a8c8bb1a5ca0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:07.638626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a275d6b3-166f-4399-9853-cd0509e1c4ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab6d3c00b7c46318e28a8c8bb1a5ca0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:07.653105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1102/2171] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:07 2022] DELETE /identity/v3/users/0ab6d3c00b7c46318e28a8c8bb1a5ca0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:07.655305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29d224-ac58-4533-8739-8eaeceae0ea3 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:07.655668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29d224-ac58-4533-8739-8eaeceae0ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:07.656018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29d224-ac58-4533-8739-8eaeceae0ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:07.677992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-3d29d224-ac58-4533-8739-8eaeceae0ea3 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:07.679772 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3d29d224-ac58-4533-8739-8eaeceae0ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:07.794757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275d6b3-166f-4399-9853-cd0509e1c4ff admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:07.797528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a275d6b3-166f-4399-9853-cd0509e1c4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:07.804096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1070/2172] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:29:07.820002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29d224-ac58-4533-8739-8eaeceae0ea3 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:07.822531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3d29d224-ac58-4533-8739-8eaeceae0ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:07.830648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275d6b3-166f-4399-9853-cd0509e1c4ff admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:07.852369 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfe7af-f767-4c7a-915c-6e861593fc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:07.853399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfe7af-f767-4c7a-915c-6e861593fc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:07.853691 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfe7af-f767-4c7a-915c-6e861593fc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:07.853969 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfe7af-f767-4c7a-915c-6e861593fc4e admin admin] PATH_INFO: `/v3/projects/507a0e875ab44bca8a740119920fec98` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:07.855573 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfe7af-f767-4c7a-915c-6e861593fc4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=507a0e875ab44bca8a740119920fec98)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:07.860595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfe7af-f767-4c7a-915c-6e861593fc4e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:07.938617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29d224-ac58-4533-8739-8eaeceae0ea3 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:07.970281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1fbfe7af-f767-4c7a-915c-6e861593fc4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507a0e875ab44bca8a740119920fec98', 'request_id': 'req-1fbfe7af-f767-4c7a-915c-6e861593fc4e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:07.982546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1fbfe7af-f767-4c7a-915c-6e861593fc4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507a0e875ab44bca8a740119920fec98', 'request_id': 'req-1fbfe7af-f767-4c7a-915c-6e861593fc4e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:07.989077 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1fbfe7af-f767-4c7a-915c-6e861593fc4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507a0e875ab44bca8a740119920fec98', 'request_id': 'req-1fbfe7af-f767-4c7a-915c-6e861593fc4e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:07.999880 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f5ac8-27c3-4893-a072-9cf354315630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:08.000538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5ac8-27c3-4893-a072-9cf354315630 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:08.000820 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5ac8-27c3-4893-a072-9cf354315630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:08.001136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5ac8-27c3-4893-a072-9cf354315630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:08.003082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1fbfe7af-f767-4c7a-915c-6e861593fc4e admin admin] The token cache is being invalidate because project 507a0e875ab44bca8a740119920fec98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:08.004132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1fbfe7af-f767-4c7a-915c-6e861593fc4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.004532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1fbfe7af-f767-4c7a-915c-6e861593fc4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.007076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1103/2173] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:07 2022] DELETE /identity/v3/projects/507a0e875ab44bca8a740119920fec98 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:08.011689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52f586-0048-4d53-9dbd-4ca0c33d8570 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:08.011985 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52f586-0048-4d53-9dbd-4ca0c33d8570 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:08.012272 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52f586-0048-4d53-9dbd-4ca0c33d8570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:08.031582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7a52f586-0048-4d53-9dbd-4ca0c33d8570 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:08.032851 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7a52f586-0048-4d53-9dbd-4ca0c33d8570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:08.070146 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f5ac8-27c3-4893-a072-9cf354315630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:08.071719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f5ac8-27c3-4893-a072-9cf354315630 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:08.081406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1071/2174] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:29:08.109634 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1104/2175] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:08.119110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d1a7-a2e1-4932-a7fc-e7a81287819a None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:08.119405 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d1a7-a2e1-4932-a7fc-e7a81287819a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:08.119691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d1a7-a2e1-4932-a7fc-e7a81287819a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:08.137778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-3d22d1a7-a2e1-4932-a7fc-e7a81287819a None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:08.139243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3d22d1a7-a2e1-4932-a7fc-e7a81287819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:08.148341 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1072/2176] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:29:08.153112 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52f586-0048-4d53-9dbd-4ca0c33d8570 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:08.164399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52f586-0048-4d53-9dbd-4ca0c33d8570 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:08.169369 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b093a-4d9f-47ee-be91-1c8608b2eee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:08.170167 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b093a-4d9f-47ee-be91-1c8608b2eee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:08.170542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b093a-4d9f-47ee-be91-1c8608b2eee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:08.171810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b093a-4d9f-47ee-be91-1c8608b2eee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:08.172859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b093a-4d9f-47ee-be91-1c8608b2eee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:29:08.173302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b093a-4d9f-47ee-be91-1c8608b2eee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:08.175001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b093a-4d9f-47ee-be91-1c8608b2eee3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:08.189874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1105/2177] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:29:08.194691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22d1a7-a2e1-4932-a7fc-e7a81287819a None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:08.205001 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22d1a7-a2e1-4932-a7fc-e7a81287819a None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:08.211346 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1ec7-99bc-4df9-be56-ee609e9dc1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:08.212056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1ec7-99bc-4df9-be56-ee609e9dc1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:08.212473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1ec7-99bc-4df9-be56-ee609e9dc1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:08.212758 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1ec7-99bc-4df9-be56-ee609e9dc1e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:08.213506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc1ec7-99bc-4df9-be56-ee609e9dc1e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:08.215406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc1ec7-99bc-4df9-be56-ee609e9dc1e2 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:08.254890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1073/2178] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:08 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:08.256556 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b093a-4d9f-47ee-be91-1c8608b2eee3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:08.267875 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b093a-4d9f-47ee-be91-1c8608b2eee3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:08.332807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b9a98-35cc-419d-a708-97306024ef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:08.333703 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b9a98-35cc-419d-a708-97306024ef8d admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:08.334125 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b9a98-35cc-419d-a708-97306024ef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:08.334505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b9a98-35cc-419d-a708-97306024ef8d admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:08.335318 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b9a98-35cc-419d-a708-97306024ef8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:08.337423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b9a98-35cc-419d-a708-97306024ef8d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:08.358209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1106/2179] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:08 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:08.362315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1ec7-99bc-4df9-be56-ee609e9dc1e2 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:08.373013 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b9a98-35cc-419d-a708-97306024ef8d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:08.375121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a50b9a98-35cc-419d-a708-97306024ef8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:08.375969 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1ec7-99bc-4df9-be56-ee609e9dc1e2 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:08.381182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed4cd4-3392-48db-af0e-69f6f8585143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:08.381967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed4cd4-3392-48db-af0e-69f6f8585143 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:08.382253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed4cd4-3392-48db-af0e-69f6f8585143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:08.382533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed4cd4-3392-48db-af0e-69f6f8585143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:08.383276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed4cd4-3392-48db-af0e-69f6f8585143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:08.384878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed4cd4-3392-48db-af0e-69f6f8585143 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:08.389925 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b9a98-35cc-419d-a708-97306024ef8d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:08.395828 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:08.396835 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:08.397546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:08.397899 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] PATH_INFO: `/v3/projects/52b0cfc470434f328592d355e5df2324` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:08.398910 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1074/2180] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:08.399195 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b0cfc470434f328592d355e5df2324)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:08.401501 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:08.403483 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed4cd4-3392-48db-af0e-69f6f8585143 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:08.413588 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed4cd4-3392-48db-af0e-69f6f8585143 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:08.418190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdde1e-9834-41a6-a6be-471da604452b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:08.418837 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdde1e-9834-41a6-a6be-471da604452b admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:08.419116 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdde1e-9834-41a6-a6be-471da604452b admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:08.419391 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdde1e-9834-41a6-a6be-471da604452b admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:08.420108 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdde1e-9834-41a6-a6be-471da604452b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:08.421737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdde1e-9834-41a6-a6be-471da604452b admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:08.432678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1075/2181] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:29:08.436793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdde1e-9834-41a6-a6be-471da604452b admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:08.446171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdde1e-9834-41a6-a6be-471da604452b admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:08.452873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b0cfc470434f328592d355e5df2324', 'request_id': 'req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.460259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b0cfc470434f328592d355e5df2324', 'request_id': 'req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.468464 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b0cfc470434f328592d355e5df2324', 'request_id': 'req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.482939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] The token cache is being invalidate because project 52b0cfc470434f328592d355e5df2324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:08.483216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.483882 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.485756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1107/2182] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:08 2022] DELETE /identity/v3/projects/52b0cfc470434f328592d355e5df2324 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:08.489639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:08.491394 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:08.514370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2405e5-919d-4b41-8e29-b937b144bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:08.515368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2405e5-919d-4b41-8e29-b937b144bac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:08.515713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2405e5-919d-4b41-8e29-b937b144bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:08.515990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2405e5-919d-4b41-8e29-b937b144bac4 admin admin] PATH_INFO: `/v3/projects/fdaf6910385748829273eb39259afd0c/users/4480c827afac43acaced430047abed40/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:08.539093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2405e5-919d-4b41-8e29-b937b144bac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdaf6910385748829273eb39259afd0c, user_id=4480c827afac43acaced430047abed40, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:08.541878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2405e5-919d-4b41-8e29-b937b144bac4 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:08.556608 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1076/2183] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:08 2022] PUT /identity/v3/projects/fdaf6910385748829273eb39259afd0c/users/4480c827afac43acaced430047abed40/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:08.564474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207fccd-d4dd-47e2-a9a5-3e26c8eda0a6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:08.566672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950408e2-d31f-4fce-b46a-410f7cf53b1c None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:08.566960 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950408e2-d31f-4fce-b46a-410f7cf53b1c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:08.567235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950408e2-d31f-4fce-b46a-410f7cf53b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:08.592109 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-950408e2-d31f-4fce-b46a-410f7cf53b1c None None] MFA Rules not processed for user `4480c827afac43acaced430047abed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:08.593334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-950408e2-d31f-4fce-b46a-410f7cf53b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:08.619330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2842ce-40a9-41b6-a30b-bfbd98aa45a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:08.620198 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2842ce-40a9-41b6-a30b-bfbd98aa45a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:08.620473 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2842ce-40a9-41b6-a30b-bfbd98aa45a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:08.620827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2842ce-40a9-41b6-a30b-bfbd98aa45a8 admin admin] PATH_INFO: `/v3/users/17e8214342554684bccecb69c1b63eb7` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:08.621995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2842ce-40a9-41b6-a30b-bfbd98aa45a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e8214342554684bccecb69c1b63eb7)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:08.624087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2842ce-40a9-41b6-a30b-bfbd98aa45a8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:08.661515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1077/2184] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:29:08.670702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950408e2-d31f-4fce-b46a-410f7cf53b1c None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:08.672115 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-950408e2-d31f-4fce-b46a-410f7cf53b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:08.682084 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1e2842ce-40a9-41b6-a30b-bfbd98aa45a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e8214342554684bccecb69c1b63eb7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.695097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1e2842ce-40a9-41b6-a30b-bfbd98aa45a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e8214342554684bccecb69c1b63eb7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.705735 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1e2842ce-40a9-41b6-a30b-bfbd98aa45a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e8214342554684bccecb69c1b63eb7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.706425 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1e2842ce-40a9-41b6-a30b-bfbd98aa45a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e8214342554684bccecb69c1b63eb7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.716533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1e2842ce-40a9-41b6-a30b-bfbd98aa45a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e8214342554684bccecb69c1b63eb7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.722907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1108/2185] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:08 2022] DELETE /identity/v3/users/17e8214342554684bccecb69c1b63eb7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:08.735581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950408e2-d31f-4fce-b46a-410f7cf53b1c None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:08.804850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95e5ee-6129-4228-80af-6a2288c7830d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:08.805625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95e5ee-6129-4228-80af-6a2288c7830d service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:08.806009 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95e5ee-6129-4228-80af-6a2288c7830d service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:08.806358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95e5ee-6129-4228-80af-6a2288c7830d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:08.808305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2b95e5ee-6129-4228-80af-6a2288c7830d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:08.811286 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2842ce-40a9-41b6-a30b-bfbd98aa45a8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:08.812683 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1e2842ce-40a9-41b6-a30b-bfbd98aa45a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:08.881334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95e5ee-6129-4228-80af-6a2288c7830d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:08.882819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95e5ee-6129-4228-80af-6a2288c7830d service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:08.886702 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2842ce-40a9-41b6-a30b-bfbd98aa45a8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:08.892598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1078/2186] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:29:08.902349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fafe7c-f2af-4d16-901b-d0daf6fd94ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:08.903241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fafe7c-f2af-4d16-901b-d0daf6fd94ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:08.903521 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fafe7c-f2af-4d16-901b-d0daf6fd94ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:08.903798 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fafe7c-f2af-4d16-901b-d0daf6fd94ea admin admin] PATH_INFO: `/v3/users/27aae77c95d04b9e8ae549748cb7cfd8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:08.905054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fafe7c-f2af-4d16-901b-d0daf6fd94ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=27aae77c95d04b9e8ae549748cb7cfd8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:08.906998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fafe7c-f2af-4d16-901b-d0daf6fd94ea admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:08.961303 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f6fafe7c-f2af-4d16-901b-d0daf6fd94ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27aae77c95d04b9e8ae549748cb7cfd8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.976419 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f6fafe7c-f2af-4d16-901b-d0daf6fd94ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27aae77c95d04b9e8ae549748cb7cfd8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.984911 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f6fafe7c-f2af-4d16-901b-d0daf6fd94ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27aae77c95d04b9e8ae549748cb7cfd8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:08.985820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f6fafe7c-f2af-4d16-901b-d0daf6fd94ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27aae77c95d04b9e8ae549748cb7cfd8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:09.004806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f6fafe7c-f2af-4d16-901b-d0daf6fd94ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27aae77c95d04b9e8ae549748cb7cfd8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:09.013056 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1109/2187] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:08 2022] DELETE /identity/v3/users/27aae77c95d04b9e8ae549748cb7cfd8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:09.017014 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad53c-0105-4da2-a96e-c263656d6d0c None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:09.017515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad53c-0105-4da2-a96e-c263656d6d0c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:09.017829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cad53c-0105-4da2-a96e-c263656d6d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:09.039810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-94cad53c-0105-4da2-a96e-c263656d6d0c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:09.041414 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-94cad53c-0105-4da2-a96e-c263656d6d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:09.045127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fafe7c-f2af-4d16-901b-d0daf6fd94ea admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:09.049053 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f6fafe7c-f2af-4d16-901b-d0daf6fd94ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:09.142236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1079/2188] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:09.160281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cad53c-0105-4da2-a96e-c263656d6d0c None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:09.165562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-94cad53c-0105-4da2-a96e-c263656d6d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:09.169363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fafe7c-f2af-4d16-901b-d0daf6fd94ea admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:09.183940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:09.184940 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:09.188528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:09.188928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] PATH_INFO: `/v3/projects/449743883078408a8189b340a8f376db` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:09.191896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] RBAC: Authorizing `identity:delete_project(project_id=449743883078408a8189b340a8f376db)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:09.212654 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:09.291003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cad53c-0105-4da2-a96e-c263656d6d0c None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:09.302658 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449743883078408a8189b340a8f376db', 'request_id': 'req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:09.311133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449743883078408a8189b340a8f376db', 'request_id': 'req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:09.320946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449743883078408a8189b340a8f376db', 'request_id': 'req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:09.337957 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] The token cache is being invalidate because project 449743883078408a8189b340a8f376db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:09.338297 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:09.339080 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:09.341340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1110/2189] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:09 2022] DELETE /identity/v3/projects/449743883078408a8189b340a8f376db => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:09.345761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:09.349231 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:09.354501 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46c742-d020-4a60-8c49-d3974dc8345f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:09.355175 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46c742-d020-4a60-8c49-d3974dc8345f service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:09.355465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46c742-d020-4a60-8c49-d3974dc8345f service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:09.355743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46c742-d020-4a60-8c49-d3974dc8345f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:09.357649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9a46c742-d020-4a60-8c49-d3974dc8345f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:09.426991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216cc16e-5dcb-4e6f-9ba3-d74353ac840d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:09.433381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d71878-6fc1-4730-8d11-3196f9674d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:09.434240 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d71878-6fc1-4730-8d11-3196f9674d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:09.434550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d71878-6fc1-4730-8d11-3196f9674d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:09.434788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d71878-6fc1-4730-8d11-3196f9674d1f admin admin] PATH_INFO: `/v3/users/0c62648fdc564fa492cc10342899c16e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:09.436003 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d71878-6fc1-4730-8d11-3196f9674d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c62648fdc564fa492cc10342899c16e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:09.438405 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d71878-6fc1-4730-8d11-3196f9674d1f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:09.447459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46c742-d020-4a60-8c49-d3974dc8345f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:09.449159 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46c742-d020-4a60-8c49-d3974dc8345f service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:09.462587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1080/2190] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:09.518725 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b2d71878-6fc1-4730-8d11-3196f9674d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c62648fdc564fa492cc10342899c16e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:09.534720 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b2d71878-6fc1-4730-8d11-3196f9674d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c62648fdc564fa492cc10342899c16e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:09.546685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b2d71878-6fc1-4730-8d11-3196f9674d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c62648fdc564fa492cc10342899c16e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:09.547627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b2d71878-6fc1-4730-8d11-3196f9674d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c62648fdc564fa492cc10342899c16e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:09.556704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b2d71878-6fc1-4730-8d11-3196f9674d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c62648fdc564fa492cc10342899c16e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:09.565135 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1111/2191] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:09 2022] DELETE /identity/v3/users/0c62648fdc564fa492cc10342899c16e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:09.903510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d71878-6fc1-4730-8d11-3196f9674d1f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:09.903931 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46c742-d020-4a60-8c49-d3974dc8345f service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:09.906188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b2d71878-6fc1-4730-8d11-3196f9674d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:09.923863 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46c742-d020-4a60-8c49-d3974dc8345f service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:09.993477 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d71878-6fc1-4730-8d11-3196f9674d1f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:09.997994 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:09.998841 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:09.999142 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:09.999442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] PATH_INFO: `/v3/projects/5d5d498df0d748b785db2c150e6d32e2` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:10.000624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d5d498df0d748b785db2c150e6d32e2)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:10.002654 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:10.010767 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b871a2e-5183-497d-b380-a229b6deb899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:10.011705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b871a2e-5183-497d-b380-a229b6deb899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:10.012055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b871a2e-5183-497d-b380-a229b6deb899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:10.012434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b871a2e-5183-497d-b380-a229b6deb899 admin admin] PATH_INFO: `/v3/projects/051a23b25111477cbda991ac9fa71cb0` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:10.013901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b871a2e-5183-497d-b380-a229b6deb899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=051a23b25111477cbda991ac9fa71cb0)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:10.015855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b871a2e-5183-497d-b380-a229b6deb899 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:10.055539 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d5d498df0d748b785db2c150e6d32e2', 'request_id': 'req-4d0a014f-7916-4715-b22f-c9ba9682f548'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.062319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d5d498df0d748b785db2c150e6d32e2', 'request_id': 'req-4d0a014f-7916-4715-b22f-c9ba9682f548'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.069633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d5d498df0d748b785db2c150e6d32e2', 'request_id': 'req-4d0a014f-7916-4715-b22f-c9ba9682f548'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.070674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0b871a2e-5183-497d-b380-a229b6deb899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051a23b25111477cbda991ac9fa71cb0', 'request_id': 'req-0b871a2e-5183-497d-b380-a229b6deb899'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.081018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0b871a2e-5183-497d-b380-a229b6deb899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051a23b25111477cbda991ac9fa71cb0', 'request_id': 'req-0b871a2e-5183-497d-b380-a229b6deb899'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.084375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] The token cache is being invalidate because project 5d5d498df0d748b785db2c150e6d32e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:10.085145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.085865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.087379 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0b871a2e-5183-497d-b380-a229b6deb899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051a23b25111477cbda991ac9fa71cb0', 'request_id': 'req-0b871a2e-5183-497d-b380-a229b6deb899'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.087558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1112/2192] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:09 2022] DELETE /identity/v3/projects/5d5d498df0d748b785db2c150e6d32e2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:10.091497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:10.092884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:10.100288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0b871a2e-5183-497d-b380-a229b6deb899 admin admin] The token cache is being invalidate because project 051a23b25111477cbda991ac9fa71cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:10.100839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0b871a2e-5183-497d-b380-a229b6deb899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.101697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0b871a2e-5183-497d-b380-a229b6deb899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.103621 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1081/2193] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:09 2022] DELETE /identity/v3/projects/051a23b25111477cbda991ac9fa71cb0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:10.108883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22302099-3350-4d3d-ab33-12271822218d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:10.109291 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22302099-3350-4d3d-ab33-12271822218d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:10.109641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22302099-3350-4d3d-ab33-12271822218d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:10.132949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-22302099-3350-4d3d-ab33-12271822218d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:10.135216 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-22302099-3350-4d3d-ab33-12271822218d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:10.166730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a014f-7916-4715-b22f-c9ba9682f548 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:10.200548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1082/2194] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:10.207804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53263d50-1b95-447f-824a-13d40a6a2c23 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:10.208163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53263d50-1b95-447f-824a-13d40a6a2c23 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:10.208510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53263d50-1b95-447f-824a-13d40a6a2c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:10.226714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-53263d50-1b95-447f-824a-13d40a6a2c23 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:10.227907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-53263d50-1b95-447f-824a-13d40a6a2c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:10.231885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd27bff-898d-4a16-ae7b-cb231ead6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:10.232770 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27bff-898d-4a16-ae7b-cb231ead6051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:10.233098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27bff-898d-4a16-ae7b-cb231ead6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:10.233360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd27bff-898d-4a16-ae7b-cb231ead6051 admin admin] PATH_INFO: `/v3/users/fb86c099666440e78e2e76a10e66a6c7` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:10.234535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd27bff-898d-4a16-ae7b-cb231ead6051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb86c099666440e78e2e76a10e66a6c7)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:10.236188 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1083/2195] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:10.236457 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd27bff-898d-4a16-ae7b-cb231ead6051 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:10.240051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53263d50-1b95-447f-824a-13d40a6a2c23 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:10.249902 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53263d50-1b95-447f-824a-13d40a6a2c23 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:10.255244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b8e7b-1772-42b6-a78c-0112332f453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:10.256494 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b8e7b-1772-42b6-a78c-0112332f453c admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:10.256755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b8e7b-1772-42b6-a78c-0112332f453c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:10.257052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b8e7b-1772-42b6-a78c-0112332f453c admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:10.257775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b8e7b-1772-42b6-a78c-0112332f453c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:29:10.258081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b8e7b-1772-42b6-a78c-0112332f453c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:10.259664 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b8e7b-1772-42b6-a78c-0112332f453c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:10.273846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1084/2196] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:29:10.281223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b8e7b-1772-42b6-a78c-0112332f453c admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:10.291413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2fd27bff-898d-4a16-ae7b-cb231ead6051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb86c099666440e78e2e76a10e66a6c7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.291767 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b8e7b-1772-42b6-a78c-0112332f453c admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:10.296537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90f1b2-d0b6-4264-bbe0-588e99c3d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:10.297230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90f1b2-d0b6-4264-bbe0-588e99c3d34c admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:10.297514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90f1b2-d0b6-4264-bbe0-588e99c3d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:10.297790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90f1b2-d0b6-4264-bbe0-588e99c3d34c admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:10.298618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90f1b2-d0b6-4264-bbe0-588e99c3d34c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:10.300681 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90f1b2-d0b6-4264-bbe0-588e99c3d34c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:10.306187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2fd27bff-898d-4a16-ae7b-cb231ead6051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb86c099666440e78e2e76a10e66a6c7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.314566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2fd27bff-898d-4a16-ae7b-cb231ead6051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb86c099666440e78e2e76a10e66a6c7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.315553 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2fd27bff-898d-4a16-ae7b-cb231ead6051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb86c099666440e78e2e76a10e66a6c7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.327833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-2fd27bff-898d-4a16-ae7b-cb231ead6051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb86c099666440e78e2e76a10e66a6c7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:10.335984 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1085/2197] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:10 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:10.337013 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1113/2198] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:10 2022] DELETE /identity/v3/users/fb86c099666440e78e2e76a10e66a6c7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:10.340451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90f1b2-d0b6-4264-bbe0-588e99c3d34c admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:10.342852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-cf90f1b2-d0b6-4264-bbe0-588e99c3d34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:10.418415 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90f1b2-d0b6-4264-bbe0-588e99c3d34c admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:10.484597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a6457-13bd-4a9f-b700-db77f6153bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:10.485349 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6457-13bd-4a9f-b700-db77f6153bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:10.485631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6457-13bd-4a9f-b700-db77f6153bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:10.485905 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a6457-13bd-4a9f-b700-db77f6153bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:10.486681 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a6457-13bd-4a9f-b700-db77f6153bf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:10.488528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a6457-13bd-4a9f-b700-db77f6153bf6 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:10.529886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1086/2199] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:10 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:10.530851 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd27bff-898d-4a16-ae7b-cb231ead6051 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:10.544765 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd27bff-898d-4a16-ae7b-cb231ead6051 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:10.550659 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb938e6e-d847-4b7f-941c-6c6b93c0a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:10.551498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb938e6e-d847-4b7f-941c-6c6b93c0a380 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:10.551776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb938e6e-d847-4b7f-941c-6c6b93c0a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:10.552061 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb938e6e-d847-4b7f-941c-6c6b93c0a380 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:10.552955 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb938e6e-d847-4b7f-941c-6c6b93c0a380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:10.556025 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb938e6e-d847-4b7f-941c-6c6b93c0a380 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:10.569055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1114/2200] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:29:10.573249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a6457-13bd-4a9f-b700-db77f6153bf6 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:10.585235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a6457-13bd-4a9f-b700-db77f6153bf6 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:10.593354 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95911765-54c0-456a-91e3-18efc0d02a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:10.594257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911765-54c0-456a-91e3-18efc0d02a86 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:10.594572 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911765-54c0-456a-91e3-18efc0d02a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:10.594989 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95911765-54c0-456a-91e3-18efc0d02a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:10.595788 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95911765-54c0-456a-91e3-18efc0d02a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:10.597671 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95911765-54c0-456a-91e3-18efc0d02a86 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:10.613719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1087/2201] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:10.615097 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb938e6e-d847-4b7f-941c-6c6b93c0a380 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:10.625802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb938e6e-d847-4b7f-941c-6c6b93c0a380 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:10.631644 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb27744-9ed2-4610-ab6d-abe114e5ab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:10.632676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb27744-9ed2-4610-ab6d-abe114e5ab4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:10.633206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb27744-9ed2-4610-ab6d-abe114e5ab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:10.633558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb27744-9ed2-4610-ab6d-abe114e5ab4d admin admin] PATH_INFO: `/v3/projects/cc54327515c1473397509aece282fbe2/users/0fee1c00ec9d419abd7dfcdc45e7c539/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:10.655031 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb27744-9ed2-4610-ab6d-abe114e5ab4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc54327515c1473397509aece282fbe2, user_id=0fee1c00ec9d419abd7dfcdc45e7c539, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:10.658081 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb27744-9ed2-4610-ab6d-abe114e5ab4d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:10.686394 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1115/2202] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:10 2022] PUT /identity/v3/projects/cc54327515c1473397509aece282fbe2/users/0fee1c00ec9d419abd7dfcdc45e7c539/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:10.698693 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2684c8-ba69-47e3-bbc1-d5765d78c5a8 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:10.699061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2684c8-ba69-47e3-bbc1-d5765d78c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:10.699340 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2684c8-ba69-47e3-bbc1-d5765d78c5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:10.754909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-3c2684c8-ba69-47e3-bbc1-d5765d78c5a8 None None] MFA Rules not processed for user `0fee1c00ec9d419abd7dfcdc45e7c539`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:10.757052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3c2684c8-ba69-47e3-bbc1-d5765d78c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:10.887655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1088/2203] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:10.892541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb27744-9ed2-4610-ab6d-abe114e5ab4d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:10.956513 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2684c8-ba69-47e3-bbc1-d5765d78c5a8 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:10.957895 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb27744-9ed2-4610-ab6d-abe114e5ab4d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:10.958412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3c2684c8-ba69-47e3-bbc1-d5765d78c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:10.964218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bce71-37a5-4939-b550-005ce88251bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:10.964924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bce71-37a5-4939-b550-005ce88251bb admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:10.965669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bce71-37a5-4939-b550-005ce88251bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:10.965669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bce71-37a5-4939-b550-005ce88251bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:10.966490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bce71-37a5-4939-b550-005ce88251bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:10.968780 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bce71-37a5-4939-b550-005ce88251bb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:10.994538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2684c8-ba69-47e3-bbc1-d5765d78c5a8 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.000569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e23aa-96dd-402f-bdae-01c25a983492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.001586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e23aa-96dd-402f-bdae-01c25a983492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.001925 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e23aa-96dd-402f-bdae-01c25a983492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.002290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e23aa-96dd-402f-bdae-01c25a983492 admin admin] PATH_INFO: `/v3/projects/aa841c28492042f9969bc36c69366f53` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.005038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e23aa-96dd-402f-bdae-01c25a983492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa841c28492042f9969bc36c69366f53)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.007518 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e23aa-96dd-402f-bdae-01c25a983492 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.017356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1116/2204] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:10 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:29:11.018262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bce71-37a5-4939-b550-005ce88251bb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.079150 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-650e23aa-96dd-402f-bdae-01c25a983492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa841c28492042f9969bc36c69366f53', 'request_id': 'req-650e23aa-96dd-402f-bdae-01c25a983492'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:11.086767 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bce71-37a5-4939-b550-005ce88251bb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.089480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-650e23aa-96dd-402f-bdae-01c25a983492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa841c28492042f9969bc36c69366f53', 'request_id': 'req-650e23aa-96dd-402f-bdae-01c25a983492'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:11.105004 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-650e23aa-96dd-402f-bdae-01c25a983492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa841c28492042f9969bc36c69366f53', 'request_id': 'req-650e23aa-96dd-402f-bdae-01c25a983492'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:11.125545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-650e23aa-96dd-402f-bdae-01c25a983492 admin admin] The token cache is being invalidate because project aa841c28492042f9969bc36c69366f53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:11.125932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-650e23aa-96dd-402f-bdae-01c25a983492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:11.126791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-650e23aa-96dd-402f-bdae-01c25a983492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:11.134244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1089/2205] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:10 2022] DELETE /identity/v3/projects/aa841c28492042f9969bc36c69366f53 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:11.139375 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85152a-f423-4da9-be1d-d5b9ebcf3213 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.139672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85152a-f423-4da9-be1d-d5b9ebcf3213 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.139958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85152a-f423-4da9-be1d-d5b9ebcf3213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.159595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c25fd5-b83c-491d-90f0-ced807423998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.160498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c25fd5-b83c-491d-90f0-ced807423998 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.161253 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c25fd5-b83c-491d-90f0-ced807423998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.163757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c25fd5-b83c-491d-90f0-ced807423998 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.164694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c25fd5-b83c-491d-90f0-ced807423998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.166878 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c25fd5-b83c-491d-90f0-ced807423998 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.167048 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-dd85152a-f423-4da9-be1d-d5b9ebcf3213 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:11.168710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-dd85152a-f423-4da9-be1d-d5b9ebcf3213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:11.194008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1090/2206] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:11.196226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1117/2207] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:11 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:11.196781 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85152a-f423-4da9-be1d-d5b9ebcf3213 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.198360 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-dd85152a-f423-4da9-be1d-d5b9ebcf3213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:11.201667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02307c-e232-4d55-a7dd-dcfbfdb03ff8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.202168 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02307c-e232-4d55-a7dd-dcfbfdb03ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.202779 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02307c-e232-4d55-a7dd-dcfbfdb03ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.215734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85152a-f423-4da9-be1d-d5b9ebcf3213 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.222779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53955d4b-7439-401b-a029-ecd30d0824fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.223542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53955d4b-7439-401b-a029-ecd30d0824fc admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.223830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53955d4b-7439-401b-a029-ecd30d0824fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.224139 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53955d4b-7439-401b-a029-ecd30d0824fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.226332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53955d4b-7439-401b-a029-ecd30d0824fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.228123 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53955d4b-7439-401b-a029-ecd30d0824fc admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.228274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4d02307c-e232-4d55-a7dd-dcfbfdb03ff8 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:11.229741 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4d02307c-e232-4d55-a7dd-dcfbfdb03ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:11.239828 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1118/2208] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:29:11.244251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02307c-e232-4d55-a7dd-dcfbfdb03ff8 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.247115 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1091/2209] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:29:11.250762 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53955d4b-7439-401b-a029-ecd30d0824fc admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.261547 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02307c-e232-4d55-a7dd-dcfbfdb03ff8 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.268874 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53955d4b-7439-401b-a029-ecd30d0824fc admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.271729 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3096745-3f19-439e-b76f-837109b71562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.272790 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3096745-3f19-439e-b76f-837109b71562 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.273209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3096745-3f19-439e-b76f-837109b71562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.273560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3096745-3f19-439e-b76f-837109b71562 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.274363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3096745-3f19-439e-b76f-837109b71562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:29:11.274725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2db2-bc33-4056-b5da-80fec4701849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.274852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3096745-3f19-439e-b76f-837109b71562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.275406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2db2-bc33-4056-b5da-80fec4701849 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.275695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2db2-bc33-4056-b5da-80fec4701849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.275977 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c2db2-bc33-4056-b5da-80fec4701849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.276680 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3096745-3f19-439e-b76f-837109b71562 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.276793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c2db2-bc33-4056-b5da-80fec4701849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.278501 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c2db2-bc33-4056-b5da-80fec4701849 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.293977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1119/2210] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:29:11.298348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1092/2211] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:11.299516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3096745-3f19-439e-b76f-837109b71562 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.299728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2db2-bc33-4056-b5da-80fec4701849 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.310414 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3096745-3f19-439e-b76f-837109b71562 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.320158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d148dde-020a-42a6-b8f0-cdf95e86da07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.320957 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d148dde-020a-42a6-b8f0-cdf95e86da07 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.321516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d148dde-020a-42a6-b8f0-cdf95e86da07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.322343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d148dde-020a-42a6-b8f0-cdf95e86da07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.322572 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d148dde-020a-42a6-b8f0-cdf95e86da07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.324317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c2db2-bc33-4056-b5da-80fec4701849 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.326158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d148dde-020a-42a6-b8f0-cdf95e86da07 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.330402 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0753ef-c8b4-4193-b536-42830098e933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.331410 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0753ef-c8b4-4193-b536-42830098e933 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.331763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0753ef-c8b4-4193-b536-42830098e933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.332142 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0753ef-c8b4-4193-b536-42830098e933 admin admin] PATH_INFO: `/v3/projects/528e10e046e34b26bb8a50533f26719a/users/01fecc79c624455e93691f3d562328eb/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.350381 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0753ef-c8b4-4193-b536-42830098e933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=528e10e046e34b26bb8a50533f26719a, user_id=01fecc79c624455e93691f3d562328eb, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.352631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0753ef-c8b4-4193-b536-42830098e933 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.365851 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1120/2212] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:11 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:11.370935 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d148dde-020a-42a6-b8f0-cdf95e86da07 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.374576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1093/2213] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:11 2022] PUT /identity/v3/projects/528e10e046e34b26bb8a50533f26719a/users/01fecc79c624455e93691f3d562328eb/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:11.384873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a3a4a-71e8-45a1-b200-cc3b824f1585 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.385188 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a3a4a-71e8-45a1-b200-cc3b824f1585 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.385469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a3a4a-71e8-45a1-b200-cc3b824f1585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.417007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-9a8a3a4a-71e8-45a1-b200-cc3b824f1585 None None] MFA Rules not processed for user `01fecc79c624455e93691f3d562328eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:11.420253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9a8a3a4a-71e8-45a1-b200-cc3b824f1585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:11.441373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d148dde-020a-42a6-b8f0-cdf95e86da07 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.490010 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1094/2214] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:11.494312 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a3a4a-71e8-45a1-b200-cc3b824f1585 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.517535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23f683-900c-4752-b2d5-5dded90b9d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.518230 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23f683-900c-4752-b2d5-5dded90b9d40 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.518515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23f683-900c-4752-b2d5-5dded90b9d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.518791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23f683-900c-4752-b2d5-5dded90b9d40 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.519490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23f683-900c-4752-b2d5-5dded90b9d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.521968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23f683-900c-4752-b2d5-5dded90b9d40 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.546523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1121/2215] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:11 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:11.550416 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23f683-900c-4752-b2d5-5dded90b9d40 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.560612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23f683-900c-4752-b2d5-5dded90b9d40 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.565842 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca9f4a-17b4-4fc8-89ea-1f2c5452aaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.566508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca9f4a-17b4-4fc8-89ea-1f2c5452aaed admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.566789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca9f4a-17b4-4fc8-89ea-1f2c5452aaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.567061 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca9f4a-17b4-4fc8-89ea-1f2c5452aaed admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.567787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca9f4a-17b4-4fc8-89ea-1f2c5452aaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.569475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ca9f4a-17b4-4fc8-89ea-1f2c5452aaed admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.573045 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a3a4a-71e8-45a1-b200-cc3b824f1585 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.577742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11de92-fb14-4264-8654-74461180e649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.578416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11de92-fb14-4264-8654-74461180e649 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.578696 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11de92-fb14-4264-8654-74461180e649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.578969 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11de92-fb14-4264-8654-74461180e649 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.579656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11de92-fb14-4264-8654-74461180e649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.579900 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1122/2216] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:29:11.581576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11de92-fb14-4264-8654-74461180e649 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.584998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca9f4a-17b4-4fc8-89ea-1f2c5452aaed admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.594300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca9f4a-17b4-4fc8-89ea-1f2c5452aaed admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.599417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a8be9-bb23-4729-9546-4c75143357e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.600640 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a8be9-bb23-4729-9546-4c75143357e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.600923 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a8be9-bb23-4729-9546-4c75143357e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.601225 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a8be9-bb23-4729-9546-4c75143357e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.601951 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a8be9-bb23-4729-9546-4c75143357e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.603536 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a8be9-bb23-4729-9546-4c75143357e3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.611473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1095/2217] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:11 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:29:11.612459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11de92-fb14-4264-8654-74461180e649 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.615928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1123/2218] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:29:11.619798 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a8be9-bb23-4729-9546-4c75143357e3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.629804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a8be9-bb23-4729-9546-4c75143357e3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.684109 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11de92-fb14-4264-8654-74461180e649 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.689173 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560d2c6-b790-49a9-a8ce-d69ec8df8394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.689797 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b74ad4-cef9-40f1-b455-86ae0b68db10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.690145 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560d2c6-b790-49a9-a8ce-d69ec8df8394 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.690428 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560d2c6-b790-49a9-a8ce-d69ec8df8394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.690705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560d2c6-b790-49a9-a8ce-d69ec8df8394 admin admin] PATH_INFO: `/v3/projects/a1a751b0c106422ea11236bf58bcd805/users/523ff4f80460439886411aa63f5d7d97/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.690811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b74ad4-cef9-40f1-b455-86ae0b68db10 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.691193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b74ad4-cef9-40f1-b455-86ae0b68db10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.691471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b74ad4-cef9-40f1-b455-86ae0b68db10 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.692268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b74ad4-cef9-40f1-b455-86ae0b68db10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.694274 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b74ad4-cef9-40f1-b455-86ae0b68db10 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.707782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560d2c6-b790-49a9-a8ce-d69ec8df8394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1a751b0c106422ea11236bf58bcd805, user_id=523ff4f80460439886411aa63f5d7d97, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.714028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560d2c6-b790-49a9-a8ce-d69ec8df8394 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.717268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1096/2219] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:11 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:11.721131 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b74ad4-cef9-40f1-b455-86ae0b68db10 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.731430 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1124/2220] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:11 2022] PUT /identity/v3/projects/a1a751b0c106422ea11236bf58bcd805/users/523ff4f80460439886411aa63f5d7d97/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:11.732309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b74ad4-cef9-40f1-b455-86ae0b68db10 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.743168 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33f670-06b9-4ebe-9167-0fa9ab7ae381 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.743168 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33f670-06b9-4ebe-9167-0fa9ab7ae381 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.743168 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33f670-06b9-4ebe-9167-0fa9ab7ae381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.770001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ad33f670-06b9-4ebe-9167-0fa9ab7ae381 None None] MFA Rules not processed for user `523ff4f80460439886411aa63f5d7d97`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:11.772365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ad33f670-06b9-4ebe-9167-0fa9ab7ae381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:11.792506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e42f0-77ad-4f1b-b695-012006efa778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.793209 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e42f0-77ad-4f1b-b695-012006efa778 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.793497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e42f0-77ad-4f1b-b695-012006efa778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.793773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e42f0-77ad-4f1b-b695-012006efa778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.794503 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e42f0-77ad-4f1b-b695-012006efa778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.796094 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e42f0-77ad-4f1b-b695-012006efa778 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.809392 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1097/2221] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:29:11.810355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e42f0-77ad-4f1b-b695-012006efa778 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.820080 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e42f0-77ad-4f1b-b695-012006efa778 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.825457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9e023-fa35-4df9-a6fd-fa36352a8cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.826315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9e023-fa35-4df9-a6fd-fa36352a8cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.826608 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9e023-fa35-4df9-a6fd-fa36352a8cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.826877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9e023-fa35-4df9-a6fd-fa36352a8cbd admin admin] PATH_INFO: `/v3/projects/0c54de7655d24834aa0d5662732a83a1/users/3eb7e3c8ad5b4c058b6456776d322fcf/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.842075 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1125/2222] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:29:11.842722 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33f670-06b9-4ebe-9167-0fa9ab7ae381 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.843844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9e023-fa35-4df9-a6fd-fa36352a8cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c54de7655d24834aa0d5662732a83a1, user_id=3eb7e3c8ad5b4c058b6456776d322fcf, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.847141 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9e023-fa35-4df9-a6fd-fa36352a8cbd admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.855405 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33f670-06b9-4ebe-9167-0fa9ab7ae381 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.861380 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c998d59-2be8-4dd1-9ab2-4f21da8ccaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.862047 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c998d59-2be8-4dd1-9ab2-4f21da8ccaed admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.862575 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c998d59-2be8-4dd1-9ab2-4f21da8ccaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.862858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c998d59-2be8-4dd1-9ab2-4f21da8ccaed admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.863732 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c998d59-2be8-4dd1-9ab2-4f21da8ccaed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.865675 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1098/2223] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:11 2022] PUT /identity/v3/projects/0c54de7655d24834aa0d5662732a83a1/users/3eb7e3c8ad5b4c058b6456776d322fcf/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:11.870810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c998d59-2be8-4dd1-9ab2-4f21da8ccaed admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.870938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9e023-fa35-4df9-a6fd-fa36352a8cbd admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.893218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1126/2224] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:11 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:11.897531 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c998d59-2be8-4dd1-9ab2-4f21da8ccaed admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:11.941136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9e023-fa35-4df9-a6fd-fa36352a8cbd admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.957765 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c998d59-2be8-4dd1-9ab2-4f21da8ccaed admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:11.962677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60521a6-036d-492f-86ac-a3365941f1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:11.963309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60521a6-036d-492f-86ac-a3365941f1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:11.963594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60521a6-036d-492f-86ac-a3365941f1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:11.963874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60521a6-036d-492f-86ac-a3365941f1c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:11.965010 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60521a6-036d-492f-86ac-a3365941f1c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:11.966584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60521a6-036d-492f-86ac-a3365941f1c6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:11.995482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1127/2225] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:11 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:29:11.999524 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60521a6-036d-492f-86ac-a3365941f1c6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:12.008784 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd6724-75e1-47f9-b146-4dfdc9e038ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:12.009504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd6724-75e1-47f9-b146-4dfdc9e038ff admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:12.009792 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd6724-75e1-47f9-b146-4dfdc9e038ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:12.009897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60521a6-036d-492f-86ac-a3365941f1c6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:12.010081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd6724-75e1-47f9-b146-4dfdc9e038ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:12.010821 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd6724-75e1-47f9-b146-4dfdc9e038ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:12.012603 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd6724-75e1-47f9-b146-4dfdc9e038ff admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:12.019098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd78ba9-c632-43f6-b293-62ac5ace90e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:12.019832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd78ba9-c632-43f6-b293-62ac5ace90e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:12.020180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd78ba9-c632-43f6-b293-62ac5ace90e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:12.020528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd78ba9-c632-43f6-b293-62ac5ace90e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:12.021398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd78ba9-c632-43f6-b293-62ac5ace90e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:12.026669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1099/2226] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:12.026820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd78ba9-c632-43f6-b293-62ac5ace90e6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:12.027465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd6724-75e1-47f9-b146-4dfdc9e038ff admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:12.034134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1128/2227] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:29:12.038126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd6724-75e1-47f9-b146-4dfdc9e038ff admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:12.038510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd78ba9-c632-43f6-b293-62ac5ace90e6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:12.042746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd7c76-6b29-4017-abd4-43787d3f8725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:12.043613 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd7c76-6b29-4017-abd4-43787d3f8725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:12.043891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd7c76-6b29-4017-abd4-43787d3f8725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:12.044164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd7c76-6b29-4017-abd4-43787d3f8725 admin admin] PATH_INFO: `/v3/projects/0c54de7655d24834aa0d5662732a83a1/users/3eb7e3c8ad5b4c058b6456776d322fcf/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:12.046266 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd7c76-6b29-4017-abd4-43787d3f8725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c54de7655d24834aa0d5662732a83a1, user_id=3eb7e3c8ad5b4c058b6456776d322fcf, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:12.047984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd78ba9-c632-43f6-b293-62ac5ace90e6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:12.048940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd7c76-6b29-4017-abd4-43787d3f8725 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:12.053907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8096d-a03f-4f6f-b2dd-7c8082e6a44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:12.054783 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8096d-a03f-4f6f-b2dd-7c8082e6a44c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:12.055114 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8096d-a03f-4f6f-b2dd-7c8082e6a44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:12.055411 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8096d-a03f-4f6f-b2dd-7c8082e6a44c admin admin] PATH_INFO: `/v3/projects/54af07f2697049eb8899b0dfe30c39d0/users/7c7dd3d7eaa8438784372cd9c413341e/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:12.060210 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1100/2228] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:12 2022] PUT /identity/v3/projects/0c54de7655d24834aa0d5662732a83a1/users/3eb7e3c8ad5b4c058b6456776d322fcf/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:12.070364 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0496d79-4636-44a3-85f9-11d1f87a1b40 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:12.070656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0496d79-4636-44a3-85f9-11d1f87a1b40 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:12.070939 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0496d79-4636-44a3-85f9-11d1f87a1b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:12.071453 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8096d-a03f-4f6f-b2dd-7c8082e6a44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54af07f2697049eb8899b0dfe30c39d0, user_id=7c7dd3d7eaa8438784372cd9c413341e, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:12.074205 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8096d-a03f-4f6f-b2dd-7c8082e6a44c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:12.086753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1129/2229] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:12 2022] PUT /identity/v3/projects/54af07f2697049eb8899b0dfe30c39d0/users/7c7dd3d7eaa8438784372cd9c413341e/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:12.090548 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8096d-a03f-4f6f-b2dd-7c8082e6a44c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:12.097642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-c0496d79-4636-44a3-85f9-11d1f87a1b40 None None] MFA Rules not processed for user `3eb7e3c8ad5b4c058b6456776d322fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:12.098847 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c0496d79-4636-44a3-85f9-11d1f87a1b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:12.149100 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8096d-a03f-4f6f-b2dd-7c8082e6a44c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:12.153719 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59764d-85b9-48b6-bf2f-5a03e9fab597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:12.154385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59764d-85b9-48b6-bf2f-5a03e9fab597 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:12.154670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59764d-85b9-48b6-bf2f-5a03e9fab597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:12.154956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59764d-85b9-48b6-bf2f-5a03e9fab597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:12.155682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59764d-85b9-48b6-bf2f-5a03e9fab597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:12.157314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59764d-85b9-48b6-bf2f-5a03e9fab597 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:12.164121 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1101/2230] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:29:12.170335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1130/2231] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:12 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:29:12.172025 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0496d79-4636-44a3-85f9-11d1f87a1b40 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:12.175395 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59764d-85b9-48b6-bf2f-5a03e9fab597 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:12.177121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2e59764d-85b9-48b6-bf2f-5a03e9fab597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:12.182934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0496d79-4636-44a3-85f9-11d1f87a1b40 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:12.187575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c40ae-6a67-47e6-bf5c-234b6534eb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:12.188499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c40ae-6a67-47e6-bf5c-234b6534eb22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:12.188784 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c40ae-6a67-47e6-bf5c-234b6534eb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:12.189098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c40ae-6a67-47e6-bf5c-234b6534eb22 admin admin] PATH_INFO: `/v3/projects/54af07f2697049eb8899b0dfe30c39d0/users/7c7dd3d7eaa8438784372cd9c413341e/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:12.191074 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c40ae-6a67-47e6-bf5c-234b6534eb22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54af07f2697049eb8899b0dfe30c39d0, user_id=7c7dd3d7eaa8438784372cd9c413341e, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:12.193773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c40ae-6a67-47e6-bf5c-234b6534eb22 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:12.203633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1102/2232] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:12 2022] PUT /identity/v3/projects/54af07f2697049eb8899b0dfe30c39d0/users/7c7dd3d7eaa8438784372cd9c413341e/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:12.214260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525dff1-6284-451a-ad7b-a7f94f25edb9 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:12.214546 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525dff1-6284-451a-ad7b-a7f94f25edb9 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:12.214826 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525dff1-6284-451a-ad7b-a7f94f25edb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:12.233510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59764d-85b9-48b6-bf2f-5a03e9fab597 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:12.240602 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b525dff1-6284-451a-ad7b-a7f94f25edb9 None None] MFA Rules not processed for user `7c7dd3d7eaa8438784372cd9c413341e`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:12.241836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b525dff1-6284-451a-ad7b-a7f94f25edb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:12.279787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f8117-940e-45fd-a29a-bb366512a3a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:12.280363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f8117-940e-45fd-a29a-bb366512a3a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:12.280650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f8117-940e-45fd-a29a-bb366512a3a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:12.280927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f8117-940e-45fd-a29a-bb366512a3a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:12.282728 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-762f8117-940e-45fd-a29a-bb366512a3a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:12.307388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1103/2233] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:29:12.318060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525dff1-6284-451a-ad7b-a7f94f25edb9 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:12.319499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b525dff1-6284-451a-ad7b-a7f94f25edb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:12.330754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525dff1-6284-451a-ad7b-a7f94f25edb9 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:12.334860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec3a71-8cdb-4512-ab6b-759c3e01e294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:12.335502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec3a71-8cdb-4512-ab6b-759c3e01e294 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:12.335785 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec3a71-8cdb-4512-ab6b-759c3e01e294 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:12.336057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec3a71-8cdb-4512-ab6b-759c3e01e294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:12.339785 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f8117-940e-45fd-a29a-bb366512a3a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:12.341283 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f8117-940e-45fd-a29a-bb366512a3a5 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:12.344802 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec3a71-8cdb-4512-ab6b-759c3e01e294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:12.346251 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec3a71-8cdb-4512-ab6b-759c3e01e294 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:12.350710 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1131/2234] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:12.358173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1104/2235] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:29:12.738830 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f8117-940e-45fd-a29a-bb366512a3a5 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:12.801237 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f8117-940e-45fd-a29a-bb366512a3a5 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:12.805910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6bfd7-9a41-4dc6-8147-72d10f30b7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:12.806775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6bfd7-9a41-4dc6-8147-72d10f30b7fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:12.807058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6bfd7-9a41-4dc6-8147-72d10f30b7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:12.807333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6bfd7-9a41-4dc6-8147-72d10f30b7fc admin admin] PATH_INFO: `/v3/users/523ff4f80460439886411aa63f5d7d97` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:12.808502 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6bfd7-9a41-4dc6-8147-72d10f30b7fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=523ff4f80460439886411aa63f5d7d97)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:12.810450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6bfd7-9a41-4dc6-8147-72d10f30b7fc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:12.855403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d1f6bfd7-9a41-4dc6-8147-72d10f30b7fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '523ff4f80460439886411aa63f5d7d97'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:12.866860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d1f6bfd7-9a41-4dc6-8147-72d10f30b7fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '523ff4f80460439886411aa63f5d7d97'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:12.873890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d1f6bfd7-9a41-4dc6-8147-72d10f30b7fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '523ff4f80460439886411aa63f5d7d97'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:12.874961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d1f6bfd7-9a41-4dc6-8147-72d10f30b7fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '523ff4f80460439886411aa63f5d7d97'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:12.884628 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d1f6bfd7-9a41-4dc6-8147-72d10f30b7fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '523ff4f80460439886411aa63f5d7d97'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:12.892284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1132/2236] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:12 2022] DELETE /identity/v3/users/523ff4f80460439886411aa63f5d7d97 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:12.897434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12af235-e823-4344-8174-57bbb3655b18 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:12.897826 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12af235-e823-4344-8174-57bbb3655b18 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:12.898270 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12af235-e823-4344-8174-57bbb3655b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:12.917239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-d12af235-e823-4344-8174-57bbb3655b18 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:12.918537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d12af235-e823-4344-8174-57bbb3655b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:12.980738 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1105/2237] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:12.991033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6bfd7-9a41-4dc6-8147-72d10f30b7fc admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:12.992580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d1f6bfd7-9a41-4dc6-8147-72d10f30b7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:13.050416 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6bfd7-9a41-4dc6-8147-72d10f30b7fc admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:13.055755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6add4-c525-4f81-958b-83819dd1ddfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:13.056439 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6add4-c525-4f81-958b-83819dd1ddfe service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:13.056721 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6add4-c525-4f81-958b-83819dd1ddfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:13.057891 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6add4-c525-4f81-958b-83819dd1ddfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:13.066436 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6add4-c525-4f81-958b-83819dd1ddfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:13.067916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a6add4-c525-4f81-958b-83819dd1ddfe service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:13.086158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1133/2238] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:13.448131 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12af235-e823-4344-8174-57bbb3655b18 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:13.449735 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d12af235-e823-4344-8174-57bbb3655b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:13.464447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12af235-e823-4344-8174-57bbb3655b18 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:13.471581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:13.472612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:13.473015 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:13.473577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] PATH_INFO: `/v3/projects/a1a751b0c106422ea11236bf58bcd805` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:13.476218 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1a751b0c106422ea11236bf58bcd805)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:13.479595 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:13.535316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1a751b0c106422ea11236bf58bcd805', 'request_id': 'req-36e472c2-54cf-4835-b310-c5983b8ce132'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:13.543907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1a751b0c106422ea11236bf58bcd805', 'request_id': 'req-36e472c2-54cf-4835-b310-c5983b8ce132'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:13.549686 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1a751b0c106422ea11236bf58bcd805', 'request_id': 'req-36e472c2-54cf-4835-b310-c5983b8ce132'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:13.561273 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] The token cache is being invalidate because project a1a751b0c106422ea11236bf58bcd805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:13.561559 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:13.562227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:13.563771 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1106/2239] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:13 2022] DELETE /identity/v3/projects/a1a751b0c106422ea11236bf58bcd805 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:13.567816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6add4-c525-4f81-958b-83819dd1ddfe service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:13.580266 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6add4-c525-4f81-958b-83819dd1ddfe service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:13.665501 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe4495-5eea-4e86-aadb-076667109d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:13.666372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe4495-5eea-4e86-aadb-076667109d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:13.666657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe4495-5eea-4e86-aadb-076667109d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:13.666933 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe4495-5eea-4e86-aadb-076667109d6f admin admin] PATH_INFO: `/v3/users/7c7dd3d7eaa8438784372cd9c413341e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:13.668126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe4495-5eea-4e86-aadb-076667109d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c7dd3d7eaa8438784372cd9c413341e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:13.670127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe4495-5eea-4e86-aadb-076667109d6f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:13.730756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1bbe4495-5eea-4e86-aadb-076667109d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c7dd3d7eaa8438784372cd9c413341e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:13.744164 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1bbe4495-5eea-4e86-aadb-076667109d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c7dd3d7eaa8438784372cd9c413341e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:13.753869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1bbe4495-5eea-4e86-aadb-076667109d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c7dd3d7eaa8438784372cd9c413341e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:13.754606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1bbe4495-5eea-4e86-aadb-076667109d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c7dd3d7eaa8438784372cd9c413341e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:13.763343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1bbe4495-5eea-4e86-aadb-076667109d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c7dd3d7eaa8438784372cd9c413341e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:13.769809 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1134/2240] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:13 2022] DELETE /identity/v3/users/7c7dd3d7eaa8438784372cd9c413341e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:14.117850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:14.119334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:14.132901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e472c2-54cf-4835-b310-c5983b8ce132 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:14.188452 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:14.189333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:14.189615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:14.189886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69 admin admin] PATH_INFO: `/v3/projects/54af07f2697049eb8899b0dfe30c39d0` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:14.191046 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54af07f2697049eb8899b0dfe30c39d0)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:14.192939 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:14.236845 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54af07f2697049eb8899b0dfe30c39d0', 'request_id': 'req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:14.244857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54af07f2697049eb8899b0dfe30c39d0', 'request_id': 'req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:14.250779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54af07f2697049eb8899b0dfe30c39d0', 'request_id': 'req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:14.261940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69 admin admin] The token cache is being invalidate because project 54af07f2697049eb8899b0dfe30c39d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:14.262229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:14.263008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2d3997e8-e470-4c8a-9ff8-ea138b39cc69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:14.264637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1107/2241] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:14 2022] DELETE /identity/v3/projects/54af07f2697049eb8899b0dfe30c39d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:14.270531 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e773c-40ce-4272-878d-afbb2dd404c8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:14.271057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e773c-40ce-4272-878d-afbb2dd404c8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:14.271222 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e773c-40ce-4272-878d-afbb2dd404c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:14.292123 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-786e773c-40ce-4272-878d-afbb2dd404c8 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:14.293330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-786e773c-40ce-4272-878d-afbb2dd404c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:14.360250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1135/2242] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:14.369482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f988f-72b2-4bd5-99c8-d4cfd6130718 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:14.369773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f988f-72b2-4bd5-99c8-d4cfd6130718 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:14.370053 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f988f-72b2-4bd5-99c8-d4cfd6130718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:14.392289 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-7b4f988f-72b2-4bd5-99c8-d4cfd6130718 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:14.393572 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7b4f988f-72b2-4bd5-99c8-d4cfd6130718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:14.402547 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1108/2243] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:29:14.406299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e773c-40ce-4272-878d-afbb2dd404c8 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:14.416289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e773c-40ce-4272-878d-afbb2dd404c8 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:14.420814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed80ab1-85da-4bce-9f81-13a97f7c9dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:14.421497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed80ab1-85da-4bce-9f81-13a97f7c9dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:14.421775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed80ab1-85da-4bce-9f81-13a97f7c9dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:14.422052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed80ab1-85da-4bce-9f81-13a97f7c9dfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:14.422769 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed80ab1-85da-4bce-9f81-13a97f7c9dfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:29:14.423070 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed80ab1-85da-4bce-9f81-13a97f7c9dfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:14.424646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed80ab1-85da-4bce-9f81-13a97f7c9dfd admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:14.440123 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1136/2244] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:29:14.441576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f988f-72b2-4bd5-99c8-d4cfd6130718 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:14.450880 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f988f-72b2-4bd5-99c8-d4cfd6130718 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:14.455701 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432bb67-a8f7-4958-93f7-36b9e846041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:14.456355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bb67-a8f7-4958-93f7-36b9e846041a admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:14.456930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bb67-a8f7-4958-93f7-36b9e846041a admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:14.457246 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432bb67-a8f7-4958-93f7-36b9e846041a admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:14.458056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432bb67-a8f7-4958-93f7-36b9e846041a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:14.460756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432bb67-a8f7-4958-93f7-36b9e846041a admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:14.485805 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1109/2245] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:14 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:14.489985 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed80ab1-85da-4bce-9f81-13a97f7c9dfd admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:14.499451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed80ab1-85da-4bce-9f81-13a97f7c9dfd admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:14.555509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd431163-9871-4ed8-b1a4-5373fda0e07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:14.556169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd431163-9871-4ed8-b1a4-5373fda0e07c admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:14.556451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd431163-9871-4ed8-b1a4-5373fda0e07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:14.556730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd431163-9871-4ed8-b1a4-5373fda0e07c admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:14.557454 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd431163-9871-4ed8-b1a4-5373fda0e07c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:14.559364 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd431163-9871-4ed8-b1a4-5373fda0e07c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:14.581561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1137/2246] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:14 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:14.586076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432bb67-a8f7-4958-93f7-36b9e846041a admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:14.596059 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432bb67-a8f7-4958-93f7-36b9e846041a admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:14.601316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aef9f-6931-415e-8547-5e1cccd8a5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:14.601970 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aef9f-6931-415e-8547-5e1cccd8a5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:14.602253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aef9f-6931-415e-8547-5e1cccd8a5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:14.602536 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aef9f-6931-415e-8547-5e1cccd8a5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:14.603261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9aef9f-6931-415e-8547-5e1cccd8a5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:14.604840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9aef9f-6931-415e-8547-5e1cccd8a5b4 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:14.616514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1110/2247] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:29:14.620911 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd431163-9871-4ed8-b1a4-5373fda0e07c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:14.630857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd431163-9871-4ed8-b1a4-5373fda0e07c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:14.635492 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac9693-98f7-40cd-87f9-0412f6dd4a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:14.636538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac9693-98f7-40cd-87f9-0412f6dd4a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:14.636538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac9693-98f7-40cd-87f9-0412f6dd4a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:14.636752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac9693-98f7-40cd-87f9-0412f6dd4a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:14.637455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac9693-98f7-40cd-87f9-0412f6dd4a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:14.639057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac9693-98f7-40cd-87f9-0412f6dd4a81 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:14.649637 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1138/2248] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:14.653742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aef9f-6931-415e-8547-5e1cccd8a5b4 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:14.664368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aef9f-6931-415e-8547-5e1cccd8a5b4 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:14.668998 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca3f96-196a-4f9a-ab53-cfc6f5209a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:14.669880 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca3f96-196a-4f9a-ab53-cfc6f5209a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:14.670162 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca3f96-196a-4f9a-ab53-cfc6f5209a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:14.670437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca3f96-196a-4f9a-ab53-cfc6f5209a4c admin admin] PATH_INFO: `/v3/projects/c6b26afd1a8b4aafa9c1b886d10316e0/users/ff02a0ea406744e38d5a514bde3bc56b/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:14.684518 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca3f96-196a-4f9a-ab53-cfc6f5209a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b26afd1a8b4aafa9c1b886d10316e0, user_id=ff02a0ea406744e38d5a514bde3bc56b, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:14.687168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca3f96-196a-4f9a-ab53-cfc6f5209a4c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:14.699822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1111/2249] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:14 2022] PUT /identity/v3/projects/c6b26afd1a8b4aafa9c1b886d10316e0/users/ff02a0ea406744e38d5a514bde3bc56b/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:14.710535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b146247-4270-4218-9f75-3023d3f3d6a7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:14.710827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b146247-4270-4218-9f75-3023d3f3d6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:14.711120 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b146247-4270-4218-9f75-3023d3f3d6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:14.742805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7b146247-4270-4218-9f75-3023d3f3d6a7 None None] MFA Rules not processed for user `ff02a0ea406744e38d5a514bde3bc56b`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:14.744421 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7b146247-4270-4218-9f75-3023d3f3d6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:14.833271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1139/2250] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:14.837940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca3f96-196a-4f9a-ab53-cfc6f5209a4c admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:14.904829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca3f96-196a-4f9a-ab53-cfc6f5209a4c admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:14.909707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf433c-3396-4d69-b246-80dade0cf28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:14.910263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf433c-3396-4d69-b246-80dade0cf28e admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:14.910514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf433c-3396-4d69-b246-80dade0cf28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:14.910788 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf433c-3396-4d69-b246-80dade0cf28e admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:14.911562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf433c-3396-4d69-b246-80dade0cf28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:14.913421 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf433c-3396-4d69-b246-80dade0cf28e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:14.932499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b146247-4270-4218-9f75-3023d3f3d6a7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:14.933911 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7b146247-4270-4218-9f75-3023d3f3d6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:14.965289 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1112/2251] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:14 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:14.976635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf433c-3396-4d69-b246-80dade0cf28e admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:15.008834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b146247-4270-4218-9f75-3023d3f3d6a7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:15.060208 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf433c-3396-4d69-b246-80dade0cf28e admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:15.066118 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385763d-1479-49c0-b876-e6049072c364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:15.066762 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385763d-1479-49c0-b876-e6049072c364 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:15.067049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385763d-1479-49c0-b876-e6049072c364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:15.067348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385763d-1479-49c0-b876-e6049072c364 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:15.068711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385763d-1479-49c0-b876-e6049072c364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:15.070924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385763d-1479-49c0-b876-e6049072c364 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:15.103075 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1113/2252] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:14 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:15.108243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385763d-1479-49c0-b876-e6049072c364 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:15.113811 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f95f6-8f42-41d9-a310-371536e847db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:15.115664 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f95f6-8f42-41d9-a310-371536e847db service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:15.116463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f95f6-8f42-41d9-a310-371536e847db service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:15.117402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f95f6-8f42-41d9-a310-371536e847db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:15.131118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-526f95f6-8f42-41d9-a310-371536e847db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:15.139215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385763d-1479-49c0-b876-e6049072c364 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:15.156694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99594c46-92bc-4b8a-9552-895628bffcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:15.158808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99594c46-92bc-4b8a-9552-895628bffcaf admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:15.158808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99594c46-92bc-4b8a-9552-895628bffcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:15.158808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99594c46-92bc-4b8a-9552-895628bffcaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:15.158808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99594c46-92bc-4b8a-9552-895628bffcaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:15.160282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99594c46-92bc-4b8a-9552-895628bffcaf admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:15.179352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1114/2253] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:15.189459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99594c46-92bc-4b8a-9552-895628bffcaf admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:15.212874 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99594c46-92bc-4b8a-9552-895628bffcaf admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:15.218709 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f46ac-e6c7-42d3-b0f1-961bddf14974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:15.221438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f46ac-e6c7-42d3-b0f1-961bddf14974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:15.221438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f46ac-e6c7-42d3-b0f1-961bddf14974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:15.221438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f46ac-e6c7-42d3-b0f1-961bddf14974 admin admin] PATH_INFO: `/v3/projects/66c7ae9567e24d469db942fbb6dc0807/users/f9e88c2a31b84185b1b0b6755ed8874e/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:15.245475 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f46ac-e6c7-42d3-b0f1-961bddf14974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c7ae9567e24d469db942fbb6dc0807, user_id=f9e88c2a31b84185b1b0b6755ed8874e, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:15.250252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f46ac-e6c7-42d3-b0f1-961bddf14974 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:15.268907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f95f6-8f42-41d9-a310-371536e847db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:15.270490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f95f6-8f42-41d9-a310-371536e847db service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:15.272413 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1115/2254] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:15 2022] PUT /identity/v3/projects/66c7ae9567e24d469db942fbb6dc0807/users/f9e88c2a31b84185b1b0b6755ed8874e/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:15.276321 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f46ac-e6c7-42d3-b0f1-961bddf14974 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:15.284276 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1140/2255] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:29:15.370900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f46ac-e6c7-42d3-b0f1-961bddf14974 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:15.376007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3930f-25a9-426c-a175-b21c8b6a23a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:15.376667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3930f-25a9-426c-a175-b21c8b6a23a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:15.376956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3930f-25a9-426c-a175-b21c8b6a23a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:15.377455 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3930f-25a9-426c-a175-b21c8b6a23a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:15.378200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3930f-25a9-426c-a175-b21c8b6a23a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:15.379939 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3930f-25a9-426c-a175-b21c8b6a23a7 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:15.391410 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1116/2256] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:29:15.395691 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f95f6-8f42-41d9-a310-371536e847db service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:15.410419 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f95f6-8f42-41d9-a310-371536e847db service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:15.417730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b85008-aa8d-459c-ab3e-b4205e579800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:15.417893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85008-aa8d-459c-ab3e-b4205e579800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:15.418182 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85008-aa8d-459c-ab3e-b4205e579800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:15.418468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b85008-aa8d-459c-ab3e-b4205e579800 admin admin] PATH_INFO: `/v3/projects/66c7ae9567e24d469db942fbb6dc0807/users/f9e88c2a31b84185b1b0b6755ed8874e/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:15.420554 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b85008-aa8d-459c-ab3e-b4205e579800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c7ae9567e24d469db942fbb6dc0807, user_id=f9e88c2a31b84185b1b0b6755ed8874e, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:15.423296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b85008-aa8d-459c-ab3e-b4205e579800 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:15.438128 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1141/2257] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:15 2022] PUT /identity/v3/projects/66c7ae9567e24d469db942fbb6dc0807/users/f9e88c2a31b84185b1b0b6755ed8874e/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:15.449722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bdb77-9041-43c6-bfef-6966fee0ef07 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:15.449722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bdb77-9041-43c6-bfef-6966fee0ef07 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:15.449722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bdb77-9041-43c6-bfef-6966fee0ef07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:15.484693 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-d25bdb77-9041-43c6-bfef-6966fee0ef07 None None] MFA Rules not processed for user `f9e88c2a31b84185b1b0b6755ed8874e`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:15.486076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d25bdb77-9041-43c6-bfef-6966fee0ef07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:15.588141 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1117/2258] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:15.601042 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b85008-aa8d-459c-ab3e-b4205e579800 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:15.603608 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-00b85008-aa8d-459c-ab3e-b4205e579800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:15.674057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b85008-aa8d-459c-ab3e-b4205e579800 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:15.680496 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe0e59-d9d7-41a1-bee0-5de97b3674e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:15.680731 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe0e59-d9d7-41a1-bee0-5de97b3674e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:15.680952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe0e59-d9d7-41a1-bee0-5de97b3674e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:15.681817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe0e59-d9d7-41a1-bee0-5de97b3674e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:15.692826 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe0e59-d9d7-41a1-bee0-5de97b3674e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:15.695341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe0e59-d9d7-41a1-bee0-5de97b3674e2 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:15.713174 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1142/2259] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:15.792168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bdb77-9041-43c6-bfef-6966fee0ef07 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:15.806496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bdb77-9041-43c6-bfef-6966fee0ef07 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:15.810131 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7521cae-9394-49a1-b1ef-cf04ca156f15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:15.810872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7521cae-9394-49a1-b1ef-cf04ca156f15 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:15.811230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7521cae-9394-49a1-b1ef-cf04ca156f15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:15.811565 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7521cae-9394-49a1-b1ef-cf04ca156f15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:15.868966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7521cae-9394-49a1-b1ef-cf04ca156f15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:15.870439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7521cae-9394-49a1-b1ef-cf04ca156f15 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:15.879511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1118/2260] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:15.940246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe0e59-d9d7-41a1-bee0-5de97b3674e2 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:15.952364 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe0e59-d9d7-41a1-bee0-5de97b3674e2 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:15.956014 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33a65f-5149-4381-a5ab-8a295f3063b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:15.956642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a65f-5149-4381-a5ab-8a295f3063b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:15.956919 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a65f-5149-4381-a5ab-8a295f3063b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:15.957223 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a65f-5149-4381-a5ab-8a295f3063b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:15.959521 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-de33a65f-5149-4381-a5ab-8a295f3063b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:16.028731 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33a65f-5149-4381-a5ab-8a295f3063b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:16.030220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33a65f-5149-4381-a5ab-8a295f3063b3 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:16.040548 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1143/2261] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:16.143015 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7521cae-9394-49a1-b1ef-cf04ca156f15 service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:16.204403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7521cae-9394-49a1-b1ef-cf04ca156f15 service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:16.209595 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcd48c-e796-4a33-9a56-deebfb67e3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:16.210492 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcd48c-e796-4a33-9a56-deebfb67e3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:16.210777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcd48c-e796-4a33-9a56-deebfb67e3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:16.211080 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcd48c-e796-4a33-9a56-deebfb67e3ad admin admin] PATH_INFO: `/v3/users/ff02a0ea406744e38d5a514bde3bc56b` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:16.212658 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcd48c-e796-4a33-9a56-deebfb67e3ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff02a0ea406744e38d5a514bde3bc56b)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:16.214199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcd48c-e796-4a33-9a56-deebfb67e3ad admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:16.265107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7dfcd48c-e796-4a33-9a56-deebfb67e3ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff02a0ea406744e38d5a514bde3bc56b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:16.265814 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7dfcd48c-e796-4a33-9a56-deebfb67e3ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff02a0ea406744e38d5a514bde3bc56b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:16.280535 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7dfcd48c-e796-4a33-9a56-deebfb67e3ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff02a0ea406744e38d5a514bde3bc56b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:16.289491 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7dfcd48c-e796-4a33-9a56-deebfb67e3ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff02a0ea406744e38d5a514bde3bc56b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:16.298699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7dfcd48c-e796-4a33-9a56-deebfb67e3ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff02a0ea406744e38d5a514bde3bc56b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:16.306152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1119/2262] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:16 2022] DELETE /identity/v3/users/ff02a0ea406744e38d5a514bde3bc56b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:16.310678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7ad17-7afa-4fd4-b411-0d88aac0ea4f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:16.311183 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7ad17-7afa-4fd4-b411-0d88aac0ea4f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:16.311296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7ad17-7afa-4fd4-b411-0d88aac0ea4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:16.340012 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-61f7ad17-7afa-4fd4-b411-0d88aac0ea4f None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:16.341274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-61f7ad17-7afa-4fd4-b411-0d88aac0ea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:16.402890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1144/2263] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:16.412575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcd48c-e796-4a33-9a56-deebfb67e3ad admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:16.414135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7dfcd48c-e796-4a33-9a56-deebfb67e3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:16.473220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcd48c-e796-4a33-9a56-deebfb67e3ad admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:16.477502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18365204-49b4-4c87-ad0d-6a0246ccecbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:16.478186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18365204-49b4-4c87-ad0d-6a0246ccecbb service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:16.478457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18365204-49b4-4c87-ad0d-6a0246ccecbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:16.478731 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18365204-49b4-4c87-ad0d-6a0246ccecbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:16.488727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18365204-49b4-4c87-ad0d-6a0246ccecbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:16.490384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18365204-49b4-4c87-ad0d-6a0246ccecbb service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:16.500179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1120/2264] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:29:16.849222 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7ad17-7afa-4fd4-b411-0d88aac0ea4f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:16.850833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-61f7ad17-7afa-4fd4-b411-0d88aac0ea4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:16.862338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7ad17-7afa-4fd4-b411-0d88aac0ea4f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:16.867670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:16.868524 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:16.868806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:16.869113 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] PATH_INFO: `/v3/projects/c6b26afd1a8b4aafa9c1b886d10316e0` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:16.870281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b26afd1a8b4aafa9c1b886d10316e0)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:16.872531 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:16.917187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b26afd1a8b4aafa9c1b886d10316e0', 'request_id': 'req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:16.922321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b26afd1a8b4aafa9c1b886d10316e0', 'request_id': 'req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:16.928678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b26afd1a8b4aafa9c1b886d10316e0', 'request_id': 'req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:16.939980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] The token cache is being invalidate because project c6b26afd1a8b4aafa9c1b886d10316e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:16.940259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:16.940861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:16.942400 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1145/2265] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:16 2022] DELETE /identity/v3/projects/c6b26afd1a8b4aafa9c1b886d10316e0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:16.946891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18365204-49b4-4c87-ad0d-6a0246ccecbb service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:16.956028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18365204-49b4-4c87-ad0d-6a0246ccecbb service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:17.010286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c0d0f-fff9-403d-925d-6e38400e5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:17.011176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c0d0f-fff9-403d-925d-6e38400e5534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:17.011456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c0d0f-fff9-403d-925d-6e38400e5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:17.011729 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c0d0f-fff9-403d-925d-6e38400e5534 admin admin] PATH_INFO: `/v3/users/f9e88c2a31b84185b1b0b6755ed8874e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:17.012924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c0d0f-fff9-403d-925d-6e38400e5534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e88c2a31b84185b1b0b6755ed8874e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:17.014855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c0d0f-fff9-403d-925d-6e38400e5534 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:17.058740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-795c0d0f-fff9-403d-925d-6e38400e5534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e88c2a31b84185b1b0b6755ed8874e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.059393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-795c0d0f-fff9-403d-925d-6e38400e5534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e88c2a31b84185b1b0b6755ed8874e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.071193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-795c0d0f-fff9-403d-925d-6e38400e5534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e88c2a31b84185b1b0b6755ed8874e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.077958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-795c0d0f-fff9-403d-925d-6e38400e5534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e88c2a31b84185b1b0b6755ed8874e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.084898 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-795c0d0f-fff9-403d-925d-6e38400e5534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e88c2a31b84185b1b0b6755ed8874e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.091091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1121/2266] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:16 2022] DELETE /identity/v3/users/f9e88c2a31b84185b1b0b6755ed8874e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:17.357886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:17.359417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:17.374647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b9c90e-493b-4a05-bbb6-4a66a4e18a11 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:17.391592 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98bfd7-0503-4477-a3ca-62b77b6aed65 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:17.391934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98bfd7-0503-4477-a3ca-62b77b6aed65 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:17.392196 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98bfd7-0503-4477-a3ca-62b77b6aed65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:17.431357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-ab98bfd7-0503-4477-a3ca-62b77b6aed65 None None] MFA Rules not processed for user `968e45f60cb74bd9b16b2c74801071fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:17.432564 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ab98bfd7-0503-4477-a3ca-62b77b6aed65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:17.459986 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb32aa-6855-45a0-bc70-c894d5cb6176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:17.460866 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb32aa-6855-45a0-bc70-c894d5cb6176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:17.461176 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb32aa-6855-45a0-bc70-c894d5cb6176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:17.461451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb32aa-6855-45a0-bc70-c894d5cb6176 admin admin] PATH_INFO: `/v3/users/4480c827afac43acaced430047abed40` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:17.462815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb32aa-6855-45a0-bc70-c894d5cb6176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4480c827afac43acaced430047abed40)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:17.464787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb32aa-6855-45a0-bc70-c894d5cb6176 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:17.504932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1122/2267] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:17.506416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98bfd7-0503-4477-a3ca-62b77b6aed65 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:17.507820 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ab98bfd7-0503-4477-a3ca-62b77b6aed65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:17.529608 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98bfd7-0503-4477-a3ca-62b77b6aed65 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:17.532156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-41fb32aa-6855-45a0-bc70-c894d5cb6176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4480c827afac43acaced430047abed40'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.538555 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971efb65-458f-4499-91d8-5bf04b827e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:17.539781 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971efb65-458f-4499-91d8-5bf04b827e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:17.540241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971efb65-458f-4499-91d8-5bf04b827e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:17.540712 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971efb65-458f-4499-91d8-5bf04b827e9e admin admin] PATH_INFO: `/v3/projects/66c7ae9567e24d469db942fbb6dc0807` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:17.542239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971efb65-458f-4499-91d8-5bf04b827e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c7ae9567e24d469db942fbb6dc0807)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:17.544541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971efb65-458f-4499-91d8-5bf04b827e9e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:17.548446 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-41fb32aa-6855-45a0-bc70-c894d5cb6176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4480c827afac43acaced430047abed40'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.557973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-41fb32aa-6855-45a0-bc70-c894d5cb6176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4480c827afac43acaced430047abed40'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.559102 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-41fb32aa-6855-45a0-bc70-c894d5cb6176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4480c827afac43acaced430047abed40'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.570792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-41fb32aa-6855-45a0-bc70-c894d5cb6176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4480c827afac43acaced430047abed40'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.582922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1146/2268] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:17 2022] DELETE /identity/v3/users/4480c827afac43acaced430047abed40 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:17.594634 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924366a-1531-4b38-ab38-238378e38531 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:17.595229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924366a-1531-4b38-ab38-238378e38531 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:17.596840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924366a-1531-4b38-ab38-238378e38531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:17.600899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-971efb65-458f-4499-91d8-5bf04b827e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c7ae9567e24d469db942fbb6dc0807', 'request_id': 'req-971efb65-458f-4499-91d8-5bf04b827e9e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.611186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-971efb65-458f-4499-91d8-5bf04b827e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c7ae9567e24d469db942fbb6dc0807', 'request_id': 'req-971efb65-458f-4499-91d8-5bf04b827e9e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.617668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-971efb65-458f-4499-91d8-5bf04b827e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c7ae9567e24d469db942fbb6dc0807', 'request_id': 'req-971efb65-458f-4499-91d8-5bf04b827e9e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.624877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d924366a-1531-4b38-ab38-238378e38531 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:17.626283 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d924366a-1531-4b38-ab38-238378e38531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:17.628794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-971efb65-458f-4499-91d8-5bf04b827e9e admin admin] The token cache is being invalidate because project 66c7ae9567e24d469db942fbb6dc0807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:17.629124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-971efb65-458f-4499-91d8-5bf04b827e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.629811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-971efb65-458f-4499-91d8-5bf04b827e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:17.631380 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1123/2269] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:17 2022] DELETE /identity/v3/projects/66c7ae9567e24d469db942fbb6dc0807 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:17.637782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43210c7-eb13-486c-ab0b-05cd9bc994ea None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:17.638079 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43210c7-eb13-486c-ab0b-05cd9bc994ea None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:17.638557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43210c7-eb13-486c-ab0b-05cd9bc994ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:17.658977 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-f43210c7-eb13-486c-ab0b-05cd9bc994ea None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:17.660192 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f43210c7-eb13-486c-ab0b-05cd9bc994ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:17.694877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1147/2270] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:17.706082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924366a-1531-4b38-ab38-238378e38531 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:17.707636 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d924366a-1531-4b38-ab38-238378e38531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:17.732043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1124/2271] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:17.740773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8ef16-32d2-4242-b465-5fa817785088 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:17.741299 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8ef16-32d2-4242-b465-5fa817785088 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:17.741582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8ef16-32d2-4242-b465-5fa817785088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:17.773215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b8c8ef16-32d2-4242-b465-5fa817785088 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:17.774434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b8c8ef16-32d2-4242-b465-5fa817785088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:17.776243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924366a-1531-4b38-ab38-238378e38531 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:17.781439 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef127cb2-19e1-4667-b40d-7a622f1c52fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:17.782216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef127cb2-19e1-4667-b40d-7a622f1c52fb service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:17.782705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1125/2272] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:17.782817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef127cb2-19e1-4667-b40d-7a622f1c52fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:17.783315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef127cb2-19e1-4667-b40d-7a622f1c52fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:17.786649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8ef16-32d2-4242-b465-5fa817785088 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:17.795611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef127cb2-19e1-4667-b40d-7a622f1c52fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:17.797369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8ef16-32d2-4242-b465-5fa817785088 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:17.797705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef127cb2-19e1-4667-b40d-7a622f1c52fb service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:17.810920 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0c75-1623-4613-a3e6-30d27e12bede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:17.811626 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0c75-1623-4613-a3e6-30d27e12bede admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:17.811908 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0c75-1623-4613-a3e6-30d27e12bede admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:17.812183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0c75-1623-4613-a3e6-30d27e12bede admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:17.812679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1148/2273] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:17.812933 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f0c75-1623-4613-a3e6-30d27e12bede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:29:17.813268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f0c75-1623-4613-a3e6-30d27e12bede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:17.814875 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f0c75-1623-4613-a3e6-30d27e12bede admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:17.831506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1126/2274] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:29:17.833450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef127cb2-19e1-4667-b40d-7a622f1c52fb service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:17.846354 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef127cb2-19e1-4667-b40d-7a622f1c52fb service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:17.855281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f728973-e7d0-48ec-8752-aacab7759546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:17.856284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f728973-e7d0-48ec-8752-aacab7759546 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:17.856763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f728973-e7d0-48ec-8752-aacab7759546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:17.857319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f728973-e7d0-48ec-8752-aacab7759546 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:17.858232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f728973-e7d0-48ec-8752-aacab7759546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:17.861331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f728973-e7d0-48ec-8752-aacab7759546 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:17.896444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1149/2275] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:17 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:17.901299 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0c75-1623-4613-a3e6-30d27e12bede admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:17.912388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0c75-1623-4613-a3e6-30d27e12bede admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:17.987868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a569c-2089-48a5-b454-ea68edfaa502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:17.988611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a569c-2089-48a5-b454-ea68edfaa502 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:17.989187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a569c-2089-48a5-b454-ea68edfaa502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:17.989489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a569c-2089-48a5-b454-ea68edfaa502 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:17.990912 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a569c-2089-48a5-b454-ea68edfaa502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:17.992868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a569c-2089-48a5-b454-ea68edfaa502 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:18.013953 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1127/2276] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:17 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:29:18.017945 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f728973-e7d0-48ec-8752-aacab7759546 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:18.030632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f728973-e7d0-48ec-8752-aacab7759546 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:18.035849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb28eee-ea82-4992-9273-e463e1b136d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:18.036009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb28eee-ea82-4992-9273-e463e1b136d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:18.037080 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb28eee-ea82-4992-9273-e463e1b136d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:18.037408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb28eee-ea82-4992-9273-e463e1b136d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:18.038210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb28eee-ea82-4992-9273-e463e1b136d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:18.040062 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb28eee-ea82-4992-9273-e463e1b136d4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:18.051333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1150/2277] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:29:18.055321 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a569c-2089-48a5-b454-ea68edfaa502 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:18.065803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a569c-2089-48a5-b454-ea68edfaa502 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:18.071135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275827e2-ee80-42fe-ba8d-b2c56a37d20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:18.071791 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275827e2-ee80-42fe-ba8d-b2c56a37d20c admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:18.072072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275827e2-ee80-42fe-ba8d-b2c56a37d20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:18.072349 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275827e2-ee80-42fe-ba8d-b2c56a37d20c admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:18.073114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275827e2-ee80-42fe-ba8d-b2c56a37d20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:18.074702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275827e2-ee80-42fe-ba8d-b2c56a37d20c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:18.088528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1128/2278] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:18.089733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb28eee-ea82-4992-9273-e463e1b136d4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:18.100064 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb28eee-ea82-4992-9273-e463e1b136d4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:18.104798 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce0299-bb99-455a-863b-aef5c708ba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:18.105750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce0299-bb99-455a-863b-aef5c708ba47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:18.106028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce0299-bb99-455a-863b-aef5c708ba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:18.106300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce0299-bb99-455a-863b-aef5c708ba47 admin admin] PATH_INFO: `/v3/projects/aea0bd6f268f4a7fa88cfb7a0066bfd8/users/ff740c982d9f4e3494a624195a6b64cf/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:18.127373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce0299-bb99-455a-863b-aef5c708ba47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea0bd6f268f4a7fa88cfb7a0066bfd8, user_id=ff740c982d9f4e3494a624195a6b64cf, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:18.131470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce0299-bb99-455a-863b-aef5c708ba47 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:18.148816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1151/2279] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:18 2022] PUT /identity/v3/projects/aea0bd6f268f4a7fa88cfb7a0066bfd8/users/ff740c982d9f4e3494a624195a6b64cf/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:18.153884 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db45ae-aa6d-439a-b000-1f86e8dea778 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:18.154178 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db45ae-aa6d-439a-b000-1f86e8dea778 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:18.154455 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db45ae-aa6d-439a-b000-1f86e8dea778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:18.172342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-38db45ae-aa6d-439a-b000-1f86e8dea778 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:18.173584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-38db45ae-aa6d-439a-b000-1f86e8dea778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:18.236082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce0299-bb99-455a-863b-aef5c708ba47 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:18.238347 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8cce0299-bb99-455a-863b-aef5c708ba47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:18.241558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1129/2280] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:18.251635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db45ae-aa6d-439a-b000-1f86e8dea778 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:18.264245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce0299-bb99-455a-863b-aef5c708ba47 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:18.271284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:18.272465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:18.272748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:18.273049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0 admin admin] PATH_INFO: `/v3/projects/fdaf6910385748829273eb39259afd0c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:18.274419 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdaf6910385748829273eb39259afd0c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:18.276850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:18.315309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db45ae-aa6d-439a-b000-1f86e8dea778 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:18.319582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4bd30-d741-4be6-a53c-3960a83f334d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:18.320246 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4bd30-d741-4be6-a53c-3960a83f334d service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:18.320512 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4bd30-d741-4be6-a53c-3960a83f334d service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:18.320785 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4bd30-d741-4be6-a53c-3960a83f334d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:18.331052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4bd30-d741-4be6-a53c-3960a83f334d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:18.332574 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4bd30-d741-4be6-a53c-3960a83f334d service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:18.345601 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1130/2281] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:18.356695 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdaf6910385748829273eb39259afd0c', 'request_id': 'req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:18.362675 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdaf6910385748829273eb39259afd0c', 'request_id': 'req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:18.370777 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdaf6910385748829273eb39259afd0c', 'request_id': 'req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:18.388091 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0 admin admin] The token cache is being invalidate because project fdaf6910385748829273eb39259afd0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:18.388398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:18.389113 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dfa8f74a-2d89-4c71-a7b9-597f0d053fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:18.390696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1152/2282] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:18 2022] DELETE /identity/v3/projects/fdaf6910385748829273eb39259afd0c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:18.397903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f816943-1233-428a-972f-f6aa35997a64 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:18.398090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f816943-1233-428a-972f-f6aa35997a64 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:18.398729 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f816943-1233-428a-972f-f6aa35997a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:18.420425 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-5f816943-1233-428a-972f-f6aa35997a64 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:18.422026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5f816943-1233-428a-972f-f6aa35997a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:18.492651 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1131/2283] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:18.501344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15889d-faa9-4f70-9c7d-629879300755 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:18.501849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15889d-faa9-4f70-9c7d-629879300755 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:18.502567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15889d-faa9-4f70-9c7d-629879300755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:18.531937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7d15889d-faa9-4f70-9c7d-629879300755 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:18.534992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7d15889d-faa9-4f70-9c7d-629879300755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:18.548557 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1153/2284] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:18.552812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f816943-1233-428a-972f-f6aa35997a64 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:18.565190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f816943-1233-428a-972f-f6aa35997a64 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:18.571495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69835f06-b8c0-4ba5-899b-d3630ae93a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:18.572513 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69835f06-b8c0-4ba5-899b-d3630ae93a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:18.573017 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69835f06-b8c0-4ba5-899b-d3630ae93a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:18.584294 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69835f06-b8c0-4ba5-899b-d3630ae93a6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:18.584294 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69835f06-b8c0-4ba5-899b-d3630ae93a6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:29:18.584294 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69835f06-b8c0-4ba5-899b-d3630ae93a6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:18.584294 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69835f06-b8c0-4ba5-899b-d3630ae93a6a admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:18.602618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1132/2285] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:29:18.604251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15889d-faa9-4f70-9c7d-629879300755 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:18.618929 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15889d-faa9-4f70-9c7d-629879300755 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:18.626832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ced07-89bc-4db3-9b89-161f8a8f3008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:18.627692 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ced07-89bc-4db3-9b89-161f8a8f3008 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:18.627981 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ced07-89bc-4db3-9b89-161f8a8f3008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:18.628644 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ced07-89bc-4db3-9b89-161f8a8f3008 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:18.629562 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ced07-89bc-4db3-9b89-161f8a8f3008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:18.632915 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ced07-89bc-4db3-9b89-161f8a8f3008 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:18.678373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1154/2286] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:18 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:18.682165 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69835f06-b8c0-4ba5-899b-d3630ae93a6a admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:18.696260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69835f06-b8c0-4ba5-899b-d3630ae93a6a admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:18.780320 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eacaee-bfea-47b0-9936-48e640a9fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:18.781161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eacaee-bfea-47b0-9936-48e640a9fdec admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:18.781507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eacaee-bfea-47b0-9936-48e640a9fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:18.782020 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eacaee-bfea-47b0-9936-48e640a9fdec admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:18.782896 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eacaee-bfea-47b0-9936-48e640a9fdec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:18.785013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eacaee-bfea-47b0-9936-48e640a9fdec admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:18.821677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1133/2287] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:18 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:18.825467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ced07-89bc-4db3-9b89-161f8a8f3008 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:18.839025 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ced07-89bc-4db3-9b89-161f8a8f3008 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:18.851392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b04ae-b4bf-4fa3-99be-31a4195d1a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:18.852335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b04ae-b4bf-4fa3-99be-31a4195d1a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:18.854004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b04ae-b4bf-4fa3-99be-31a4195d1a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:18.854506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b04ae-b4bf-4fa3-99be-31a4195d1a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:18.856049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b04ae-b4bf-4fa3-99be-31a4195d1a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:18.861900 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b04ae-b4bf-4fa3-99be-31a4195d1a6f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:18.898081 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1155/2288] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:18.902073 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eacaee-bfea-47b0-9936-48e640a9fdec admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:18.926699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eacaee-bfea-47b0-9936-48e640a9fdec admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:18.932067 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb3e31-e007-46ad-b8fa-23e727f0d831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:18.932728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb3e31-e007-46ad-b8fa-23e727f0d831 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:18.933053 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb3e31-e007-46ad-b8fa-23e727f0d831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:18.933337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb3e31-e007-46ad-b8fa-23e727f0d831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:18.934070 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb3e31-e007-46ad-b8fa-23e727f0d831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:18.935682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb3e31-e007-46ad-b8fa-23e727f0d831 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:18.948743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1134/2289] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:18.958123 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b04ae-b4bf-4fa3-99be-31a4195d1a6f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:18.975586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b04ae-b4bf-4fa3-99be-31a4195d1a6f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:18.989555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4072c-bdde-4a36-af2c-1c1c4ad9ba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:18.991192 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4072c-bdde-4a36-af2c-1c1c4ad9ba1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:18.991472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4072c-bdde-4a36-af2c-1c1c4ad9ba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:18.991746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4072c-bdde-4a36-af2c-1c1c4ad9ba1c admin admin] PATH_INFO: `/v3/projects/51884a66cf014d6596d22c37c4a97147/users/50d5a87e4d094287bb543721c9c9909d/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:19.039582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4072c-bdde-4a36-af2c-1c1c4ad9ba1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51884a66cf014d6596d22c37c4a97147, user_id=50d5a87e4d094287bb543721c9c9909d, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:19.046000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4072c-bdde-4a36-af2c-1c1c4ad9ba1c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:19.069688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1156/2290] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:18 2022] PUT /identity/v3/projects/51884a66cf014d6596d22c37c4a97147/users/50d5a87e4d094287bb543721c9c9909d/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:19.075753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93628ed5-2c3a-4794-b36a-b139106e416e None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:19.076059 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93628ed5-2c3a-4794-b36a-b139106e416e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:19.076554 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93628ed5-2c3a-4794-b36a-b139106e416e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:19.096178 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-93628ed5-2c3a-4794-b36a-b139106e416e None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:19.097471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-93628ed5-2c3a-4794-b36a-b139106e416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:19.199302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1135/2291] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:19.319737 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4072c-bdde-4a36-af2c-1c1c4ad9ba1c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:19.322525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-83d4072c-bdde-4a36-af2c-1c1c4ad9ba1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:19.406832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4072c-bdde-4a36-af2c-1c1c4ad9ba1c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:19.412697 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae604f-6917-44cd-8446-ea8ca165675c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:19.413407 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae604f-6917-44cd-8446-ea8ca165675c service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:19.413766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae604f-6917-44cd-8446-ea8ca165675c service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:19.414103 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae604f-6917-44cd-8446-ea8ca165675c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:19.423946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae604f-6917-44cd-8446-ea8ca165675c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:19.425542 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae604f-6917-44cd-8446-ea8ca165675c service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:19.439278 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1157/2292] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:19.620178 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389ede-b6f3-4efa-91d7-8936b03bf39f None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:19.634165 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389ede-b6f3-4efa-91d7-8936b03bf39f None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:19.634885 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07389ede-b6f3-4efa-91d7-8936b03bf39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:19.669922 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-07389ede-b6f3-4efa-91d7-8936b03bf39f None None] MFA Rules not processed for user `ff740c982d9f4e3494a624195a6b64cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:19.673573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-07389ede-b6f3-4efa-91d7-8936b03bf39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:19.759523 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1136/2293] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:19.760529 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae604f-6917-44cd-8446-ea8ca165675c service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:19.761986 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-daae604f-6917-44cd-8446-ea8ca165675c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:19.782851 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae604f-6917-44cd-8446-ea8ca165675c service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:19.789806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337a492-212b-4a3f-8827-e715923ae804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:19.790785 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337a492-212b-4a3f-8827-e715923ae804 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:19.791248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337a492-212b-4a3f-8827-e715923ae804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:19.791700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337a492-212b-4a3f-8827-e715923ae804 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:19.793198 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337a492-212b-4a3f-8827-e715923ae804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:19.795760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337a492-212b-4a3f-8827-e715923ae804 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:19.829083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1158/2294] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:19 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:19.834485 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07389ede-b6f3-4efa-91d7-8936b03bf39f None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:19.861517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07389ede-b6f3-4efa-91d7-8936b03bf39f None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:19.936114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc6258-b537-47ed-8c73-4ce130b730a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:19.936827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc6258-b537-47ed-8c73-4ce130b730a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:19.937115 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc6258-b537-47ed-8c73-4ce130b730a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:19.937487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc6258-b537-47ed-8c73-4ce130b730a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:19.938306 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc6258-b537-47ed-8c73-4ce130b730a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:19.940517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc6258-b537-47ed-8c73-4ce130b730a2 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:19.961518 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1137/2295] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:19 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:19.965527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337a492-212b-4a3f-8827-e715923ae804 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:19.976522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337a492-212b-4a3f-8827-e715923ae804 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:19.994685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faec3e-3a9b-4e57-b6a2-9b28fb793147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:19.995372 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faec3e-3a9b-4e57-b6a2-9b28fb793147 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:19.995653 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faec3e-3a9b-4e57-b6a2-9b28fb793147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:19.995928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faec3e-3a9b-4e57-b6a2-9b28fb793147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:19.996669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faec3e-3a9b-4e57-b6a2-9b28fb793147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:19.998310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faec3e-3a9b-4e57-b6a2-9b28fb793147 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:20.009490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1159/2296] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:20.013752 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc6258-b537-47ed-8c73-4ce130b730a2 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:20.025923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc6258-b537-47ed-8c73-4ce130b730a2 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:20.031392 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88eb7d-31bf-4bdd-891c-dc0e018b4c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:20.032492 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88eb7d-31bf-4bdd-891c-dc0e018b4c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:20.032921 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88eb7d-31bf-4bdd-891c-dc0e018b4c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:20.033721 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88eb7d-31bf-4bdd-891c-dc0e018b4c6d admin admin] PATH_INFO: `/v3/projects/f9c319ba50a64fa68161a5b025915ed1/users/95bb81143a5f4f2ca0f8670bdb2bd0ab/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:20.053705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88eb7d-31bf-4bdd-891c-dc0e018b4c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c319ba50a64fa68161a5b025915ed1, user_id=95bb81143a5f4f2ca0f8670bdb2bd0ab, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:20.057684 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88eb7d-31bf-4bdd-891c-dc0e018b4c6d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:20.085870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1138/2297] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:20 2022] PUT /identity/v3/projects/f9c319ba50a64fa68161a5b025915ed1/users/95bb81143a5f4f2ca0f8670bdb2bd0ab/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:20.087775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faec3e-3a9b-4e57-b6a2-9b28fb793147 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:20.105443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faec3e-3a9b-4e57-b6a2-9b28fb793147 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:20.151318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88eb7d-31bf-4bdd-891c-dc0e018b4c6d admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:20.153571 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0e88eb7d-31bf-4bdd-891c-dc0e018b4c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:20.193686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13a7ce-d4d1-4323-baf1-fedb87dddc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:20.194364 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13a7ce-d4d1-4323-baf1-fedb87dddc3a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:20.194649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13a7ce-d4d1-4323-baf1-fedb87dddc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:20.194927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13a7ce-d4d1-4323-baf1-fedb87dddc3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:20.195658 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13a7ce-d4d1-4323-baf1-fedb87dddc3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:20.197409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13a7ce-d4d1-4323-baf1-fedb87dddc3a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:20.211111 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1160/2298] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:20 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:29:20.211982 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13a7ce-d4d1-4323-baf1-fedb87dddc3a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:20.221737 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13a7ce-d4d1-4323-baf1-fedb87dddc3a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:20.226685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f828ba-1f23-431d-89d4-f97f81a48494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:20.227813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f828ba-1f23-431d-89d4-f97f81a48494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:20.228103 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f828ba-1f23-431d-89d4-f97f81a48494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:20.228390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f828ba-1f23-431d-89d4-f97f81a48494 admin admin] PATH_INFO: `/v3/projects/f9c319ba50a64fa68161a5b025915ed1/users/95bb81143a5f4f2ca0f8670bdb2bd0ab/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:20.230820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f828ba-1f23-431d-89d4-f97f81a48494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c319ba50a64fa68161a5b025915ed1, user_id=95bb81143a5f4f2ca0f8670bdb2bd0ab, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:20.233753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f828ba-1f23-431d-89d4-f97f81a48494 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:20.235265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88eb7d-31bf-4bdd-891c-dc0e018b4c6d admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:20.240563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddc8e8-ac37-457b-95f6-5d1332dc0af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:20.241699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddc8e8-ac37-457b-95f6-5d1332dc0af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:20.242082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddc8e8-ac37-457b-95f6-5d1332dc0af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:20.242450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddc8e8-ac37-457b-95f6-5d1332dc0af3 admin admin] PATH_INFO: `/v3/users/0fee1c00ec9d419abd7dfcdc45e7c539` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:20.243755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddc8e8-ac37-457b-95f6-5d1332dc0af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fee1c00ec9d419abd7dfcdc45e7c539)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:20.246034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddc8e8-ac37-457b-95f6-5d1332dc0af3 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:20.246147 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1161/2299] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:20 2022] PUT /identity/v3/projects/f9c319ba50a64fa68161a5b025915ed1/users/95bb81143a5f4f2ca0f8670bdb2bd0ab/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:20.298384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-1eddc8e8-ac37-457b-95f6-5d1332dc0af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fee1c00ec9d419abd7dfcdc45e7c539'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:20.299112 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-1eddc8e8-ac37-457b-95f6-5d1332dc0af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fee1c00ec9d419abd7dfcdc45e7c539'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:20.313786 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-1eddc8e8-ac37-457b-95f6-5d1332dc0af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fee1c00ec9d419abd7dfcdc45e7c539'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:20.323212 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-1eddc8e8-ac37-457b-95f6-5d1332dc0af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fee1c00ec9d419abd7dfcdc45e7c539'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:20.336845 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-1eddc8e8-ac37-457b-95f6-5d1332dc0af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fee1c00ec9d419abd7dfcdc45e7c539'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:20.344748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1139/2300] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:20 2022] DELETE /identity/v3/users/0fee1c00ec9d419abd7dfcdc45e7c539 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:20.349321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbcd20-50f6-4c54-abfd-62e5ad5241ab None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:20.350214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbcd20-50f6-4c54-abfd-62e5ad5241ab None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:20.350508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbcd20-50f6-4c54-abfd-62e5ad5241ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:20.374398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9ccbcd20-50f6-4c54-abfd-62e5ad5241ab None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:20.376144 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9ccbcd20-50f6-4c54-abfd-62e5ad5241ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:20.450773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1162/2301] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:29:20.476076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddc8e8-ac37-457b-95f6-5d1332dc0af3 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:20.479634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-1eddc8e8-ac37-457b-95f6-5d1332dc0af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:20.582274 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddc8e8-ac37-457b-95f6-5d1332dc0af3 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:20.592529 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee775c25-1d77-4679-88c9-2f0164776ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:20.595907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee775c25-1d77-4679-88c9-2f0164776ccc service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:20.595907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee775c25-1d77-4679-88c9-2f0164776ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:20.595907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee775c25-1d77-4679-88c9-2f0164776ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:20.611756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee775c25-1d77-4679-88c9-2f0164776ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:20.613689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee775c25-1d77-4679-88c9-2f0164776ccc service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:20.629200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1140/2302] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:21.446008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbcd20-50f6-4c54-abfd-62e5ad5241ab None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:21.447676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9ccbcd20-50f6-4c54-abfd-62e5ad5241ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:21.460605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbcd20-50f6-4c54-abfd-62e5ad5241ab None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:21.477250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:21.478711 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:21.479510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:21.479970 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad admin admin] PATH_INFO: `/v3/projects/cc54327515c1473397509aece282fbe2` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:21.482204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc54327515c1473397509aece282fbe2)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:21.485813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:21.559590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc54327515c1473397509aece282fbe2', 'request_id': 'req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:21.570236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc54327515c1473397509aece282fbe2', 'request_id': 'req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:21.577164 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc54327515c1473397509aece282fbe2', 'request_id': 'req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:21.593467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad admin admin] The token cache is being invalidate because project cc54327515c1473397509aece282fbe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:21.593757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:21.594626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ce01ca59-08ef-41fb-b7d1-7b8667d74aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:21.596193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1163/2303] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:21 2022] DELETE /identity/v3/projects/cc54327515c1473397509aece282fbe2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:21.600764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee775c25-1d77-4679-88c9-2f0164776ccc service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:21.612622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee775c25-1d77-4679-88c9-2f0164776ccc service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:21.695386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90f021-8057-4fd1-9172-f2e6516d84cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:21.696331 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90f021-8057-4fd1-9172-f2e6516d84cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:21.696619 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90f021-8057-4fd1-9172-f2e6516d84cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:21.696904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90f021-8057-4fd1-9172-f2e6516d84cc admin admin] PATH_INFO: `/v3/users/01fecc79c624455e93691f3d562328eb` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:21.698228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90f021-8057-4fd1-9172-f2e6516d84cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=01fecc79c624455e93691f3d562328eb)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:21.700253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90f021-8057-4fd1-9172-f2e6516d84cc admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:21.763847 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4a90f021-8057-4fd1-9172-f2e6516d84cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01fecc79c624455e93691f3d562328eb'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:21.765530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4a90f021-8057-4fd1-9172-f2e6516d84cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01fecc79c624455e93691f3d562328eb'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:21.786236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4a90f021-8057-4fd1-9172-f2e6516d84cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01fecc79c624455e93691f3d562328eb'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:21.798330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4a90f021-8057-4fd1-9172-f2e6516d84cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01fecc79c624455e93691f3d562328eb'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:21.807038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4a90f021-8057-4fd1-9172-f2e6516d84cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01fecc79c624455e93691f3d562328eb'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:21.816149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1141/2304] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:21 2022] DELETE /identity/v3/users/01fecc79c624455e93691f3d562328eb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:21.842859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4586c-6210-42d2-aebe-7484a2d6c487 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:21.843391 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4586c-6210-42d2-aebe-7484a2d6c487 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:21.843820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4586c-6210-42d2-aebe-7484a2d6c487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:21.883472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8ac4586c-6210-42d2-aebe-7484a2d6c487 None None] MFA Rules not processed for user `95bb81143a5f4f2ca0f8670bdb2bd0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:21.885883 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8ac4586c-6210-42d2-aebe-7484a2d6c487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:22.097829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1164/2305] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:22.115346 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90f021-8057-4fd1-9172-f2e6516d84cc admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:22.117373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-4a90f021-8057-4fd1-9172-f2e6516d84cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:22.283439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90f021-8057-4fd1-9172-f2e6516d84cc admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:22.288992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df41226-963e-409a-b94a-4333151fde3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:22.289805 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df41226-963e-409a-b94a-4333151fde3a service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:22.290011 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df41226-963e-409a-b94a-4333151fde3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:22.291091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df41226-963e-409a-b94a-4333151fde3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:22.294122 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2df41226-963e-409a-b94a-4333151fde3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:22.392268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df41226-963e-409a-b94a-4333151fde3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:22.394734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df41226-963e-409a-b94a-4333151fde3a service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:22.436238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1142/2306] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:22.489215 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4586c-6210-42d2-aebe-7484a2d6c487 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:22.491495 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8ac4586c-6210-42d2-aebe-7484a2d6c487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:22.654732 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4586c-6210-42d2-aebe-7484a2d6c487 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:22.668217 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:22.675838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:22.676129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:22.676876 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] PATH_INFO: `/v3/projects/528e10e046e34b26bb8a50533f26719a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:22.679149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=528e10e046e34b26bb8a50533f26719a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:22.681668 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:22.788799 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '528e10e046e34b26bb8a50533f26719a', 'request_id': 'req-6abe9c7c-6459-485e-8229-7f52264fb221'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:22.800258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '528e10e046e34b26bb8a50533f26719a', 'request_id': 'req-6abe9c7c-6459-485e-8229-7f52264fb221'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:22.813343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '528e10e046e34b26bb8a50533f26719a', 'request_id': 'req-6abe9c7c-6459-485e-8229-7f52264fb221'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:22.834936 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] The token cache is being invalidate because project 528e10e046e34b26bb8a50533f26719a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:22.835339 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:22.837760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:22.839714 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1165/2307] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:22 2022] DELETE /identity/v3/projects/528e10e046e34b26bb8a50533f26719a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:22.844152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df41226-963e-409a-b94a-4333151fde3a service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:22.858809 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df41226-963e-409a-b94a-4333151fde3a service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:22.970538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f144a2c-7937-4134-93ed-9dea295f1545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:22.971839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f144a2c-7937-4134-93ed-9dea295f1545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:22.972358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f144a2c-7937-4134-93ed-9dea295f1545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:22.972836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f144a2c-7937-4134-93ed-9dea295f1545 admin admin] PATH_INFO: `/v3/users/3eb7e3c8ad5b4c058b6456776d322fcf` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:22.974961 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f144a2c-7937-4134-93ed-9dea295f1545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb7e3c8ad5b4c058b6456776d322fcf)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:22.977615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f144a2c-7937-4134-93ed-9dea295f1545 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:23.065013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0f144a2c-7937-4134-93ed-9dea295f1545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb7e3c8ad5b4c058b6456776d322fcf'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:23.069169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0f144a2c-7937-4134-93ed-9dea295f1545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb7e3c8ad5b4c058b6456776d322fcf'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:23.097834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0f144a2c-7937-4134-93ed-9dea295f1545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb7e3c8ad5b4c058b6456776d322fcf'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:23.109348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0f144a2c-7937-4134-93ed-9dea295f1545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb7e3c8ad5b4c058b6456776d322fcf'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:23.119078 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0f144a2c-7937-4134-93ed-9dea295f1545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb7e3c8ad5b4c058b6456776d322fcf'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:23.132430 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1143/2308] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:22 2022] DELETE /identity/v3/users/3eb7e3c8ad5b4c058b6456776d322fcf => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:23.631337 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:23.635631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:23.650468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe9c7c-6459-485e-8229-7f52264fb221 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:23.712064 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d06032-7581-40a9-8f1d-cf0928b08f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:23.713531 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d06032-7581-40a9-8f1d-cf0928b08f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:23.713968 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d06032-7581-40a9-8f1d-cf0928b08f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:23.714395 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d06032-7581-40a9-8f1d-cf0928b08f9f admin admin] PATH_INFO: `/v3/projects/0c54de7655d24834aa0d5662732a83a1` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:23.715812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d06032-7581-40a9-8f1d-cf0928b08f9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c54de7655d24834aa0d5662732a83a1)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:23.718784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d06032-7581-40a9-8f1d-cf0928b08f9f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:23.772785 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22d06032-7581-40a9-8f1d-cf0928b08f9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c54de7655d24834aa0d5662732a83a1', 'request_id': 'req-22d06032-7581-40a9-8f1d-cf0928b08f9f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:23.809056 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22d06032-7581-40a9-8f1d-cf0928b08f9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c54de7655d24834aa0d5662732a83a1', 'request_id': 'req-22d06032-7581-40a9-8f1d-cf0928b08f9f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:23.824121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22d06032-7581-40a9-8f1d-cf0928b08f9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c54de7655d24834aa0d5662732a83a1', 'request_id': 'req-22d06032-7581-40a9-8f1d-cf0928b08f9f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:23.841755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22d06032-7581-40a9-8f1d-cf0928b08f9f admin admin] The token cache is being invalidate because project 0c54de7655d24834aa0d5662732a83a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:23.842044 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22d06032-7581-40a9-8f1d-cf0928b08f9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:23.843075 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-22d06032-7581-40a9-8f1d-cf0928b08f9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:23.845884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1166/2309] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:23 2022] DELETE /identity/v3/projects/0c54de7655d24834aa0d5662732a83a1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:23.851223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500e409-9d77-491d-aaa1-f7b01b388a98 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:23.852073 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500e409-9d77-491d-aaa1-f7b01b388a98 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:23.852495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500e409-9d77-491d-aaa1-f7b01b388a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:23.877506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-5500e409-9d77-491d-aaa1-f7b01b388a98 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:23.879558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5500e409-9d77-491d-aaa1-f7b01b388a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:23.995207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1144/2310] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:24.002981 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de21f8-f5ed-43ef-95b2-fd7aaa8c982c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:24.003438 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de21f8-f5ed-43ef-95b2-fd7aaa8c982c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:24.003787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de21f8-f5ed-43ef-95b2-fd7aaa8c982c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:24.028526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c3de21f8-f5ed-43ef-95b2-fd7aaa8c982c None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:24.029981 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c3de21f8-f5ed-43ef-95b2-fd7aaa8c982c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:24.042157 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1167/2311] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:24.046214 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500e409-9d77-491d-aaa1-f7b01b388a98 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:24.061727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500e409-9d77-491d-aaa1-f7b01b388a98 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:24.072369 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8bc35-85f6-46e8-b79e-429d17e1f207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:24.077238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8bc35-85f6-46e8-b79e-429d17e1f207 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:24.077735 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8bc35-85f6-46e8-b79e-429d17e1f207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:24.078169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8bc35-85f6-46e8-b79e-429d17e1f207 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:24.079118 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8bc35-85f6-46e8-b79e-429d17e1f207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:29:24.079885 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8bc35-85f6-46e8-b79e-429d17e1f207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:24.081986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8bc35-85f6-46e8-b79e-429d17e1f207 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:24.101205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1145/2312] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:29:24.103615 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de21f8-f5ed-43ef-95b2-fd7aaa8c982c None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:24.113365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de21f8-f5ed-43ef-95b2-fd7aaa8c982c None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:24.133652 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a4f4e-0a7d-4bf6-9659-ff972a8f9f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:24.134448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a4f4e-0a7d-4bf6-9659-ff972a8f9f20 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:24.134807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a4f4e-0a7d-4bf6-9659-ff972a8f9f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:24.135178 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a4f4e-0a7d-4bf6-9659-ff972a8f9f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:24.135832 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8bc35-85f6-46e8-b79e-429d17e1f207 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:24.136089 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a4f4e-0a7d-4bf6-9659-ff972a8f9f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:24.138155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a4f4e-0a7d-4bf6-9659-ff972a8f9f20 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:24.138640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ebb8bc35-85f6-46e8-b79e-429d17e1f207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:24.175816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1168/2313] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:24 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:24.180590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a4f4e-0a7d-4bf6-9659-ff972a8f9f20 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:24.213807 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8bc35-85f6-46e8-b79e-429d17e1f207 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:24.288304 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59732b47-7c3d-43d5-b74b-5849c6c24c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:24.289012 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59732b47-7c3d-43d5-b74b-5849c6c24c33 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:24.289360 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59732b47-7c3d-43d5-b74b-5849c6c24c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:24.289542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59732b47-7c3d-43d5-b74b-5849c6c24c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:24.295967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-59732b47-7c3d-43d5-b74b-5849c6c24c33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:24.324726 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a4f4e-0a7d-4bf6-9659-ff972a8f9f20 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:24.346924 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66538fb2-f112-44c0-96a2-919a7ac1b0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:24.347714 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66538fb2-f112-44c0-96a2-919a7ac1b0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:24.347932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66538fb2-f112-44c0-96a2-919a7ac1b0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:24.348215 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66538fb2-f112-44c0-96a2-919a7ac1b0b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:24.348949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66538fb2-f112-44c0-96a2-919a7ac1b0b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:24.351481 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66538fb2-f112-44c0-96a2-919a7ac1b0b3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:24.376692 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59732b47-7c3d-43d5-b74b-5849c6c24c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:24.380438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59732b47-7c3d-43d5-b74b-5849c6c24c33 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:24.391994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1146/2314] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:24 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:24.392277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1169/2315] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:24 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:24.405085 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59732b47-7c3d-43d5-b74b-5849c6c24c33 service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:24.427695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59732b47-7c3d-43d5-b74b-5849c6c24c33 service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:24.439910 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d84aa-2285-441f-af1b-b30276de54a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:24.440904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d84aa-2285-441f-af1b-b30276de54a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:24.441416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d84aa-2285-441f-af1b-b30276de54a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:24.441892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d84aa-2285-441f-af1b-b30276de54a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:24.442914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d84aa-2285-441f-af1b-b30276de54a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:24.444737 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d84aa-2285-441f-af1b-b30276de54a5 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:24.470929 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1147/2316] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:24.472121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66538fb2-f112-44c0-96a2-919a7ac1b0b3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:24.488998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66538fb2-f112-44c0-96a2-919a7ac1b0b3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:24.497111 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac840b76-07c1-4736-91bc-1b6c06d55c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:24.497796 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac840b76-07c1-4736-91bc-1b6c06d55c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:24.498083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac840b76-07c1-4736-91bc-1b6c06d55c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:24.498361 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac840b76-07c1-4736-91bc-1b6c06d55c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:24.499107 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac840b76-07c1-4736-91bc-1b6c06d55c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:24.500708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac840b76-07c1-4736-91bc-1b6c06d55c20 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:24.512114 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1170/2317] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:24.516230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d84aa-2285-441f-af1b-b30276de54a5 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:24.528646 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d84aa-2285-441f-af1b-b30276de54a5 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:24.534124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f260bf-1764-4b3d-8f8c-61d737bcd498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:24.535030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f260bf-1764-4b3d-8f8c-61d737bcd498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:24.535376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f260bf-1764-4b3d-8f8c-61d737bcd498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:24.535661 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f260bf-1764-4b3d-8f8c-61d737bcd498 admin admin] PATH_INFO: `/v3/projects/f41df963fc334b24b0ddef0946179bb6/users/7c4fb8aded0e4f62a7e67e9bd23b81b1/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:24.578050 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f260bf-1764-4b3d-8f8c-61d737bcd498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41df963fc334b24b0ddef0946179bb6, user_id=7c4fb8aded0e4f62a7e67e9bd23b81b1, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:24.578050 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f260bf-1764-4b3d-8f8c-61d737bcd498 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:24.618433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1148/2318] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:24 2022] PUT /identity/v3/projects/f41df963fc334b24b0ddef0946179bb6/users/7c4fb8aded0e4f62a7e67e9bd23b81b1/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:24.618579 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27cb9b-390c-4c2d-8b6d-9e82f5c0e04d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:24.618868 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27cb9b-390c-4c2d-8b6d-9e82f5c0e04d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:24.619160 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27cb9b-390c-4c2d-8b6d-9e82f5c0e04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:24.659665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5b27cb9b-390c-4c2d-8b6d-9e82f5c0e04d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:24.660908 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5b27cb9b-390c-4c2d-8b6d-9e82f5c0e04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:24.761678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1171/2319] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:29:24.782622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f260bf-1764-4b3d-8f8c-61d737bcd498 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:24.785569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-83f260bf-1764-4b3d-8f8c-61d737bcd498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:24.856965 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f260bf-1764-4b3d-8f8c-61d737bcd498 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:24.861928 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442bab9-6588-437d-ab0c-56df7f092072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:24.862590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442bab9-6588-437d-ab0c-56df7f092072 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:24.863172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442bab9-6588-437d-ab0c-56df7f092072 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:24.863463 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442bab9-6588-437d-ab0c-56df7f092072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:24.878616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442bab9-6588-437d-ab0c-56df7f092072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:24.882307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442bab9-6588-437d-ab0c-56df7f092072 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:24.901287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1149/2320] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:27.114284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006c3e3-1c0a-49bc-a791-c12c029b811c None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:27.115798 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006c3e3-1c0a-49bc-a791-c12c029b811c None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:27.116220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006c3e3-1c0a-49bc-a791-c12c029b811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:27.160414 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e006c3e3-1c0a-49bc-a791-c12c029b811c None None] MFA Rules not processed for user `7c4fb8aded0e4f62a7e67e9bd23b81b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:27.162474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e006c3e3-1c0a-49bc-a791-c12c029b811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:27.251539 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1172/2321] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:27.265116 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442bab9-6588-437d-ab0c-56df7f092072 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:27.266585 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f442bab9-6588-437d-ab0c-56df7f092072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:27.361315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442bab9-6588-437d-ab0c-56df7f092072 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:27.367749 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e222-0ab5-4753-8a76-89c39bd99768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:27.368433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e222-0ab5-4753-8a76-89c39bd99768 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:27.368776 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e222-0ab5-4753-8a76-89c39bd99768 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:27.369097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344e222-0ab5-4753-8a76-89c39bd99768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:27.381826 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e222-0ab5-4753-8a76-89c39bd99768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:27.383290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344e222-0ab5-4753-8a76-89c39bd99768 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:27.417308 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1150/2322] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:27.872821 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde82b10-56ca-4cc8-ba72-9d1b7e20fcb2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:27.873356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde82b10-56ca-4cc8-ba72-9d1b7e20fcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:27.873737 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde82b10-56ca-4cc8-ba72-9d1b7e20fcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:27.915706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-dde82b10-56ca-4cc8-ba72-9d1b7e20fcb2 None None] MFA Rules not processed for user `50d5a87e4d094287bb543721c9c9909d`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:27.917739 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-dde82b10-56ca-4cc8-ba72-9d1b7e20fcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:28.065086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1173/2323] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:28.069930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e222-0ab5-4753-8a76-89c39bd99768 service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:28.071419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-4344e222-0ab5-4753-8a76-89c39bd99768 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:28.090451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344e222-0ab5-4753-8a76-89c39bd99768 service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:28.100684 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af76e73-7a05-4b52-a581-655af1d3a8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:28.101665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af76e73-7a05-4b52-a581-655af1d3a8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:28.102166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af76e73-7a05-4b52-a581-655af1d3a8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:28.102912 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af76e73-7a05-4b52-a581-655af1d3a8c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:28.103804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af76e73-7a05-4b52-a581-655af1d3a8c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:28.106078 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af76e73-7a05-4b52-a581-655af1d3a8c1 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:28.139769 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1151/2324] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:28 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:28.143583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde82b10-56ca-4cc8-ba72-9d1b7e20fcb2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:28.154750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde82b10-56ca-4cc8-ba72-9d1b7e20fcb2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:28.216298 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94851525-d4cd-408e-a022-276902f9635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:28.217118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94851525-d4cd-408e-a022-276902f9635f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:28.217473 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94851525-d4cd-408e-a022-276902f9635f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:28.217827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94851525-d4cd-408e-a022-276902f9635f admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:28.218593 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94851525-d4cd-408e-a022-276902f9635f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:28.220642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94851525-d4cd-408e-a022-276902f9635f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:28.245149 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1174/2325] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:28 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:28.246685 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af76e73-7a05-4b52-a581-655af1d3a8c1 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:28.257692 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af76e73-7a05-4b52-a581-655af1d3a8c1 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:28.268445 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab9ea3-b952-4b83-ac42-600d932dcc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:28.269191 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab9ea3-b952-4b83-ac42-600d932dcc89 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:28.269478 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab9ea3-b952-4b83-ac42-600d932dcc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:28.269755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab9ea3-b952-4b83-ac42-600d932dcc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:28.270497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab9ea3-b952-4b83-ac42-600d932dcc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:28.272472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab9ea3-b952-4b83-ac42-600d932dcc89 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:28.283508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1152/2326] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:28.287746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94851525-d4cd-408e-a022-276902f9635f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:28.297792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94851525-d4cd-408e-a022-276902f9635f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:28.303821 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a9259-ba38-4528-ab74-9aae35c9db45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:28.304674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a9259-ba38-4528-ab74-9aae35c9db45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:28.304956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a9259-ba38-4528-ab74-9aae35c9db45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:28.305270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a9259-ba38-4528-ab74-9aae35c9db45 admin admin] PATH_INFO: `/v3/projects/c55adf09fe3e48468a0317be42fe770a/users/4b6f071562404411a0c6a6e9907198f1/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:28.323153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a9259-ba38-4528-ab74-9aae35c9db45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c55adf09fe3e48468a0317be42fe770a, user_id=4b6f071562404411a0c6a6e9907198f1, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:28.326063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a9259-ba38-4528-ab74-9aae35c9db45 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:28.338894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1175/2327] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:28 2022] PUT /identity/v3/projects/c55adf09fe3e48468a0317be42fe770a/users/4b6f071562404411a0c6a6e9907198f1/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:28.342852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab9ea3-b952-4b83-ac42-600d932dcc89 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:28.353425 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab9ea3-b952-4b83-ac42-600d932dcc89 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:28.407840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6ce6d-3795-4bce-b95a-0788bfb2a36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:28.408513 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6ce6d-3795-4bce-b95a-0788bfb2a36e admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:28.408798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6ce6d-3795-4bce-b95a-0788bfb2a36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:28.409118 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6ce6d-3795-4bce-b95a-0788bfb2a36e admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:28.409852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6ce6d-3795-4bce-b95a-0788bfb2a36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:28.411979 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6ce6d-3795-4bce-b95a-0788bfb2a36e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:28.421977 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1153/2328] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:28.426079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a9259-ba38-4528-ab74-9aae35c9db45 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:28.437882 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a9259-ba38-4528-ab74-9aae35c9db45 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:28.442797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fde286-4733-4356-b7bc-ef1098224ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:28.443711 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fde286-4733-4356-b7bc-ef1098224ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:28.444020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fde286-4733-4356-b7bc-ef1098224ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:28.444313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fde286-4733-4356-b7bc-ef1098224ecc admin admin] PATH_INFO: `/v3/projects/c55adf09fe3e48468a0317be42fe770a/users/4b6f071562404411a0c6a6e9907198f1/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:28.446384 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fde286-4733-4356-b7bc-ef1098224ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c55adf09fe3e48468a0317be42fe770a, user_id=4b6f071562404411a0c6a6e9907198f1, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:28.449240 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fde286-4733-4356-b7bc-ef1098224ecc admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:28.461115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1176/2329] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:28 2022] PUT /identity/v3/projects/c55adf09fe3e48468a0317be42fe770a/users/4b6f071562404411a0c6a6e9907198f1/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:29.134530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638e5e-9fdf-43e8-9037-a2e16f467b8d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:29.134821 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638e5e-9fdf-43e8-9037-a2e16f467b8d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:29.135352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638e5e-9fdf-43e8-9037-a2e16f467b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:29.167882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-d0638e5e-9fdf-43e8-9037-a2e16f467b8d None None] MFA Rules not processed for user `7c4fb8aded0e4f62a7e67e9bd23b81b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:29.169820 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d0638e5e-9fdf-43e8-9037-a2e16f467b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:29.302590 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1154/2330] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:32.946636 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1414b-2481-4b7f-8ca4-4118dd286718 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:32.947704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1414b-2481-4b7f-8ca4-4118dd286718 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:32.948202 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1414b-2481-4b7f-8ca4-4118dd286718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:33.000911 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-aea1414b-2481-4b7f-8ca4-4118dd286718 None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:33.002583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-aea1414b-2481-4b7f-8ca4-4118dd286718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:33.107937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1177/2331] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:29:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:33.175993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638e5e-9fdf-43e8-9037-a2e16f467b8d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:33.179019 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d0638e5e-9fdf-43e8-9037-a2e16f467b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:33.358086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638e5e-9fdf-43e8-9037-a2e16f467b8d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:33.375606 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050a668-eeae-453c-8916-608f158df52b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:33.376756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050a668-eeae-453c-8916-608f158df52b service swift] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:33.377312 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050a668-eeae-453c-8916-608f158df52b service swift] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:33.377986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050a668-eeae-453c-8916-608f158df52b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:33.396387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050a668-eeae-453c-8916-608f158df52b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:33.400096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050a668-eeae-453c-8916-608f158df52b service swift] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:33.410254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1155/2332] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:29:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 20:29:34.757374 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0334d30-3595-468a-9263-354f5576ff67 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:34.757931 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0334d30-3595-468a-9263-354f5576ff67 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:34.758016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0334d30-3595-468a-9263-354f5576ff67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:34.853842 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e0334d30-3595-468a-9263-354f5576ff67 None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:34.858624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e0334d30-3595-468a-9263-354f5576ff67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:34.886634 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1178/2333] 10.222.0.61 () {58 vars in 967 bytes} [Tue May 10 20:29:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:34.901009 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050a668-eeae-453c-8916-608f158df52b service swift] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:34.921324 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050a668-eeae-453c-8916-608f158df52b service swift] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:34.953458 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed73c60-8aa5-4c6f-acd2-4a928af3a636 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:34.955630 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed73c60-8aa5-4c6f-acd2-4a928af3a636 service swift] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:34.956095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed73c60-8aa5-4c6f-acd2-4a928af3a636 service swift] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:34.956802 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed73c60-8aa5-4c6f-acd2-4a928af3a636 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:35.001639 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed73c60-8aa5-4c6f-acd2-4a928af3a636 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:35.001639 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed73c60-8aa5-4c6f-acd2-4a928af3a636 service swift] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:35.033240 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1156/2334] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:29:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:29:35.464907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03510c1-e564-42d6-902b-a5d562a633ec None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:35.465512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03510c1-e564-42d6-902b-a5d562a633ec None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:35.465990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03510c1-e564-42d6-902b-a5d562a633ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:35.518364 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b03510c1-e564-42d6-902b-a5d562a633ec None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:35.523462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b03510c1-e564-42d6-902b-a5d562a633ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:35.551087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1179/2335] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:29:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:35.570954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed73c60-8aa5-4c6f-acd2-4a928af3a636 service swift] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:35.592484 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed73c60-8aa5-4c6f-acd2-4a928af3a636 service swift] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:35.601817 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b6c69-ec18-4cf4-b642-d717667430d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:35.602738 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6c69-ec18-4cf4-b642-d717667430d2 service swift] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:35.603262 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6c69-ec18-4cf4-b642-d717667430d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:35.603813 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b6c69-ec18-4cf4-b642-d717667430d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:35.635502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b6c69-ec18-4cf4-b642-d717667430d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:35.637132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b6c69-ec18-4cf4-b642-d717667430d2 service swift] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:35.651920 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1157/2336] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:29:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:29:36.235051 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5204-f1df-4f1c-a9c0-2cd543cbdc7a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:36.235966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5204-f1df-4f1c-a9c0-2cd543cbdc7a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:36.236255 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f5204-f1df-4f1c-a9c0-2cd543cbdc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:36.264572 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-271f5204-f1df-4f1c-a9c0-2cd543cbdc7a None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:36.266828 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-271f5204-f1df-4f1c-a9c0-2cd543cbdc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:36.306165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1180/2337] 10.222.0.61 () {58 vars in 967 bytes} [Tue May 10 20:29:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:36.306652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b6c69-ec18-4cf4-b642-d717667430d2 service swift] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:36.322189 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b6c69-ec18-4cf4-b642-d717667430d2 service swift] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:36.330043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2cda2-c93c-4a7b-8911-d4c06b802b90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:36.330984 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2cda2-c93c-4a7b-8911-d4c06b802b90 service swift] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:36.332056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2cda2-c93c-4a7b-8911-d4c06b802b90 service swift] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:36.332538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2cda2-c93c-4a7b-8911-d4c06b802b90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:36.345786 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2cda2-c93c-4a7b-8911-d4c06b802b90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:36.349547 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2cda2-c93c-4a7b-8911-d4c06b802b90 service swift] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:36.362804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1158/2338] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:29:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 20:29:38.678243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bbee8-34bc-4e43-8ceb-30cca3183f12 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:38.678785 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bbee8-34bc-4e43-8ceb-30cca3183f12 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:38.678785 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bbee8-34bc-4e43-8ceb-30cca3183f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:38.711514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-746bbee8-34bc-4e43-8ceb-30cca3183f12 None None] MFA Rules not processed for user `4b6f071562404411a0c6a6e9907198f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:38.713031 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-746bbee8-34bc-4e43-8ceb-30cca3183f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:38.793787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1181/2339] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:38.806569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2cda2-c93c-4a7b-8911-d4c06b802b90 service swift] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:38.809029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-99c2cda2-c93c-4a7b-8911-d4c06b802b90 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:38.876823 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2cda2-c93c-4a7b-8911-d4c06b802b90 service swift] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:38.881505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a069a-115c-4cb1-9d9b-68bda779459b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f59e7ae8da841dc809355fa8e4be488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:38.882064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a069a-115c-4cb1-9d9b-68bda779459b service glance] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:38.882350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a069a-115c-4cb1-9d9b-68bda779459b service glance] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:38.882628 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a069a-115c-4cb1-9d9b-68bda779459b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:38.954229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a069a-115c-4cb1-9d9b-68bda779459b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:38.956145 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a069a-115c-4cb1-9d9b-68bda779459b service glance] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:38.971505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1159/2340] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:29:39.134004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09f0a2-4f23-4067-bc72-814440a831f2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:39.134293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09f0a2-4f23-4067-bc72-814440a831f2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:39.134768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09f0a2-4f23-4067-bc72-814440a831f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:39.170520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9e09f0a2-4f23-4067-bc72-814440a831f2 None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:39.172001 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9e09f0a2-4f23-4067-bc72-814440a831f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:39.180886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1182/2341] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:29:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:39.196819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a069a-115c-4cb1-9d9b-68bda779459b service glance] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:39.210836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a069a-115c-4cb1-9d9b-68bda779459b service glance] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:39.218803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d267e9-db6f-4b4a-8034-b55220c1935b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:39.219783 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d267e9-db6f-4b4a-8034-b55220c1935b service swift] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:39.220296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d267e9-db6f-4b4a-8034-b55220c1935b service swift] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:39.220781 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d267e9-db6f-4b4a-8034-b55220c1935b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:39.231274 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d267e9-db6f-4b4a-8034-b55220c1935b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:39.233195 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d267e9-db6f-4b4a-8034-b55220c1935b service swift] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:39.248597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1160/2342] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:29:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:29:39.588101 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09f0a2-4f23-4067-bc72-814440a831f2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:39.590032 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9e09f0a2-4f23-4067-bc72-814440a831f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:39.759026 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09f0a2-4f23-4067-bc72-814440a831f2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:39.766816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07749f-6fd8-491c-ac42-9a89e613dcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:39.768101 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07749f-6fd8-491c-ac42-9a89e613dcf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:39.768663 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07749f-6fd8-491c-ac42-9a89e613dcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:39.769244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07749f-6fd8-491c-ac42-9a89e613dcf1 admin admin] PATH_INFO: `/v3/users/509c75788fdc46e6aa15096f8a43071c` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:39.771160 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07749f-6fd8-491c-ac42-9a89e613dcf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=509c75788fdc46e6aa15096f8a43071c)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:39.773795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07749f-6fd8-491c-ac42-9a89e613dcf1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:39.855612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8e07749f-6fd8-491c-ac42-9a89e613dcf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '509c75788fdc46e6aa15096f8a43071c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:39.870789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8e07749f-6fd8-491c-ac42-9a89e613dcf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '509c75788fdc46e6aa15096f8a43071c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:39.884061 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8e07749f-6fd8-491c-ac42-9a89e613dcf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '509c75788fdc46e6aa15096f8a43071c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:39.885645 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8e07749f-6fd8-491c-ac42-9a89e613dcf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '509c75788fdc46e6aa15096f8a43071c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:39.912497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8e07749f-6fd8-491c-ac42-9a89e613dcf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '509c75788fdc46e6aa15096f8a43071c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:39.926261 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1183/2343] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:39 2022] DELETE /identity/v3/users/509c75788fdc46e6aa15096f8a43071c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:39.930827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4ad92-1609-4550-9242-361d0641909b None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:39.931344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4ad92-1609-4550-9242-361d0641909b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:39.931344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4ad92-1609-4550-9242-361d0641909b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:39.967481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-81d4ad92-1609-4550-9242-361d0641909b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:39.969219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-81d4ad92-1609-4550-9242-361d0641909b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:40.124271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1161/2344] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:40.149890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07749f-6fd8-491c-ac42-9a89e613dcf1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:40.153781 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8e07749f-6fd8-491c-ac42-9a89e613dcf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:40.352857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07749f-6fd8-491c-ac42-9a89e613dcf1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:40.364003 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69f87b-a52a-45e5-aca8-b80724141b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:40.365311 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69f87b-a52a-45e5-aca8-b80724141b33 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:40.365781 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69f87b-a52a-45e5-aca8-b80724141b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:40.366206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69f87b-a52a-45e5-aca8-b80724141b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:40.388570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69f87b-a52a-45e5-aca8-b80724141b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:40.391008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69f87b-a52a-45e5-aca8-b80724141b33 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:40.415428 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1184/2345] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:40.813682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4ad92-1609-4550-9242-361d0641909b None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:40.815200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-81d4ad92-1609-4550-9242-361d0641909b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:40.843589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4ad92-1609-4550-9242-361d0641909b None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:40.857286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:40.859239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:40.859744 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:40.860174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] PATH_INFO: `/v3/projects/00d5dc630aa047e2b28547fb11db324f` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:40.865485 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d5dc630aa047e2b28547fb11db324f)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:40.868324 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:40.954783 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d5dc630aa047e2b28547fb11db324f', 'request_id': 'req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:40.969762 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d5dc630aa047e2b28547fb11db324f', 'request_id': 'req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:40.978445 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d5dc630aa047e2b28547fb11db324f', 'request_id': 'req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:40.994006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] The token cache is being invalidate because project 00d5dc630aa047e2b28547fb11db324f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:40.994537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:40.995437 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:40.997592 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1162/2346] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:40 2022] DELETE /identity/v3/projects/00d5dc630aa047e2b28547fb11db324f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:41.661935 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69f87b-a52a-45e5-aca8-b80724141b33 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:41.663403 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0a69f87b-a52a-45e5-aca8-b80724141b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:41.697982 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69f87b-a52a-45e5-aca8-b80724141b33 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:41.845887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb59d8-a25b-4c85-baf9-c988039e3c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:41.847054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb59d8-a25b-4c85-baf9-c988039e3c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:41.847424 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb59d8-a25b-4c85-baf9-c988039e3c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:41.847820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb59d8-a25b-4c85-baf9-c988039e3c89 admin admin] PATH_INFO: `/v3/users/ff740c982d9f4e3494a624195a6b64cf` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:41.850443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb59d8-a25b-4c85-baf9-c988039e3c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff740c982d9f4e3494a624195a6b64cf)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:41.855737 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb59d8-a25b-4c85-baf9-c988039e3c89 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:42.013234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f1eb59d8-a25b-4c85-baf9-c988039e3c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff740c982d9f4e3494a624195a6b64cf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:42.050533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f1eb59d8-a25b-4c85-baf9-c988039e3c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff740c982d9f4e3494a624195a6b64cf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:42.082000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f1eb59d8-a25b-4c85-baf9-c988039e3c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff740c982d9f4e3494a624195a6b64cf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:42.083381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f1eb59d8-a25b-4c85-baf9-c988039e3c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff740c982d9f4e3494a624195a6b64cf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:42.122507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f1eb59d8-a25b-4c85-baf9-c988039e3c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff740c982d9f4e3494a624195a6b64cf'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:42.136467 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1185/2347] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:41 2022] DELETE /identity/v3/users/ff740c982d9f4e3494a624195a6b64cf => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:42.627209 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:42.636503 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:42.678272 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c40a-eaa4-4f2f-b9fd-2aab307b52af admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:42.815887 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:42.823391 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:42.824054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:42.824669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] PATH_INFO: `/v3/projects/aea0bd6f268f4a7fa88cfb7a0066bfd8` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:42.826434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea0bd6f268f4a7fa88cfb7a0066bfd8)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:42.828621 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:42.945856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea0bd6f268f4a7fa88cfb7a0066bfd8', 'request_id': 'req-74b9aa39-6d54-466d-996b-c30fca1065ff'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:42.964395 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea0bd6f268f4a7fa88cfb7a0066bfd8', 'request_id': 'req-74b9aa39-6d54-466d-996b-c30fca1065ff'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:42.995690 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea0bd6f268f4a7fa88cfb7a0066bfd8', 'request_id': 'req-74b9aa39-6d54-466d-996b-c30fca1065ff'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:43.019666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] The token cache is being invalidate because project aea0bd6f268f4a7fa88cfb7a0066bfd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:43.019964 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:43.022964 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:43.028213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1163/2348] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:42 2022] DELETE /identity/v3/projects/aea0bd6f268f4a7fa88cfb7a0066bfd8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:43.031663 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb59d8-a25b-4c85-baf9-c988039e3c89 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:43.034409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f1eb59d8-a25b-4c85-baf9-c988039e3c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:43.058964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb59d8-a25b-4c85-baf9-c988039e3c89 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:43.177602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acd4bd-0971-4fef-8067-586f93fe7611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:43.179763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acd4bd-0971-4fef-8067-586f93fe7611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:43.180058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acd4bd-0971-4fef-8067-586f93fe7611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:43.180342 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acd4bd-0971-4fef-8067-586f93fe7611 admin admin] PATH_INFO: `/v3/users/95bb81143a5f4f2ca0f8670bdb2bd0ab` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:43.181734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acd4bd-0971-4fef-8067-586f93fe7611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95bb81143a5f4f2ca0f8670bdb2bd0ab)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:43.184132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acd4bd-0971-4fef-8067-586f93fe7611 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:43.249377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13acd4bd-0971-4fef-8067-586f93fe7611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95bb81143a5f4f2ca0f8670bdb2bd0ab'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:43.267449 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13acd4bd-0971-4fef-8067-586f93fe7611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95bb81143a5f4f2ca0f8670bdb2bd0ab'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:43.275808 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13acd4bd-0971-4fef-8067-586f93fe7611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95bb81143a5f4f2ca0f8670bdb2bd0ab'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:43.276609 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13acd4bd-0971-4fef-8067-586f93fe7611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95bb81143a5f4f2ca0f8670bdb2bd0ab'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:43.294165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-13acd4bd-0971-4fef-8067-586f93fe7611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95bb81143a5f4f2ca0f8670bdb2bd0ab'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:43.302218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1186/2349] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:43 2022] DELETE /identity/v3/users/95bb81143a5f4f2ca0f8670bdb2bd0ab => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:43.602759 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:43.605292 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:43.651874 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9aa39-6d54-466d-996b-c30fca1065ff admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:43.840082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc176e-d5d7-4211-9461-e19fb250ff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:43.847606 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc176e-d5d7-4211-9461-e19fb250ff95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:43.848885 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc176e-d5d7-4211-9461-e19fb250ff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:43.849793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc176e-d5d7-4211-9461-e19fb250ff95 admin admin] PATH_INFO: `/v3/projects/f9c319ba50a64fa68161a5b025915ed1` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:43.851385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc176e-d5d7-4211-9461-e19fb250ff95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c319ba50a64fa68161a5b025915ed1)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:43.853634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc176e-d5d7-4211-9461-e19fb250ff95 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:43.967859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-97dc176e-d5d7-4211-9461-e19fb250ff95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c319ba50a64fa68161a5b025915ed1', 'request_id': 'req-97dc176e-d5d7-4211-9461-e19fb250ff95'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:43.991373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-97dc176e-d5d7-4211-9461-e19fb250ff95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c319ba50a64fa68161a5b025915ed1', 'request_id': 'req-97dc176e-d5d7-4211-9461-e19fb250ff95'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:44.008193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-97dc176e-d5d7-4211-9461-e19fb250ff95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c319ba50a64fa68161a5b025915ed1', 'request_id': 'req-97dc176e-d5d7-4211-9461-e19fb250ff95'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:44.032099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-97dc176e-d5d7-4211-9461-e19fb250ff95 admin admin] The token cache is being invalidate because project f9c319ba50a64fa68161a5b025915ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:44.032099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-97dc176e-d5d7-4211-9461-e19fb250ff95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:44.032099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-97dc176e-d5d7-4211-9461-e19fb250ff95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:44.032099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1164/2350] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:43 2022] DELETE /identity/v3/projects/f9c319ba50a64fa68161a5b025915ed1 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:44.035944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fdb5b-9c18-4bec-b8f2-43ae6ff8251b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:44.036462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fdb5b-9c18-4bec-b8f2-43ae6ff8251b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:44.036462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fdb5b-9c18-4bec-b8f2-43ae6ff8251b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:44.159970 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a41fdb5b-9c18-4bec-b8f2-43ae6ff8251b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:44.163624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a41fdb5b-9c18-4bec-b8f2-43ae6ff8251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:44.274978 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1187/2351] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:44.282047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990cc6d-9a99-4757-aa1b-c9c11d0b81c2 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:44.282403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990cc6d-9a99-4757-aa1b-c9c11d0b81c2 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:44.282662 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990cc6d-9a99-4757-aa1b-c9c11d0b81c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:44.319661 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-c990cc6d-9a99-4757-aa1b-c9c11d0b81c2 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:44.320185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c990cc6d-9a99-4757-aa1b-c9c11d0b81c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:44.354250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1165/2352] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:44.354926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fdb5b-9c18-4bec-b8f2-43ae6ff8251b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:44.371127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fdb5b-9c18-4bec-b8f2-43ae6ff8251b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:44.383033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ecd95-67de-4af6-bd91-88c966e0f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:44.385125 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecd95-67de-4af6-bd91-88c966e0f591 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:44.385413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecd95-67de-4af6-bd91-88c966e0f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:44.385689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecd95-67de-4af6-bd91-88c966e0f591 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:44.387568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ecd95-67de-4af6-bd91-88c966e0f591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:29:44.387890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ecd95-67de-4af6-bd91-88c966e0f591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:44.391794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ecd95-67de-4af6-bd91-88c966e0f591 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:44.421457 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1188/2353] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:29:44.426244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990cc6d-9a99-4757-aa1b-c9c11d0b81c2 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:44.442537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990cc6d-9a99-4757-aa1b-c9c11d0b81c2 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:44.458249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4cad8-ea52-4b5d-a15b-8b0a0f73db2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:44.459052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4cad8-ea52-4b5d-a15b-8b0a0f73db2d admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:44.459476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4cad8-ea52-4b5d-a15b-8b0a0f73db2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:44.459815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4cad8-ea52-4b5d-a15b-8b0a0f73db2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:44.460668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4cad8-ea52-4b5d-a15b-8b0a0f73db2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:44.462865 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4cad8-ea52-4b5d-a15b-8b0a0f73db2d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:44.538842 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1166/2354] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:29:44 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:44.542502 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ecd95-67de-4af6-bd91-88c966e0f591 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:44.564717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ecd95-67de-4af6-bd91-88c966e0f591 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:44.684802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13c57b-5151-47e8-a619-0ba763973be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:44.685576 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13c57b-5151-47e8-a619-0ba763973be5 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:44.685867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13c57b-5151-47e8-a619-0ba763973be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:44.686194 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13c57b-5151-47e8-a619-0ba763973be5 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:44.687172 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13c57b-5151-47e8-a619-0ba763973be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:44.689002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13c57b-5151-47e8-a619-0ba763973be5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:44.776400 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1189/2355] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:29:44 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:29:44.778317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4cad8-ea52-4b5d-a15b-8b0a0f73db2d admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:44.795076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4cad8-ea52-4b5d-a15b-8b0a0f73db2d admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:44.818170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a76c6-3667-41ab-9537-6d14066904fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:44.818855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a76c6-3667-41ab-9537-6d14066904fc admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:44.819216 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a76c6-3667-41ab-9537-6d14066904fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:44.819451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a76c6-3667-41ab-9537-6d14066904fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:44.820180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a76c6-3667-41ab-9537-6d14066904fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:44.821843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a76c6-3667-41ab-9537-6d14066904fc admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:44.853031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1167/2356] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:44.857072 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13c57b-5151-47e8-a619-0ba763973be5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:44.877106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13c57b-5151-47e8-a619-0ba763973be5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:44.886214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2b302-b334-49bc-9cc0-31b2c5e537e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:44.888550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2b302-b334-49bc-9cc0-31b2c5e537e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:44.888550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2b302-b334-49bc-9cc0-31b2c5e537e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:44.888550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2b302-b334-49bc-9cc0-31b2c5e537e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:44.888550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2b302-b334-49bc-9cc0-31b2c5e537e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:44.890015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2b302-b334-49bc-9cc0-31b2c5e537e6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:44.931976 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1190/2357] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:29:44.938123 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a76c6-3667-41ab-9537-6d14066904fc admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:44.953923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a76c6-3667-41ab-9537-6d14066904fc admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:44.963130 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38a351-c0f8-4021-b579-e809b5c97a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:44.964063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38a351-c0f8-4021-b579-e809b5c97a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:44.964349 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38a351-c0f8-4021-b579-e809b5c97a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:44.964631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38a351-c0f8-4021-b579-e809b5c97a84 admin admin] PATH_INFO: `/v3/projects/adcbc088ded54e06866087e96b4cb748/users/1b4c72b75b4445ee8d430bcfd2efa360/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:44.994888 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38a351-c0f8-4021-b579-e809b5c97a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adcbc088ded54e06866087e96b4cb748, user_id=1b4c72b75b4445ee8d430bcfd2efa360, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:45.007193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38a351-c0f8-4021-b579-e809b5c97a84 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:45.037241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1168/2358] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:29:44 2022] PUT /identity/v3/projects/adcbc088ded54e06866087e96b4cb748/users/1b4c72b75b4445ee8d430bcfd2efa360/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:45.049388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db709cf-5aff-4aad-ac0a-00d2e416502a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:45.053232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db709cf-5aff-4aad-ac0a-00d2e416502a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:45.054501 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db709cf-5aff-4aad-ac0a-00d2e416502a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:45.111243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0db709cf-5aff-4aad-ac0a-00d2e416502a None None] MFA Rules not processed for user `1b4c72b75b4445ee8d430bcfd2efa360`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:45.112463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0db709cf-5aff-4aad-ac0a-00d2e416502a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:45.238268 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1191/2359] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:45.249196 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38a351-c0f8-4021-b579-e809b5c97a84 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:45.251540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9a38a351-c0f8-4021-b579-e809b5c97a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:45.354769 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38a351-c0f8-4021-b579-e809b5c97a84 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:45.359542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a530209-9a35-489a-9756-ac95392d008f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:45.360255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a530209-9a35-489a-9756-ac95392d008f service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:45.360549 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a530209-9a35-489a-9756-ac95392d008f service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:45.360831 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a530209-9a35-489a-9756-ac95392d008f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:45.374149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a530209-9a35-489a-9756-ac95392d008f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:45.378363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a530209-9a35-489a-9756-ac95392d008f service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:45.399428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1169/2360] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:49.419751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90ae3c-f5bc-4c66-abd9-9db9f659e4b2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:49.420272 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90ae3c-f5bc-4c66-abd9-9db9f659e4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:49.420387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90ae3c-f5bc-4c66-abd9-9db9f659e4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:49.464615 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1b90ae3c-f5bc-4c66-abd9-9db9f659e4b2 None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:49.466321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1b90ae3c-f5bc-4c66-abd9-9db9f659e4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:49.622675 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1192/2361] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:29:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:49.663002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a530209-9a35-489a-9756-ac95392d008f service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:49.664724 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7a530209-9a35-489a-9756-ac95392d008f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:49.751881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a530209-9a35-489a-9756-ac95392d008f service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:49.759356 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c4007-785d-4e5e-8295-bde2b8d3c518 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:49.760149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c4007-785d-4e5e-8295-bde2b8d3c518 service swift] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:49.760705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c4007-785d-4e5e-8295-bde2b8d3c518 service swift] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:49.761012 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c4007-785d-4e5e-8295-bde2b8d3c518 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:49.772451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c4007-785d-4e5e-8295-bde2b8d3c518 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:49.774248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c4007-785d-4e5e-8295-bde2b8d3c518 service swift] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:49.784661 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1170/2362] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:29:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:29:51.183458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90ae3c-f5bc-4c66-abd9-9db9f659e4b2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:51.326455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90ae3c-f5bc-4c66-abd9-9db9f659e4b2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:51.338472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86357db5-d31d-4b9f-b4fb-688cdf4d5d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:51.339679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357db5-d31d-4b9f-b4fb-688cdf4d5d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:51.340133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357db5-d31d-4b9f-b4fb-688cdf4d5d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:51.340577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357db5-d31d-4b9f-b4fb-688cdf4d5d54 admin admin] PATH_INFO: `/v3/users/1b4c72b75b4445ee8d430bcfd2efa360` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:51.342752 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86357db5-d31d-4b9f-b4fb-688cdf4d5d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b4c72b75b4445ee8d430bcfd2efa360)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:51.344933 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86357db5-d31d-4b9f-b4fb-688cdf4d5d54 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:51.451007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-86357db5-d31d-4b9f-b4fb-688cdf4d5d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b4c72b75b4445ee8d430bcfd2efa360'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:51.463599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-86357db5-d31d-4b9f-b4fb-688cdf4d5d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b4c72b75b4445ee8d430bcfd2efa360'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:51.470618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-86357db5-d31d-4b9f-b4fb-688cdf4d5d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b4c72b75b4445ee8d430bcfd2efa360'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:51.471389 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-86357db5-d31d-4b9f-b4fb-688cdf4d5d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b4c72b75b4445ee8d430bcfd2efa360'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:51.491318 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-86357db5-d31d-4b9f-b4fb-688cdf4d5d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b4c72b75b4445ee8d430bcfd2efa360'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:51.498636 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1193/2363] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:29:51 2022] DELETE /identity/v3/users/1b4c72b75b4445ee8d430bcfd2efa360 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:29:51.502907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f5929-152f-41db-ae41-72e4d0308cb4 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:51.503504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f5929-152f-41db-ae41-72e4d0308cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:51.503504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f5929-152f-41db-ae41-72e4d0308cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:51.525517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-df6f5929-152f-41db-ae41-72e4d0308cb4 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:51.527620 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-df6f5929-152f-41db-ae41-72e4d0308cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:51.624361 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1171/2364] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:51.625757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86357db5-d31d-4b9f-b4fb-688cdf4d5d54 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:51.627350 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-86357db5-d31d-4b9f-b4fb-688cdf4d5d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:51.789161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86357db5-d31d-4b9f-b4fb-688cdf4d5d54 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:51.793051 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe146f-39c3-4619-a05e-e873d4ae8962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:51.793833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe146f-39c3-4619-a05e-e873d4ae8962 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:51.794215 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe146f-39c3-4619-a05e-e873d4ae8962 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:51.794589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe146f-39c3-4619-a05e-e873d4ae8962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:51.837981 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe146f-39c3-4619-a05e-e873d4ae8962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:51.841865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe146f-39c3-4619-a05e-e873d4ae8962 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:51.880244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1194/2365] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:29:52.566488 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7bd62-b8eb-401f-93bf-82a4f850e427 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:52.567901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7bd62-b8eb-401f-93bf-82a4f850e427 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:52.568361 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7bd62-b8eb-401f-93bf-82a4f850e427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:52.607913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-0eb7bd62-b8eb-401f-93bf-82a4f850e427 None None] MFA Rules not processed for user `50d5a87e4d094287bb543721c9c9909d`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:52.609404 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0eb7bd62-b8eb-401f-93bf-82a4f850e427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:52.723940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1172/2366] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:29:52.725683 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe146f-39c3-4619-a05e-e873d4ae8962 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:29:52.734795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5ffe146f-39c3-4619-a05e-e873d4ae8962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:52.788540 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe146f-39c3-4619-a05e-e873d4ae8962 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:29:52.823267 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63765228-1f7c-474b-a89b-76b1a572c599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:29:52.824213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63765228-1f7c-474b-a89b-76b1a572c599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:52.824533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63765228-1f7c-474b-a89b-76b1a572c599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:52.824817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63765228-1f7c-474b-a89b-76b1a572c599 admin admin] PATH_INFO: `/v3/projects/adcbc088ded54e06866087e96b4cb748` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:52.829635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63765228-1f7c-474b-a89b-76b1a572c599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adcbc088ded54e06866087e96b4cb748)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:29:52.833493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63765228-1f7c-474b-a89b-76b1a572c599 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:29:52.925797 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-63765228-1f7c-474b-a89b-76b1a572c599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adcbc088ded54e06866087e96b4cb748', 'request_id': 'req-63765228-1f7c-474b-a89b-76b1a572c599'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:52.931320 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-63765228-1f7c-474b-a89b-76b1a572c599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adcbc088ded54e06866087e96b4cb748', 'request_id': 'req-63765228-1f7c-474b-a89b-76b1a572c599'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:52.938442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-63765228-1f7c-474b-a89b-76b1a572c599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adcbc088ded54e06866087e96b4cb748', 'request_id': 'req-63765228-1f7c-474b-a89b-76b1a572c599'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:52.954455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-63765228-1f7c-474b-a89b-76b1a572c599 admin admin] The token cache is being invalidate because project adcbc088ded54e06866087e96b4cb748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:29:52.954736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-63765228-1f7c-474b-a89b-76b1a572c599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:52.955560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-63765228-1f7c-474b-a89b-76b1a572c599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:29:52.958297 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1195/2367] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:29:52 2022] DELETE /identity/v3/projects/adcbc088ded54e06866087e96b4cb748 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:29:56.586030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc7dc7-af13-4068-8337-89d06a8189a5 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:29:56.586615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc7dc7-af13-4068-8337-89d06a8189a5 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:29:56.586615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc7dc7-af13-4068-8337-89d06a8189a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:29:56.644034 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e6cc7dc7-af13-4068-8337-89d06a8189a5 None None] MFA Rules not processed for user `df3cf8a2f7c54b80aac61d6ca59672b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:29:56.648696 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e6cc7dc7-af13-4068-8337-89d06a8189a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:29:56.807389 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1173/2368] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:29:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:30:09.720461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820a11e-911e-43ba-b5cd-a175f62ca4b9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:09.721819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820a11e-911e-43ba-b5cd-a175f62ca4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:09.723173 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820a11e-911e-43ba-b5cd-a175f62ca4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:09.760815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5820a11e-911e-43ba-b5cd-a175f62ca4b9 None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:30:09.762627 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5820a11e-911e-43ba-b5cd-a175f62ca4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:09.863859 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1196/2369] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:30:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:30:09.877001 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc7dc7-af13-4068-8337-89d06a8189a5 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:09.879319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e6cc7dc7-af13-4068-8337-89d06a8189a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:09.967867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc7dc7-af13-4068-8337-89d06a8189a5 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:09.974153 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183239fe-667c-4761-8f61-5960a29d23a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:09.975187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183239fe-667c-4761-8f61-5960a29d23a5 service swift] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:09.975742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183239fe-667c-4761-8f61-5960a29d23a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:09.976271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183239fe-667c-4761-8f61-5960a29d23a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:09.992680 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183239fe-667c-4761-8f61-5960a29d23a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:09.994838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183239fe-667c-4761-8f61-5960a29d23a5 service swift] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:10.006795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1174/2370] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:30:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:30:14.577660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2196b57-5f35-4c0d-aa92-af146658f03f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:14.578175 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2196b57-5f35-4c0d-aa92-af146658f03f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:14.578264 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2196b57-5f35-4c0d-aa92-af146658f03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:14.605499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b2196b57-5f35-4c0d-aa92-af146658f03f None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:30:14.606872 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b2196b57-5f35-4c0d-aa92-af146658f03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:14.621551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1197/2371] 10.222.0.61 () {58 vars in 967 bytes} [Tue May 10 20:30:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:30:14.645107 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183239fe-667c-4761-8f61-5960a29d23a5 service swift] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:14.663993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183239fe-667c-4761-8f61-5960a29d23a5 service swift] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:14.670581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2496f-e103-4e9b-8fd8-0841c8dae513 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:14.671731 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2496f-e103-4e9b-8fd8-0841c8dae513 service swift] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:14.672278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2496f-e103-4e9b-8fd8-0841c8dae513 service swift] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:14.672719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2496f-e103-4e9b-8fd8-0841c8dae513 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:14.689286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2496f-e103-4e9b-8fd8-0841c8dae513 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:14.690904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2496f-e103-4e9b-8fd8-0841c8dae513 service swift] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:14.700348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1175/2372] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:30:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:30:16.954189 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2196b57-5f35-4c0d-aa92-af146658f03f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:16.955870 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b2196b57-5f35-4c0d-aa92-af146658f03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:17.054905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2196b57-5f35-4c0d-aa92-af146658f03f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:17.062843 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adafa7-ebb9-4dd8-901d-b405faabaf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:17.064293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adafa7-ebb9-4dd8-901d-b405faabaf1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:17.064823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adafa7-ebb9-4dd8-901d-b405faabaf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:17.065330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adafa7-ebb9-4dd8-901d-b405faabaf1a admin admin] PATH_INFO: `/v3/users/968e45f60cb74bd9b16b2c74801071fb` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:17.068057 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04adafa7-ebb9-4dd8-901d-b405faabaf1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=968e45f60cb74bd9b16b2c74801071fb)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:17.071079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04adafa7-ebb9-4dd8-901d-b405faabaf1a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:17.132989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-04adafa7-ebb9-4dd8-901d-b405faabaf1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968e45f60cb74bd9b16b2c74801071fb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:30:17.144784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-04adafa7-ebb9-4dd8-901d-b405faabaf1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968e45f60cb74bd9b16b2c74801071fb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:30:17.151965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-04adafa7-ebb9-4dd8-901d-b405faabaf1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968e45f60cb74bd9b16b2c74801071fb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:30:17.152771 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-04adafa7-ebb9-4dd8-901d-b405faabaf1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968e45f60cb74bd9b16b2c74801071fb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:30:17.160228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-04adafa7-ebb9-4dd8-901d-b405faabaf1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968e45f60cb74bd9b16b2c74801071fb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:30:17.167166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1198/2373] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:30:16 2022] DELETE /identity/v3/users/968e45f60cb74bd9b16b2c74801071fb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:30:17.487526 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2496f-e103-4e9b-8fd8-0841c8dae513 service swift] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:17.514900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2496f-e103-4e9b-8fd8-0841c8dae513 service swift] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:17.605405 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c58689-d97d-49b4-9737-1d8d784ec653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:17.606297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c58689-d97d-49b4-9737-1d8d784ec653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:17.606656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c58689-d97d-49b4-9737-1d8d784ec653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:17.607006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c58689-d97d-49b4-9737-1d8d784ec653 admin admin] PATH_INFO: `/v3/projects/a24528148d9444038c71b83c90aa026e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:17.608307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c58689-d97d-49b4-9737-1d8d784ec653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24528148d9444038c71b83c90aa026e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:17.610533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c58689-d97d-49b4-9737-1d8d784ec653 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:17.666901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-06c58689-d97d-49b4-9737-1d8d784ec653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24528148d9444038c71b83c90aa026e', 'request_id': 'req-06c58689-d97d-49b4-9737-1d8d784ec653'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:30:17.674571 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-06c58689-d97d-49b4-9737-1d8d784ec653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24528148d9444038c71b83c90aa026e', 'request_id': 'req-06c58689-d97d-49b4-9737-1d8d784ec653'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:30:17.682928 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-06c58689-d97d-49b4-9737-1d8d784ec653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24528148d9444038c71b83c90aa026e', 'request_id': 'req-06c58689-d97d-49b4-9737-1d8d784ec653'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:30:17.695435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-06c58689-d97d-49b4-9737-1d8d784ec653 admin admin] The token cache is being invalidate because project a24528148d9444038c71b83c90aa026e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:30:17.695811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-06c58689-d97d-49b4-9737-1d8d784ec653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:30:17.696531 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-06c58689-d97d-49b4-9737-1d8d784ec653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:30:17.698166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1176/2374] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:30:17 2022] DELETE /identity/v3/projects/a24528148d9444038c71b83c90aa026e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:30:17.703284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f61673-752e-4994-83c4-22021d9c6e69 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:17.703895 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f61673-752e-4994-83c4-22021d9c6e69 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:17.704344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f61673-752e-4994-83c4-22021d9c6e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:17.723999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-10f61673-752e-4994-83c4-22021d9c6e69 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:30:17.725244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-10f61673-752e-4994-83c4-22021d9c6e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:17.788507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1199/2375] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:30:17.796103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132116-bd37-47da-893c-4db576c792c3 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:17.796465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132116-bd37-47da-893c-4db576c792c3 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:17.797016 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31132116-bd37-47da-893c-4db576c792c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:17.823113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-31132116-bd37-47da-893c-4db576c792c3 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:30:17.824421 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-31132116-bd37-47da-893c-4db576c792c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:17.832820 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1177/2376] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:30:17.837064 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f61673-752e-4994-83c4-22021d9c6e69 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:17.848212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f61673-752e-4994-83c4-22021d9c6e69 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:17.852811 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70672a29-23de-4dbe-9557-70a45a01f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:17.853532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70672a29-23de-4dbe-9557-70a45a01f6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:17.853809 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70672a29-23de-4dbe-9557-70a45a01f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:17.854215 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70672a29-23de-4dbe-9557-70a45a01f6d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:17.854943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70672a29-23de-4dbe-9557-70a45a01f6d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:30:17.855256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70672a29-23de-4dbe-9557-70a45a01f6d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:17.857154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70672a29-23de-4dbe-9557-70a45a01f6d7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:17.873206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1200/2377] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:30:17.875540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31132116-bd37-47da-893c-4db576c792c3 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:17.885867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31132116-bd37-47da-893c-4db576c792c3 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:17.891090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61311205-fdc1-4e01-8c1d-7c622365c52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:17.891862 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61311205-fdc1-4e01-8c1d-7c622365c52f admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:17.892215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61311205-fdc1-4e01-8c1d-7c622365c52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:17.892554 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61311205-fdc1-4e01-8c1d-7c622365c52f admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:17.893383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61311205-fdc1-4e01-8c1d-7c622365c52f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:17.896892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61311205-fdc1-4e01-8c1d-7c622365c52f admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:17.929041 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1178/2378] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:30:17 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:30:17.931596 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70672a29-23de-4dbe-9557-70a45a01f6d7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:17.942023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70672a29-23de-4dbe-9557-70a45a01f6d7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:18.021561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7ebc9-06b0-44fb-b950-22366df8f0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:18.023047 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7ebc9-06b0-44fb-b950-22366df8f0a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:18.023335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7ebc9-06b0-44fb-b950-22366df8f0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:18.023645 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7ebc9-06b0-44fb-b950-22366df8f0a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:18.024348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7ebc9-06b0-44fb-b950-22366df8f0a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:18.026300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7ebc9-06b0-44fb-b950-22366df8f0a0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:18.046794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1201/2379] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:30:17 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:30:18.051262 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61311205-fdc1-4e01-8c1d-7c622365c52f admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:18.062862 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61311205-fdc1-4e01-8c1d-7c622365c52f admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:18.068353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f79c6-e039-42f0-bc0f-821950e2e9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:18.069061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f79c6-e039-42f0-bc0f-821950e2e9de admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:18.069350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f79c6-e039-42f0-bc0f-821950e2e9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:18.069630 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f79c6-e039-42f0-bc0f-821950e2e9de admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:18.070370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f79c6-e039-42f0-bc0f-821950e2e9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:18.071980 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f79c6-e039-42f0-bc0f-821950e2e9de admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:18.084457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1179/2380] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:30:18.088515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7ebc9-06b0-44fb-b950-22366df8f0a0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:18.100723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7ebc9-06b0-44fb-b950-22366df8f0a0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:18.106033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cb518-81f9-4920-a368-a7d0744d1f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:18.106705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cb518-81f9-4920-a368-a7d0744d1f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:18.106992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cb518-81f9-4920-a368-a7d0744d1f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:18.107376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cb518-81f9-4920-a368-a7d0744d1f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:18.107994 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cb518-81f9-4920-a368-a7d0744d1f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:18.110353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cb518-81f9-4920-a368-a7d0744d1f49 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:18.125004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1202/2381] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:30:18.128841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f79c6-e039-42f0-bc0f-821950e2e9de admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:18.141125 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f79c6-e039-42f0-bc0f-821950e2e9de admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:18.158639 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2321385-11e4-4046-8d76-82905f744416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:18.160151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2321385-11e4-4046-8d76-82905f744416 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:18.160438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2321385-11e4-4046-8d76-82905f744416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:18.160720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2321385-11e4-4046-8d76-82905f744416 admin admin] PATH_INFO: `/v3/projects/890bf13c89b748b3a8f9ba4106c582b3/users/17f6eadae19c4b7b8bd66e21ae302363/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:18.178203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2321385-11e4-4046-8d76-82905f744416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890bf13c89b748b3a8f9ba4106c582b3, user_id=17f6eadae19c4b7b8bd66e21ae302363, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:18.181091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2321385-11e4-4046-8d76-82905f744416 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:18.205056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1180/2382] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:30:18 2022] PUT /identity/v3/projects/890bf13c89b748b3a8f9ba4106c582b3/users/17f6eadae19c4b7b8bd66e21ae302363/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:30:18.210642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8e2a0-bfc9-42c3-bd7d-69072be53328 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:18.210937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8e2a0-bfc9-42c3-bd7d-69072be53328 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:18.211219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8e2a0-bfc9-42c3-bd7d-69072be53328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:18.240688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-88a8e2a0-bfc9-42c3-bd7d-69072be53328 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:30:18.241964 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-88a8e2a0-bfc9-42c3-bd7d-69072be53328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:18.329220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1203/2383] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:30:18.338932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2321385-11e4-4046-8d76-82905f744416 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:18.340642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b2321385-11e4-4046-8d76-82905f744416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:18.399561 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2321385-11e4-4046-8d76-82905f744416 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:18.403224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bad15-3b1d-4454-b004-41e6422c1511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:18.403869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bad15-3b1d-4454-b004-41e6422c1511 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:18.404149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bad15-3b1d-4454-b004-41e6422c1511 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:18.404420 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bad15-3b1d-4454-b004-41e6422c1511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:18.416325 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bad15-3b1d-4454-b004-41e6422c1511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:18.417795 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bad15-3b1d-4454-b004-41e6422c1511 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:18.428177 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1181/2384] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:30:20.751759 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8e2a0-bfc9-42c3-bd7d-69072be53328 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:20.755806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-88a8e2a0-bfc9-42c3-bd7d-69072be53328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:20.948021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8e2a0-bfc9-42c3-bd7d-69072be53328 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:20.966484 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7b2c3-9a7b-46b2-a149-a66249e20297 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4dc7b58c8a04b359a4a9bbab9e7b219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:20.969130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7b2c3-9a7b-46b2-a149-a66249e20297 service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:20.969411 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7b2c3-9a7b-46b2-a149-a66249e20297 service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:20.969852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7b2c3-9a7b-46b2-a149-a66249e20297 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:20.970773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc8322-d3a2-4142-a7aa-03299b0bde27 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:20.971275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc8322-d3a2-4142-a7aa-03299b0bde27 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:20.971523 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc8322-d3a2-4142-a7aa-03299b0bde27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:20.972600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a9b7b2c3-9a7b-46b2-a149-a66249e20297 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:20.996938 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7b2c3-9a7b-46b2-a149-a66249e20297 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:21.000180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7b2c3-9a7b-46b2-a149-a66249e20297 service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:21.040215 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1204/2385] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:30:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:30:21.076788 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-58dc8322-d3a2-4142-a7aa-03299b0bde27 None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:30:21.078492 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-58dc8322-d3a2-4142-a7aa-03299b0bde27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:21.257735 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1182/2386] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:30:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:30:21.271506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7b2c3-9a7b-46b2-a149-a66249e20297 service placement] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:21.277449 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a9b7b2c3-9a7b-46b2-a149-a66249e20297 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:21.482510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7b2c3-9a7b-46b2-a149-a66249e20297 service placement] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:21.494169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd81249-e179-424f-b23e-04be453e4be1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:21.495150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81249-e179-424f-b23e-04be453e4be1 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:21.495435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81249-e179-424f-b23e-04be453e4be1 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:21.495712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd81249-e179-424f-b23e-04be453e4be1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:21.517724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd81249-e179-424f-b23e-04be453e4be1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:21.520265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd81249-e179-424f-b23e-04be453e4be1 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:21.530685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1205/2387] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:30:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:30:27.844533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338a598-3bb0-48fa-8a9c-9e65b9e79c70 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:27.845268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338a598-3bb0-48fa-8a9c-9e65b9e79c70 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:27.845701 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338a598-3bb0-48fa-8a9c-9e65b9e79c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:27.912993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6338a598-3bb0-48fa-8a9c-9e65b9e79c70 None None] MFA Rules not processed for user `17f6eadae19c4b7b8bd66e21ae302363`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:30:27.914464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6338a598-3bb0-48fa-8a9c-9e65b9e79c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:28.120198 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1183/2388] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:30:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:30:28.121123 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd81249-e179-424f-b23e-04be453e4be1 service swift] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:28.135135 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd81249-e179-424f-b23e-04be453e4be1 service swift] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:28.150225 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03cd74-ac86-42e2-8d7d-73e67b1dcace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:28.154914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03cd74-ac86-42e2-8d7d-73e67b1dcace admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:28.155315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03cd74-ac86-42e2-8d7d-73e67b1dcace admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:28.155688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03cd74-ac86-42e2-8d7d-73e67b1dcace admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:28.156527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03cd74-ac86-42e2-8d7d-73e67b1dcace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:28.160954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03cd74-ac86-42e2-8d7d-73e67b1dcace admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:28.234067 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338a598-3bb0-48fa-8a9c-9e65b9e79c70 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:28.235285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1206/2389] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:30:28 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:30:28.259477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338a598-3bb0-48fa-8a9c-9e65b9e79c70 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:28.370759 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d8998-e18f-47d3-888c-3525783dcffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:28.371867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d8998-e18f-47d3-888c-3525783dcffe admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:28.372538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d8998-e18f-47d3-888c-3525783dcffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:28.373101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d8998-e18f-47d3-888c-3525783dcffe admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:28.374631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d8998-e18f-47d3-888c-3525783dcffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:28.377177 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d8998-e18f-47d3-888c-3525783dcffe admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:28.423397 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1184/2390] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:30:28 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:30:28.427898 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03cd74-ac86-42e2-8d7d-73e67b1dcace admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:28.444796 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03cd74-ac86-42e2-8d7d-73e67b1dcace admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:28.462524 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0e16a-7d6e-408b-af9a-70452f76036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:28.463216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0e16a-7d6e-408b-af9a-70452f76036d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:28.463654 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0e16a-7d6e-408b-af9a-70452f76036d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:28.463777 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0e16a-7d6e-408b-af9a-70452f76036d admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:28.467479 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0e16a-7d6e-408b-af9a-70452f76036d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:28.469196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0e16a-7d6e-408b-af9a-70452f76036d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:28.496005 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1207/2391] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:30:28.500614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d8998-e18f-47d3-888c-3525783dcffe admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:28.516244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d8998-e18f-47d3-888c-3525783dcffe admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:28.527040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55145b-16f3-48bb-b1cc-838df498d887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:28.528101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55145b-16f3-48bb-b1cc-838df498d887 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:28.528386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55145b-16f3-48bb-b1cc-838df498d887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:28.528818 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55145b-16f3-48bb-b1cc-838df498d887 admin admin] PATH_INFO: `/v3/projects/ffca25f230564ac0b861ea42271a088a/users/526cc3b8fad246aa910cead6acf7d002/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:28.552382 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55145b-16f3-48bb-b1cc-838df498d887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffca25f230564ac0b861ea42271a088a, user_id=526cc3b8fad246aa910cead6acf7d002, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:28.557579 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55145b-16f3-48bb-b1cc-838df498d887 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:28.600827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1185/2392] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:30:28 2022] PUT /identity/v3/projects/ffca25f230564ac0b861ea42271a088a/users/526cc3b8fad246aa910cead6acf7d002/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:30:28.601302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0e16a-7d6e-408b-af9a-70452f76036d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:28.608614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0e16a-7d6e-408b-af9a-70452f76036d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:28.712235 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad58825-bc11-4a96-865c-dbc628ab18e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:28.712941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad58825-bc11-4a96-865c-dbc628ab18e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:28.713258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad58825-bc11-4a96-865c-dbc628ab18e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:28.713534 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad58825-bc11-4a96-865c-dbc628ab18e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:28.714309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad58825-bc11-4a96-865c-dbc628ab18e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:28.715943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad58825-bc11-4a96-865c-dbc628ab18e6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:28.742681 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1208/2393] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:30:28.747082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55145b-16f3-48bb-b1cc-838df498d887 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:28.764730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55145b-16f3-48bb-b1cc-838df498d887 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:28.773143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b0f8c-ac2b-465c-a253-f017b5e9a67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:28.777827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b0f8c-ac2b-465c-a253-f017b5e9a67e admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:28.778132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b0f8c-ac2b-465c-a253-f017b5e9a67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:28.778419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b0f8c-ac2b-465c-a253-f017b5e9a67e admin admin] PATH_INFO: `/v3/projects/ffca25f230564ac0b861ea42271a088a/users/526cc3b8fad246aa910cead6acf7d002/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:28.783110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b0f8c-ac2b-465c-a253-f017b5e9a67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffca25f230564ac0b861ea42271a088a, user_id=526cc3b8fad246aa910cead6acf7d002, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:28.787176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b0f8c-ac2b-465c-a253-f017b5e9a67e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:28.804256 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1186/2394] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:30:28 2022] PUT /identity/v3/projects/ffca25f230564ac0b861ea42271a088a/users/526cc3b8fad246aa910cead6acf7d002/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:30:38.457157 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc643ac-2a61-4206-b781-ee5d62c23f7e None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:38.457610 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc643ac-2a61-4206-b781-ee5d62c23f7e None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:38.457610 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc643ac-2a61-4206-b781-ee5d62c23f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:38.529280 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-efc643ac-2a61-4206-b781-ee5d62c23f7e None None] MFA Rules not processed for user `526cc3b8fad246aa910cead6acf7d002`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:30:38.530518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-efc643ac-2a61-4206-b781-ee5d62c23f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:38.697028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1209/2395] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:30:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:30:38.705593 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b0f8c-ac2b-465c-a253-f017b5e9a67e admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:38.707562 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-827b0f8c-ac2b-465c-a253-f017b5e9a67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:38.915236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b0f8c-ac2b-465c-a253-f017b5e9a67e admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:38.922180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87463648-15e6-47f5-a0c7-937c7aa9df16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:38.922368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87463648-15e6-47f5-a0c7-937c7aa9df16 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:38.922573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87463648-15e6-47f5-a0c7-937c7aa9df16 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:38.922978 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87463648-15e6-47f5-a0c7-937c7aa9df16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:39.041054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87463648-15e6-47f5-a0c7-937c7aa9df16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:39.042898 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87463648-15e6-47f5-a0c7-937c7aa9df16 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:39.064514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1187/2396] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:30:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:30:47.993310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc643ac-2a61-4206-b781-ee5d62c23f7e None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:48.048900 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc643ac-2a61-4206-b781-ee5d62c23f7e None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:48.052482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2d492-9e32-4407-9bee-7fa8aaaf2337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:48.053162 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2d492-9e32-4407-9bee-7fa8aaaf2337 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:48.053448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2d492-9e32-4407-9bee-7fa8aaaf2337 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:48.053720 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2d492-9e32-4407-9bee-7fa8aaaf2337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:48.055474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1aa2d492-9e32-4407-9bee-7fa8aaaf2337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:48.117919 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2d492-9e32-4407-9bee-7fa8aaaf2337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:48.119361 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2d492-9e32-4407-9bee-7fa8aaaf2337 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:48.128894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1210/2397] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:30:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:30:49.317755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08305baa-f75c-47c3-b19f-2362900417e6 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:49.318573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08305baa-f75c-47c3-b19f-2362900417e6 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:49.318854 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08305baa-f75c-47c3-b19f-2362900417e6 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:49.320382 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1188/2398] 10.222.0.61 () {54 vars in 921 bytes} [Tue May 10 20:30:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:30:49.327016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26f1d0-7d8d-49dd-a5bc-d3a2be60b9d2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:49.327494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26f1d0-7d8d-49dd-a5bc-d3a2be60b9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:49.335843 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26f1d0-7d8d-49dd-a5bc-d3a2be60b9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:49.384426 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9c26f1d0-7d8d-49dd-a5bc-d3a2be60b9d2 None None] MFA Rules not processed for user `8c3c6fe7e21c4c1ebc01cf91c3c05c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:30:49.385981 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9c26f1d0-7d8d-49dd-a5bc-d3a2be60b9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:49.398048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1211/2399] 10.222.0.61 () {58 vars in 1018 bytes} [Tue May 10 20:30:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:30:49.414567 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08305baa-f75c-47c3-b19f-2362900417e6 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:49.416902 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-08305baa-f75c-47c3-b19f-2362900417e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:49.504002 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08305baa-f75c-47c3-b19f-2362900417e6 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:49.508808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301dc6b-f2e2-4ee0-b315-b429ebc2a4d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f59e7ae8da841dc809355fa8e4be488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:49.509683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dc6b-f2e2-4ee0-b315-b429ebc2a4d1 service glance] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:49.509966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dc6b-f2e2-4ee0-b315-b429ebc2a4d1 service glance] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:49.510244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301dc6b-f2e2-4ee0-b315-b429ebc2a4d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:49.526731 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301dc6b-f2e2-4ee0-b315-b429ebc2a4d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:49.529110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301dc6b-f2e2-4ee0-b315-b429ebc2a4d1 service glance] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:49.546717 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1189/2400] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:30:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:30:49.630446 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b001b1-cdce-4ebc-a69f-96417f0a0854 None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:49.630948 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b001b1-cdce-4ebc-a69f-96417f0a0854 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:49.631229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b001b1-cdce-4ebc-a69f-96417f0a0854 None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:49.632606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1212/2401] 10.222.0.61 () {54 vars in 921 bytes} [Tue May 10 20:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:30:49.637899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617259a0-2cf3-4769-ade1-b69a4078411d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:49.638177 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617259a0-2cf3-4769-ade1-b69a4078411d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:49.638458 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617259a0-2cf3-4769-ade1-b69a4078411d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:49.657663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-617259a0-2cf3-4769-ade1-b69a4078411d None None] MFA Rules not processed for user `e31558db83834034b7183223bbd0f84a`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:30:49.658941 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-617259a0-2cf3-4769-ade1-b69a4078411d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:49.665801 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1190/2402] 10.222.0.61 () {58 vars in 1018 bytes} [Tue May 10 20:30:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:30:49.678758 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b001b1-cdce-4ebc-a69f-96417f0a0854 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:49.683323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-12b001b1-cdce-4ebc-a69f-96417f0a0854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:49.700399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b001b1-cdce-4ebc-a69f-96417f0a0854 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:49.704052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd1fcfe-2419-4bf4-bbd5-3acb12bbe894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:49.704962 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1fcfe-2419-4bf4-bbd5-3acb12bbe894 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:49.705375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1fcfe-2419-4bf4-bbd5-3acb12bbe894 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:49.705679 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1fcfe-2419-4bf4-bbd5-3acb12bbe894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:49.713616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1fcfe-2419-4bf4-bbd5-3acb12bbe894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:49.715074 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd1fcfe-2419-4bf4-bbd5-3acb12bbe894 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:49.724425 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1213/2403] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:30:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:30:49.816719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbc76-91a5-4aad-b1e6-6770c9333dd9 None None] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:49.817040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbc76-91a5-4aad-b1e6-6770c9333dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:49.817326 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefbc76-91a5-4aad-b1e6-6770c9333dd9 None None] PATH_INFO: `/` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:49.818770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1191/2404] 10.222.0.61 () {54 vars in 921 bytes} [Tue May 10 20:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:30:49.824879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548c915-8bcd-4049-b4fa-f796c284efb0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:49.825307 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548c915-8bcd-4049-b4fa-f796c284efb0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:49.825674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548c915-8bcd-4049-b4fa-f796c284efb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:49.844216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-9548c915-8bcd-4049-b4fa-f796c284efb0 None None] MFA Rules not processed for user `8c3c6fe7e21c4c1ebc01cf91c3c05c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:30:49.846094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9548c915-8bcd-4049-b4fa-f796c284efb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:49.855635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1214/2405] 10.222.0.61 () {58 vars in 1018 bytes} [Tue May 10 20:30:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:30:49.866760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefbc76-91a5-4aad-b1e6-6770c9333dd9 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:49.878337 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefbc76-91a5-4aad-b1e6-6770c9333dd9 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:49.885665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd8e24-c13c-43e1-8d95-2bbb5e5f551d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:49.885665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd8e24-c13c-43e1-8d95-2bbb5e5f551d service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:49.885665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd8e24-c13c-43e1-8d95-2bbb5e5f551d service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:49.885665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd8e24-c13c-43e1-8d95-2bbb5e5f551d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:49.895883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd8e24-c13c-43e1-8d95-2bbb5e5f551d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:49.897633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd8e24-c13c-43e1-8d95-2bbb5e5f551d service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:49.909662 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1192/2406] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:30:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:30:55.335917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d519e5f-f175-49b8-8374-9e4e64d1cea3 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:55.336424 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d519e5f-f175-49b8-8374-9e4e64d1cea3 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:55.337463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d519e5f-f175-49b8-8374-9e4e64d1cea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:55.355586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-7d519e5f-f175-49b8-8374-9e4e64d1cea3 None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:30:55.356779 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7d519e5f-f175-49b8-8374-9e4e64d1cea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:30:55.415718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1215/2407] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:30:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:30:55.429589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd8e24-c13c-43e1-8d95-2bbb5e5f551d service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:30:55.514470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd8e24-c13c-43e1-8d95-2bbb5e5f551d service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:30:55.522877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98758bb-602b-4b3c-85bc-4475b2cc912c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:30:55.523863 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98758bb-602b-4b3c-85bc-4475b2cc912c service swift] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:30:55.524328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98758bb-602b-4b3c-85bc-4475b2cc912c service swift] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:30:55.524941 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98758bb-602b-4b3c-85bc-4475b2cc912c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:30:55.537307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98758bb-602b-4b3c-85bc-4475b2cc912c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:30:55.540096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98758bb-602b-4b3c-85bc-4475b2cc912c service swift] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:30:55.551155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1193/2408] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:30:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:31:00.398877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b354c88-be71-49cc-b1b1-f0229326c022 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:31:00.399437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b354c88-be71-49cc-b1b1-f0229326c022 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:31:00.399437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b354c88-be71-49cc-b1b1-f0229326c022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:31:00.416710 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8b354c88-be71-49cc-b1b1-f0229326c022 None None] MFA Rules not processed for user `17f6eadae19c4b7b8bd66e21ae302363`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:31:00.417926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8b354c88-be71-49cc-b1b1-f0229326c022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:31:00.424809 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1216/2409] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:31:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:31:15.411118 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f78ab0-e5b3-4bb4-996c-81ea2bb48004 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:31:15.411666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f78ab0-e5b3-4bb4-996c-81ea2bb48004 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:31:15.411666 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f78ab0-e5b3-4bb4-996c-81ea2bb48004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:31:15.428259 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e6f78ab0-e5b3-4bb4-996c-81ea2bb48004 None None] MFA Rules not processed for user `7c4fb8aded0e4f62a7e67e9bd23b81b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:31:15.429471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e6f78ab0-e5b3-4bb4-996c-81ea2bb48004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:31:15.481480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1194/2410] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:31:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:31:19.840248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0df55-6dcb-4fc9-a222-73751661e2ea None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:31:19.840789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0df55-6dcb-4fc9-a222-73751661e2ea None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:31:19.840789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0df55-6dcb-4fc9-a222-73751661e2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:31:19.858373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-01a0df55-6dcb-4fc9-a222-73751661e2ea None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:31:19.859563 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-01a0df55-6dcb-4fc9-a222-73751661e2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:31:19.867331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1217/2411] 10.222.0.61 () {58 vars in 967 bytes} [Tue May 10 20:31:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:31:19.879552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f78ab0-e5b3-4bb4-996c-81ea2bb48004 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:31:19.891519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f78ab0-e5b3-4bb4-996c-81ea2bb48004 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:31:19.896999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb8fc5-d0cc-4ca5-b615-836bba2aee8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:31:19.897638 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb8fc5-d0cc-4ca5-b615-836bba2aee8f service swift] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:31:19.897923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb8fc5-d0cc-4ca5-b615-836bba2aee8f service swift] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:31:19.898197 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb8fc5-d0cc-4ca5-b615-836bba2aee8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:31:19.907204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb8fc5-d0cc-4ca5-b615-836bba2aee8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:31:19.908770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb8fc5-d0cc-4ca5-b615-836bba2aee8f service swift] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:31:19.920853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1195/2412] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:31:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:31:26.091605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0df55-6dcb-4fc9-a222-73751661e2ea None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:31:26.100747 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0df55-6dcb-4fc9-a222-73751661e2ea None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:31:26.104633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77201d-21e5-460c-bf85-e137957ff438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:31:26.105315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77201d-21e5-460c-bf85-e137957ff438 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:31:26.105598 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77201d-21e5-460c-bf85-e137957ff438 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:31:26.105874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77201d-21e5-460c-bf85-e137957ff438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:31:26.115281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77201d-21e5-460c-bf85-e137957ff438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:31:26.116719 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77201d-21e5-460c-bf85-e137957ff438 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:31:26.126460 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1218/2413] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:31:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:32:12.969469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6be8e5-9a8d-44cd-b6b6-dc4f623e5fda None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:32:12.970005 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6be8e5-9a8d-44cd-b6b6-dc4f623e5fda None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:32:12.970290 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6be8e5-9a8d-44cd-b6b6-dc4f623e5fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:32:12.988753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-bc6be8e5-9a8d-44cd-b6b6-dc4f623e5fda None None] MFA Rules not processed for user `df3cf8a2f7c54b80aac61d6ca59672b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:32:12.990508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-bc6be8e5-9a8d-44cd-b6b6-dc4f623e5fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:13.046326 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1196/2414] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:32:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:32:14.451564 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77201d-21e5-460c-bf85-e137957ff438 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:32:14.460134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77201d-21e5-460c-bf85-e137957ff438 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:32:14.463793 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d6b3e-05a0-4d5c-bc54-0958033c8843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:32:14.464410 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d6b3e-05a0-4d5c-bc54-0958033c8843 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:32:14.464696 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d6b3e-05a0-4d5c-bc54-0958033c8843 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:32:14.464988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d6b3e-05a0-4d5c-bc54-0958033c8843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:32:14.466773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-141d6b3e-05a0-4d5c-bc54-0958033c8843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:14.480258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d6b3e-05a0-4d5c-bc54-0958033c8843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:32:14.481709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d6b3e-05a0-4d5c-bc54-0958033c8843 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:32:14.498885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1219/2415] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:32:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:32:16.979617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6be8e5-9a8d-44cd-b6b6-dc4f623e5fda None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:32:16.988998 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6be8e5-9a8d-44cd-b6b6-dc4f623e5fda None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:32:16.992454 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea634376-d26d-4821-ba72-8199f13d0a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:32:16.993124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634376-d26d-4821-ba72-8199f13d0a4f service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:32:16.993406 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634376-d26d-4821-ba72-8199f13d0a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:32:16.993676 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea634376-d26d-4821-ba72-8199f13d0a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:32:16.995419 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ea634376-d26d-4821-ba72-8199f13d0a4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:17.009238 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea634376-d26d-4821-ba72-8199f13d0a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:32:17.010583 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea634376-d26d-4821-ba72-8199f13d0a4f service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:32:17.022105 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1197/2416] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:32:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:32:18.060166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d6b3e-05a0-4d5c-bc54-0958033c8843 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:32:18.062281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-141d6b3e-05a0-4d5c-bc54-0958033c8843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:18.134319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d6b3e-05a0-4d5c-bc54-0958033c8843 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:32:18.139390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aafaa-bfca-49a8-8c08-ab7d32b516d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:32:18.141147 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aafaa-bfca-49a8-8c08-ab7d32b516d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:32:18.141482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aafaa-bfca-49a8-8c08-ab7d32b516d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:32:18.141755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aafaa-bfca-49a8-8c08-ab7d32b516d1 admin admin] PATH_INFO: `/v3/users/7c4fb8aded0e4f62a7e67e9bd23b81b1` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:32:18.143196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aafaa-bfca-49a8-8c08-ab7d32b516d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c4fb8aded0e4f62a7e67e9bd23b81b1)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:32:18.145599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aafaa-bfca-49a8-8c08-ab7d32b516d1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:32:18.194902 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-187aafaa-bfca-49a8-8c08-ab7d32b516d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4fb8aded0e4f62a7e67e9bd23b81b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:32:18.209800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-187aafaa-bfca-49a8-8c08-ab7d32b516d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4fb8aded0e4f62a7e67e9bd23b81b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:32:18.217341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-187aafaa-bfca-49a8-8c08-ab7d32b516d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4fb8aded0e4f62a7e67e9bd23b81b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:32:18.218303 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-187aafaa-bfca-49a8-8c08-ab7d32b516d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4fb8aded0e4f62a7e67e9bd23b81b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:32:18.226996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-187aafaa-bfca-49a8-8c08-ab7d32b516d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4fb8aded0e4f62a7e67e9bd23b81b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:32:18.236036 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1220/2417] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:32:18 2022] DELETE /identity/v3/users/7c4fb8aded0e4f62a7e67e9bd23b81b1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:32:18.415529 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea634376-d26d-4821-ba72-8199f13d0a4f service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:32:18.432768 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea634376-d26d-4821-ba72-8199f13d0a4f service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:32:18.505100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:32:18.506101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:32:18.506474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:32:18.506913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] PATH_INFO: `/v3/projects/f41df963fc334b24b0ddef0946179bb6` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:32:18.508213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41df963fc334b24b0ddef0946179bb6)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:32:18.510259 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:32:18.561090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41df963fc334b24b0ddef0946179bb6', 'request_id': 'req-5b3c46f2-516f-4605-84b3-a29f8d545d46'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:32:18.571728 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41df963fc334b24b0ddef0946179bb6', 'request_id': 'req-5b3c46f2-516f-4605-84b3-a29f8d545d46'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:32:18.578069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41df963fc334b24b0ddef0946179bb6', 'request_id': 'req-5b3c46f2-516f-4605-84b3-a29f8d545d46'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:32:18.590427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] The token cache is being invalidate because project f41df963fc334b24b0ddef0946179bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:32:18.591054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:32:18.591936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:32:18.597024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1198/2418] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:32:18 2022] DELETE /identity/v3/projects/f41df963fc334b24b0ddef0946179bb6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:32:29.875544 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61e18a-41ec-421c-8a1e-d37bc8285ff1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:32:29.876584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61e18a-41ec-421c-8a1e-d37bc8285ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:32:29.877121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61e18a-41ec-421c-8a1e-d37bc8285ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:32:29.907292 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4e61e18a-41ec-421c-8a1e-d37bc8285ff1 None None] MFA Rules not processed for user `36c95ddbd4384bb3a63d02698684e29a`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:32:29.908923 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4e61e18a-41ec-421c-8a1e-d37bc8285ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:30.005400 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1221/2419] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:32:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:32:30.302404 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:32:30.303921 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:30.373513 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c46f2-516f-4605-84b3-a29f8d545d46 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:32:30.378037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a721cce-a028-477b-8fbf-4ecc34fa59b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:32:30.378898 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a721cce-a028-477b-8fbf-4ecc34fa59b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:32:30.379368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a721cce-a028-477b-8fbf-4ecc34fa59b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:32:30.379813 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a721cce-a028-477b-8fbf-4ecc34fa59b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:32:30.381750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2a721cce-a028-477b-8fbf-4ecc34fa59b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:30.393364 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a721cce-a028-477b-8fbf-4ecc34fa59b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:32:30.395430 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a721cce-a028-477b-8fbf-4ecc34fa59b2 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:32:30.404552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1199/2420] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:32:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:32:30.717747 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61e18a-41ec-421c-8a1e-d37bc8285ff1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:32:30.719180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4e61e18a-41ec-421c-8a1e-d37bc8285ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:30.797402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61e18a-41ec-421c-8a1e-d37bc8285ff1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:32:30.802395 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941522d7-229b-4be1-9b1a-1e902818b264 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4dc7b58c8a04b359a4a9bbab9e7b219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:32:30.803032 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941522d7-229b-4be1-9b1a-1e902818b264 service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:32:30.803318 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941522d7-229b-4be1-9b1a-1e902818b264 service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:32:30.803594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941522d7-229b-4be1-9b1a-1e902818b264 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:32:30.805411 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-941522d7-229b-4be1-9b1a-1e902818b264 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:30.817887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941522d7-229b-4be1-9b1a-1e902818b264 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:32:30.819474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941522d7-229b-4be1-9b1a-1e902818b264 service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:32:30.829092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1222/2421] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:32:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:32:30.961407 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a721cce-a028-477b-8fbf-4ecc34fa59b2 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:32:30.962885 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2a721cce-a028-477b-8fbf-4ecc34fa59b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:31.039841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a721cce-a028-477b-8fbf-4ecc34fa59b2 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:32:31.045798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5399b6-2579-44cb-9101-d0e147ee4a5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:32:31.046456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5399b6-2579-44cb-9101-d0e147ee4a5d service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:32:31.046812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5399b6-2579-44cb-9101-d0e147ee4a5d service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:32:31.047564 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5399b6-2579-44cb-9101-d0e147ee4a5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:32:31.050078 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7b5399b6-2579-44cb-9101-d0e147ee4a5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:31.107458 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5399b6-2579-44cb-9101-d0e147ee4a5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:32:31.109909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5399b6-2579-44cb-9101-d0e147ee4a5d service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:32:31.121044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1200/2422] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:32:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:32:32.878209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941522d7-229b-4be1-9b1a-1e902818b264 service placement] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:32:32.879848 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-941522d7-229b-4be1-9b1a-1e902818b264 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:32.896294 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941522d7-229b-4be1-9b1a-1e902818b264 service placement] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:32:32.901442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45884c38-4f63-465d-b6b4-1e71204ef678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:32:32.902772 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884c38-4f63-465d-b6b4-1e71204ef678 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:32:32.903234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884c38-4f63-465d-b6b4-1e71204ef678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:32:32.903666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45884c38-4f63-465d-b6b4-1e71204ef678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:32:32.906046 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-45884c38-4f63-465d-b6b4-1e71204ef678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:32.921446 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45884c38-4f63-465d-b6b4-1e71204ef678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:32:32.923188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45884c38-4f63-465d-b6b4-1e71204ef678 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:32:32.932348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1223/2423] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:32:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:32:33.548563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c826d76-dced-4d49-9ccb-194b02caef61 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:32:33.549063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c826d76-dced-4d49-9ccb-194b02caef61 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:32:33.549342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c826d76-dced-4d49-9ccb-194b02caef61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:32:33.567167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-8c826d76-dced-4d49-9ccb-194b02caef61 None None] MFA Rules not processed for user `e092796100394b63a7304abae7e25f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:32:33.568384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-8c826d76-dced-4d49-9ccb-194b02caef61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:33.575860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1201/2424] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:32:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:32:34.151773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45884c38-4f63-465d-b6b4-1e71204ef678 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:32:34.164397 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45884c38-4f63-465d-b6b4-1e71204ef678 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:32:34.170121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f0fad-4529-4de0-9218-8c0b49a3e142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:32:34.170756 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f0fad-4529-4de0-9218-8c0b49a3e142 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:32:34.171037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f0fad-4529-4de0-9218-8c0b49a3e142 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:32:34.171307 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f0fad-4529-4de0-9218-8c0b49a3e142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:32:34.173347 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-057f0fad-4529-4de0-9218-8c0b49a3e142 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:34.183833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f0fad-4529-4de0-9218-8c0b49a3e142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:32:34.185425 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f0fad-4529-4de0-9218-8c0b49a3e142 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:32:34.196559 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1224/2425] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:32:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:32:53.393730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c826d76-dced-4d49-9ccb-194b02caef61 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:32:53.395344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-8c826d76-dced-4d49-9ccb-194b02caef61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:53.471200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c826d76-dced-4d49-9ccb-194b02caef61 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:32:53.474844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b2f0e-62ed-45d7-8c5e-b64d56dfa0aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:32:53.475488 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b2f0e-62ed-45d7-8c5e-b64d56dfa0aa service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:32:53.475773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b2f0e-62ed-45d7-8c5e-b64d56dfa0aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:32:53.476050 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b2f0e-62ed-45d7-8c5e-b64d56dfa0aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:32:53.477863 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e05b2f0e-62ed-45d7-8c5e-b64d56dfa0aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:53.533459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b2f0e-62ed-45d7-8c5e-b64d56dfa0aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:32:53.535247 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b2f0e-62ed-45d7-8c5e-b64d56dfa0aa service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:32:53.547692 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1202/2426] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:32:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:32:59.843457 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f0fad-4529-4de0-9218-8c0b49a3e142 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:32:59.857860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f0fad-4529-4de0-9218-8c0b49a3e142 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:32:59.869124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62865ccc-be3c-443f-912c-08c87d8092e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:32:59.870039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865ccc-be3c-443f-912c-08c87d8092e2 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:32:59.870504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865ccc-be3c-443f-912c-08c87d8092e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:32:59.870934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62865ccc-be3c-443f-912c-08c87d8092e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:32:59.876444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-62865ccc-be3c-443f-912c-08c87d8092e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:32:59.903353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62865ccc-be3c-443f-912c-08c87d8092e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:32:59.908705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62865ccc-be3c-443f-912c-08c87d8092e2 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:32:59.945404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1225/2427] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:32:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:00.097671 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b2f0e-62ed-45d7-8c5e-b64d56dfa0aa service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:00.099965 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e05b2f0e-62ed-45d7-8c5e-b64d56dfa0aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:00.139949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b2f0e-62ed-45d7-8c5e-b64d56dfa0aa service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:00.152569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fc44c-0083-4b21-b346-15a5bf174576 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:00.153546 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fc44c-0083-4b21-b346-15a5bf174576 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:00.155702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fc44c-0083-4b21-b346-15a5bf174576 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:00.156721 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81fc44c-0083-4b21-b346-15a5bf174576 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:00.163793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a81fc44c-0083-4b21-b346-15a5bf174576 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:00.200873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81fc44c-0083-4b21-b346-15a5bf174576 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:00.204215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81fc44c-0083-4b21-b346-15a5bf174576 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:00.238187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1203/2428] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:09.832412 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bf577-efee-4be9-8c41-327e3eb297d5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:09.832888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bf577-efee-4be9-8c41-327e3eb297d5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:09.833106 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8bf577-efee-4be9-8c41-327e3eb297d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:09.850343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ad8bf577-efee-4be9-8c41-327e3eb297d5 None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:09.851517 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ad8bf577-efee-4be9-8c41-327e3eb297d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:09.906194 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1226/2429] 10.222.0.61 () {58 vars in 967 bytes} [Tue May 10 20:33:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:09.950671 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fc44c-0083-4b21-b346-15a5bf174576 service nova] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:09.952043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a81fc44c-0083-4b21-b346-15a5bf174576 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:10.023408 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81fc44c-0083-4b21-b346-15a5bf174576 service nova] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:10.028372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb08106-ab70-45c3-adc6-a848a90c6a34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:10.029060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb08106-ab70-45c3-adc6-a848a90c6a34 service swift] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:10.029350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb08106-ab70-45c3-adc6-a848a90c6a34 service swift] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:10.029630 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb08106-ab70-45c3-adc6-a848a90c6a34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:10.038269 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb08106-ab70-45c3-adc6-a848a90c6a34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:10.039840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb08106-ab70-45c3-adc6-a848a90c6a34 service swift] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:10.048709 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1204/2430] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:33:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:33:14.836375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bf577-efee-4be9-8c41-327e3eb297d5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:14.845541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8bf577-efee-4be9-8c41-327e3eb297d5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:14.848956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef53d0-edc9-49cc-9e27-1a03f0877a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:14.849913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef53d0-edc9-49cc-9e27-1a03f0877a44 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:14.850195 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef53d0-edc9-49cc-9e27-1a03f0877a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:14.850466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef53d0-edc9-49cc-9e27-1a03f0877a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:14.852243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-72ef53d0-edc9-49cc-9e27-1a03f0877a44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:14.912331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef53d0-edc9-49cc-9e27-1a03f0877a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:14.913866 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef53d0-edc9-49cc-9e27-1a03f0877a44 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:14.923849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1227/2431] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:18.427769 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb08106-ab70-45c3-adc6-a848a90c6a34 service swift] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:18.430091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-1eb08106-ab70-45c3-adc6-a848a90c6a34 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:18.450263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb08106-ab70-45c3-adc6-a848a90c6a34 service swift] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:18.458905 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9a371-a9b4-4153-9e7e-cac6cd7a033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:18.460232 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9a371-a9b4-4153-9e7e-cac6cd7a033d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:18.460742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9a371-a9b4-4153-9e7e-cac6cd7a033d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:18.461309 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9a371-a9b4-4153-9e7e-cac6cd7a033d admin admin] PATH_INFO: `/v3/users/50d5a87e4d094287bb543721c9c9909d` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:18.464446 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9a371-a9b4-4153-9e7e-cac6cd7a033d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d5a87e4d094287bb543721c9c9909d)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:18.468342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9a371-a9b4-4153-9e7e-cac6cd7a033d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:18.546770 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c0c9a371-a9b4-4153-9e7e-cac6cd7a033d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d5a87e4d094287bb543721c9c9909d'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:18.548091 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c0c9a371-a9b4-4153-9e7e-cac6cd7a033d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d5a87e4d094287bb543721c9c9909d'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:18.560538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c0c9a371-a9b4-4153-9e7e-cac6cd7a033d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d5a87e4d094287bb543721c9c9909d'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:18.569344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c0c9a371-a9b4-4153-9e7e-cac6cd7a033d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d5a87e4d094287bb543721c9c9909d'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:18.580257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c0c9a371-a9b4-4153-9e7e-cac6cd7a033d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d5a87e4d094287bb543721c9c9909d'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:18.587649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1205/2432] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:33:18 2022] DELETE /identity/v3/users/50d5a87e4d094287bb543721c9c9909d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:18.764160 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef53d0-edc9-49cc-9e27-1a03f0877a44 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:18.776996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef53d0-edc9-49cc-9e27-1a03f0877a44 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:18.840834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:18.842233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:18.842765 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:18.843144 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] PATH_INFO: `/v3/projects/51884a66cf014d6596d22c37c4a97147` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:18.844757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51884a66cf014d6596d22c37c4a97147)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:18.846835 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:18.911376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51884a66cf014d6596d22c37c4a97147', 'request_id': 'req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:18.917618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51884a66cf014d6596d22c37c4a97147', 'request_id': 'req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:18.924595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51884a66cf014d6596d22c37c4a97147', 'request_id': 'req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:18.943567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] The token cache is being invalidate because project 51884a66cf014d6596d22c37c4a97147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:33:18.943973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:18.944754 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:18.946553 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1228/2433] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:33:18 2022] DELETE /identity/v3/projects/51884a66cf014d6596d22c37c4a97147 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:18.950568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9a371-a9b4-4153-9e7e-cac6cd7a033d admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:18.952190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c0c9a371-a9b4-4153-9e7e-cac6cd7a033d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:18.965820 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9a371-a9b4-4153-9e7e-cac6cd7a033d admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:19.041010 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169da0bd-59a0-443d-b360-1594cce32642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:19.042347 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169da0bd-59a0-443d-b360-1594cce32642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:19.042347 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169da0bd-59a0-443d-b360-1594cce32642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:19.042843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169da0bd-59a0-443d-b360-1594cce32642 admin admin] PATH_INFO: `/v3/users/4b6f071562404411a0c6a6e9907198f1` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:19.044310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169da0bd-59a0-443d-b360-1594cce32642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b6f071562404411a0c6a6e9907198f1)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:19.046608 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169da0bd-59a0-443d-b360-1594cce32642 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:19.054612 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:19.056148 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:19.070914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7523e7a-1d7d-4cba-8dc7-16fc689cc1d6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:19.081605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0e44f-9ef8-427a-bc65-0e90dc96fc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:19.082497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0e44f-9ef8-427a-bc65-0e90dc96fc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:19.082785 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0e44f-9ef8-427a-bc65-0e90dc96fc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:19.083065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0e44f-9ef8-427a-bc65-0e90dc96fc97 admin admin] PATH_INFO: `/v3/users/df3cf8a2f7c54b80aac61d6ca59672b5` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:19.084334 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0e44f-9ef8-427a-bc65-0e90dc96fc97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3cf8a2f7c54b80aac61d6ca59672b5)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:19.086570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0e44f-9ef8-427a-bc65-0e90dc96fc97 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:19.104772 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-169da0bd-59a0-443d-b360-1594cce32642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b6f071562404411a0c6a6e9907198f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.105462 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-169da0bd-59a0-443d-b360-1594cce32642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b6f071562404411a0c6a6e9907198f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.119830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-169da0bd-59a0-443d-b360-1594cce32642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b6f071562404411a0c6a6e9907198f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.128530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-169da0bd-59a0-443d-b360-1594cce32642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b6f071562404411a0c6a6e9907198f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.137761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-169da0bd-59a0-443d-b360-1594cce32642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b6f071562404411a0c6a6e9907198f1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.145689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1206/2434] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:33:18 2022] DELETE /identity/v3/users/4b6f071562404411a0c6a6e9907198f1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:33:19.147012 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-36e0e44f-9ef8-427a-bc65-0e90dc96fc97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3cf8a2f7c54b80aac61d6ca59672b5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.165281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-36e0e44f-9ef8-427a-bc65-0e90dc96fc97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3cf8a2f7c54b80aac61d6ca59672b5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.173945 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-36e0e44f-9ef8-427a-bc65-0e90dc96fc97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3cf8a2f7c54b80aac61d6ca59672b5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.174706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-36e0e44f-9ef8-427a-bc65-0e90dc96fc97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3cf8a2f7c54b80aac61d6ca59672b5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.185812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-36e0e44f-9ef8-427a-bc65-0e90dc96fc97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3cf8a2f7c54b80aac61d6ca59672b5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.192668 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1229/2435] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:33:19 2022] DELETE /identity/v3/users/df3cf8a2f7c54b80aac61d6ca59672b5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:33:19.398409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169da0bd-59a0-443d-b360-1594cce32642 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:19.399891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-169da0bd-59a0-443d-b360-1594cce32642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:19.449491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0e44f-9ef8-427a-bc65-0e90dc96fc97 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:19.450944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-36e0e44f-9ef8-427a-bc65-0e90dc96fc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:19.477653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169da0bd-59a0-443d-b360-1594cce32642 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:19.517999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0e44f-9ef8-427a-bc65-0e90dc96fc97 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:19.523200 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2aa06b-6be9-49fc-b604-91c599cd1acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:19.524053 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aa06b-6be9-49fc-b604-91c599cd1acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:19.524358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aa06b-6be9-49fc-b604-91c599cd1acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:19.524636 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2aa06b-6be9-49fc-b604-91c599cd1acb admin admin] PATH_INFO: `/v3/projects/67dae2f388bc4a81bc957f48b1b02e42` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:19.525977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aa06b-6be9-49fc-b604-91c599cd1acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=67dae2f388bc4a81bc957f48b1b02e42)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:19.527890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2aa06b-6be9-49fc-b604-91c599cd1acb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:19.533255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19b12d-5ea2-447e-8087-ec0d450f0b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:19.534201 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19b12d-5ea2-447e-8087-ec0d450f0b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:19.534701 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19b12d-5ea2-447e-8087-ec0d450f0b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:19.535109 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19b12d-5ea2-447e-8087-ec0d450f0b08 admin admin] PATH_INFO: `/v3/projects/c55adf09fe3e48468a0317be42fe770a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:19.536460 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19b12d-5ea2-447e-8087-ec0d450f0b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c55adf09fe3e48468a0317be42fe770a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:19.538423 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19b12d-5ea2-447e-8087-ec0d450f0b08 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:19.575623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dd2aa06b-6be9-49fc-b604-91c599cd1acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67dae2f388bc4a81bc957f48b1b02e42', 'request_id': 'req-dd2aa06b-6be9-49fc-b604-91c599cd1acb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.581548 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dd2aa06b-6be9-49fc-b604-91c599cd1acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67dae2f388bc4a81bc957f48b1b02e42', 'request_id': 'req-dd2aa06b-6be9-49fc-b604-91c599cd1acb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.586480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6b19b12d-5ea2-447e-8087-ec0d450f0b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c55adf09fe3e48468a0317be42fe770a', 'request_id': 'req-6b19b12d-5ea2-447e-8087-ec0d450f0b08'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.587615 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dd2aa06b-6be9-49fc-b604-91c599cd1acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67dae2f388bc4a81bc957f48b1b02e42', 'request_id': 'req-dd2aa06b-6be9-49fc-b604-91c599cd1acb'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.594713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6b19b12d-5ea2-447e-8087-ec0d450f0b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c55adf09fe3e48468a0317be42fe770a', 'request_id': 'req-6b19b12d-5ea2-447e-8087-ec0d450f0b08'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.600392 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6b19b12d-5ea2-447e-8087-ec0d450f0b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c55adf09fe3e48468a0317be42fe770a', 'request_id': 'req-6b19b12d-5ea2-447e-8087-ec0d450f0b08'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.601723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dd2aa06b-6be9-49fc-b604-91c599cd1acb admin admin] The token cache is being invalidate because project 67dae2f388bc4a81bc957f48b1b02e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:33:19.602014 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dd2aa06b-6be9-49fc-b604-91c599cd1acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.602630 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-dd2aa06b-6be9-49fc-b604-91c599cd1acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.604275 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1230/2436] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:33:19 2022] DELETE /identity/v3/projects/67dae2f388bc4a81bc957f48b1b02e42 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:33:19.609724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65cfbb-a820-4665-a74e-3246218499d5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:19.610013 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65cfbb-a820-4665-a74e-3246218499d5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:19.610292 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65cfbb-a820-4665-a74e-3246218499d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:19.613616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6b19b12d-5ea2-447e-8087-ec0d450f0b08 admin admin] The token cache is being invalidate because project c55adf09fe3e48468a0317be42fe770a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:33:19.613903 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6b19b12d-5ea2-447e-8087-ec0d450f0b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.614536 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6b19b12d-5ea2-447e-8087-ec0d450f0b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:19.616142 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1207/2437] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:33:19 2022] DELETE /identity/v3/projects/c55adf09fe3e48468a0317be42fe770a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:33:19.629383 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1c65cfbb-a820-4665-a74e-3246218499d5 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:19.630624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1c65cfbb-a820-4665-a74e-3246218499d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:19.698697 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1231/2438] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:33:19.708198 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b33fa9-d2f6-42d2-9caf-da8313a923c1 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:19.708499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b33fa9-d2f6-42d2-9caf-da8313a923c1 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:19.708782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b33fa9-d2f6-42d2-9caf-da8313a923c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:19.731698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-94b33fa9-d2f6-42d2-9caf-da8313a923c1 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:19.732956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-94b33fa9-d2f6-42d2-9caf-da8313a923c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:19.742879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1208/2439] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:19.747020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65cfbb-a820-4665-a74e-3246218499d5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:19.757101 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65cfbb-a820-4665-a74e-3246218499d5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:19.762206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7bac9-6b68-4344-8c2d-a25abdce619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:19.762902 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bac9-6b68-4344-8c2d-a25abdce619d admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:19.763187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bac9-6b68-4344-8c2d-a25abdce619d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:19.763466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bac9-6b68-4344-8c2d-a25abdce619d admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:19.764212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7bac9-6b68-4344-8c2d-a25abdce619d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:33:19.764890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7bac9-6b68-4344-8c2d-a25abdce619d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:19.766322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7bac9-6b68-4344-8c2d-a25abdce619d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:19.783287 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1232/2440] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:33:19.784490 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b33fa9-d2f6-42d2-9caf-da8313a923c1 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:19.794196 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b33fa9-d2f6-42d2-9caf-da8313a923c1 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:19.800009 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c855cd7-4215-494c-a8bb-a0fdad380246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:19.800699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c855cd7-4215-494c-a8bb-a0fdad380246 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:19.801022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c855cd7-4215-494c-a8bb-a0fdad380246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:19.801284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c855cd7-4215-494c-a8bb-a0fdad380246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:19.801992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c855cd7-4215-494c-a8bb-a0fdad380246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:19.803946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c855cd7-4215-494c-a8bb-a0fdad380246 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:19.840549 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1209/2441] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:33:19 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:19.848109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7bac9-6b68-4344-8c2d-a25abdce619d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:19.861121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7bac9-6b68-4344-8c2d-a25abdce619d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:19.920184 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a1830-3a23-45b1-afe8-5419e53d98d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:19.921488 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a1830-3a23-45b1-afe8-5419e53d98d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:19.921777 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a1830-3a23-45b1-afe8-5419e53d98d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:19.922056 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a1830-3a23-45b1-afe8-5419e53d98d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:19.922744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a1830-3a23-45b1-afe8-5419e53d98d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:19.924678 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a1830-3a23-45b1-afe8-5419e53d98d4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:19.943190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1233/2442] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:33:19 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:19.947424 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c855cd7-4215-494c-a8bb-a0fdad380246 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:19.957918 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c855cd7-4215-494c-a8bb-a0fdad380246 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:19.962569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cea5c1-ed37-4545-8b70-94bff186f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:19.963224 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea5c1-ed37-4545-8b70-94bff186f2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:19.963508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea5c1-ed37-4545-8b70-94bff186f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:19.963782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea5c1-ed37-4545-8b70-94bff186f2f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:19.964507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cea5c1-ed37-4545-8b70-94bff186f2f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:19.966132 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cea5c1-ed37-4545-8b70-94bff186f2f2 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:19.976797 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1210/2443] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:19.980911 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a1830-3a23-45b1-afe8-5419e53d98d4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:19.991572 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a1830-3a23-45b1-afe8-5419e53d98d4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:19.996268 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f665afc-116d-450d-9830-c8e7d3f4eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:19.996922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f665afc-116d-450d-9830-c8e7d3f4eeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:19.997235 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f665afc-116d-450d-9830-c8e7d3f4eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:19.997511 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f665afc-116d-450d-9830-c8e7d3f4eeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:19.998255 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f665afc-116d-450d-9830-c8e7d3f4eeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:19.999905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f665afc-116d-450d-9830-c8e7d3f4eeb8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:20.009474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1234/2444] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:20.013594 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cea5c1-ed37-4545-8b70-94bff186f2f2 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:20.024900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cea5c1-ed37-4545-8b70-94bff186f2f2 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:20.029594 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ff8b3-33e8-4a03-8ba3-c0b931ef68bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:20.031082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ff8b3-33e8-4a03-8ba3-c0b931ef68bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:20.031364 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ff8b3-33e8-4a03-8ba3-c0b931ef68bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:20.031773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ff8b3-33e8-4a03-8ba3-c0b931ef68bc admin admin] PATH_INFO: `/v3/projects/2c4e547f4ac949e29f6cc6fd6b9e1027/users/eda02a88b79a4e05a6cadfb1f89639b1/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:20.047867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ff8b3-33e8-4a03-8ba3-c0b931ef68bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4e547f4ac949e29f6cc6fd6b9e1027, user_id=eda02a88b79a4e05a6cadfb1f89639b1, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:20.050563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ff8b3-33e8-4a03-8ba3-c0b931ef68bc admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:20.063893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1211/2445] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:33:20 2022] PUT /identity/v3/projects/2c4e547f4ac949e29f6cc6fd6b9e1027/users/eda02a88b79a4e05a6cadfb1f89639b1/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:33:20.073894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b9381-88ba-48f5-94b0-fbb6ab6d6bb6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:20.074200 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b9381-88ba-48f5-94b0-fbb6ab6d6bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:20.074478 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b9381-88ba-48f5-94b0-fbb6ab6d6bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:20.099926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f33b9381-88ba-48f5-94b0-fbb6ab6d6bb6 None None] MFA Rules not processed for user `eda02a88b79a4e05a6cadfb1f89639b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:20.101080 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f33b9381-88ba-48f5-94b0-fbb6ab6d6bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:20.163767 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1235/2446] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:20.175420 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ff8b3-33e8-4a03-8ba3-c0b931ef68bc admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:20.177149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-860ff8b3-33e8-4a03-8ba3-c0b931ef68bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:20.257677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ff8b3-33e8-4a03-8ba3-c0b931ef68bc admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:20.263214 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192ca45-bdbb-4141-b45f-32b622d94d99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:20.263852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ca45-bdbb-4141-b45f-32b622d94d99 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:20.264134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ca45-bdbb-4141-b45f-32b622d94d99 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:20.264432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192ca45-bdbb-4141-b45f-32b622d94d99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:20.272088 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192ca45-bdbb-4141-b45f-32b622d94d99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:20.273704 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192ca45-bdbb-4141-b45f-32b622d94d99 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:20.282211 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1212/2447] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:20.480669 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b9381-88ba-48f5-94b0-fbb6ab6d6bb6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:20.540519 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b9381-88ba-48f5-94b0-fbb6ab6d6bb6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:20.545002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bb8da-c8f1-4914-9dc1-974dfb6ea882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:20.546396 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bb8da-c8f1-4914-9dc1-974dfb6ea882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:20.546684 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bb8da-c8f1-4914-9dc1-974dfb6ea882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:20.546957 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5bb8da-c8f1-4914-9dc1-974dfb6ea882 admin admin] PATH_INFO: `/v3/users/eda02a88b79a4e05a6cadfb1f89639b1` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:20.548133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bb8da-c8f1-4914-9dc1-974dfb6ea882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda02a88b79a4e05a6cadfb1f89639b1)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:20.550181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5bb8da-c8f1-4914-9dc1-974dfb6ea882 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:20.593674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7c5bb8da-c8f1-4914-9dc1-974dfb6ea882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda02a88b79a4e05a6cadfb1f89639b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:20.605068 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7c5bb8da-c8f1-4914-9dc1-974dfb6ea882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda02a88b79a4e05a6cadfb1f89639b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:20.612253 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7c5bb8da-c8f1-4914-9dc1-974dfb6ea882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda02a88b79a4e05a6cadfb1f89639b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:20.612919 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7c5bb8da-c8f1-4914-9dc1-974dfb6ea882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda02a88b79a4e05a6cadfb1f89639b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:20.620098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7c5bb8da-c8f1-4914-9dc1-974dfb6ea882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda02a88b79a4e05a6cadfb1f89639b1'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:20.625925 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1236/2448] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:33:20 2022] DELETE /identity/v3/users/eda02a88b79a4e05a6cadfb1f89639b1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:20.630407 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46de68-a08b-42fc-849b-c54680913ec8 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:20.630888 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46de68-a08b-42fc-849b-c54680913ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:20.630986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46de68-a08b-42fc-849b-c54680913ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:20.647743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-fd46de68-a08b-42fc-849b-c54680913ec8 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:20.648920 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fd46de68-a08b-42fc-849b-c54680913ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:20.704853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1213/2449] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:33:20.714670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bb8da-c8f1-4914-9dc1-974dfb6ea882 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:20.716085 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7c5bb8da-c8f1-4914-9dc1-974dfb6ea882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:20.772110 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5bb8da-c8f1-4914-9dc1-974dfb6ea882 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:20.775800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298b657-d025-4a7e-8191-e788e7fa78bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:20.776440 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298b657-d025-4a7e-8191-e788e7fa78bb service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:20.776724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298b657-d025-4a7e-8191-e788e7fa78bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:20.777024 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298b657-d025-4a7e-8191-e788e7fa78bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:20.786366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298b657-d025-4a7e-8191-e788e7fa78bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:20.787789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298b657-d025-4a7e-8191-e788e7fa78bb service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:20.796962 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1237/2450] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:21.055148 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46de68-a08b-42fc-849b-c54680913ec8 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:21.056707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fd46de68-a08b-42fc-849b-c54680913ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:21.069117 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46de68-a08b-42fc-849b-c54680913ec8 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:21.073782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562231d-8c52-4ec5-816f-467a45d1ee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:21.074648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562231d-8c52-4ec5-816f-467a45d1ee8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:21.074929 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562231d-8c52-4ec5-816f-467a45d1ee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:21.075206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562231d-8c52-4ec5-816f-467a45d1ee8c admin admin] PATH_INFO: `/v3/projects/2c4e547f4ac949e29f6cc6fd6b9e1027` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:21.076455 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562231d-8c52-4ec5-816f-467a45d1ee8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4e547f4ac949e29f6cc6fd6b9e1027)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:21.078911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562231d-8c52-4ec5-816f-467a45d1ee8c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:21.125592 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5562231d-8c52-4ec5-816f-467a45d1ee8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4e547f4ac949e29f6cc6fd6b9e1027', 'request_id': 'req-5562231d-8c52-4ec5-816f-467a45d1ee8c'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:21.132501 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5562231d-8c52-4ec5-816f-467a45d1ee8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4e547f4ac949e29f6cc6fd6b9e1027', 'request_id': 'req-5562231d-8c52-4ec5-816f-467a45d1ee8c'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:21.137994 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5562231d-8c52-4ec5-816f-467a45d1ee8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4e547f4ac949e29f6cc6fd6b9e1027', 'request_id': 'req-5562231d-8c52-4ec5-816f-467a45d1ee8c'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:21.149441 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5562231d-8c52-4ec5-816f-467a45d1ee8c admin admin] The token cache is being invalidate because project 2c4e547f4ac949e29f6cc6fd6b9e1027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:33:21.149730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5562231d-8c52-4ec5-816f-467a45d1ee8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:21.150354 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-5562231d-8c52-4ec5-816f-467a45d1ee8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:21.151925 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1214/2451] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:33:21 2022] DELETE /identity/v3/projects/2c4e547f4ac949e29f6cc6fd6b9e1027 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:21.156819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43487a38-e862-455f-b160-06839a71dcf6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:21.157168 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43487a38-e862-455f-b160-06839a71dcf6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:21.157447 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43487a38-e862-455f-b160-06839a71dcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:21.175459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-43487a38-e862-455f-b160-06839a71dcf6 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:21.176649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-43487a38-e862-455f-b160-06839a71dcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:21.232715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1238/2452] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:21.241688 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4a29a-7fce-484c-bbe9-e29813b1ae0e None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:21.242006 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4a29a-7fce-484c-bbe9-e29813b1ae0e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:21.242288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4a29a-7fce-484c-bbe9-e29813b1ae0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:21.260490 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-51b4a29a-7fce-484c-bbe9-e29813b1ae0e None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:21.261703 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-51b4a29a-7fce-484c-bbe9-e29813b1ae0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:21.270760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1215/2453] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:21.275451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43487a38-e862-455f-b160-06839a71dcf6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:21.285315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43487a38-e862-455f-b160-06839a71dcf6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:21.290201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6502ac-073a-43a5-9e09-6f95b08c3367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:21.290851 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6502ac-073a-43a5-9e09-6f95b08c3367 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:21.291133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6502ac-073a-43a5-9e09-6f95b08c3367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:21.291413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6502ac-073a-43a5-9e09-6f95b08c3367 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:21.292137 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6502ac-073a-43a5-9e09-6f95b08c3367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:33:21.292449 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6502ac-073a-43a5-9e09-6f95b08c3367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:21.294100 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6502ac-073a-43a5-9e09-6f95b08c3367 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:21.305569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1239/2454] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:33:21.309821 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4a29a-7fce-484c-bbe9-e29813b1ae0e None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:21.319289 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4a29a-7fce-484c-bbe9-e29813b1ae0e None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:21.323811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131bdd1-7473-4175-81da-99a0f2afc299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:21.324447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131bdd1-7473-4175-81da-99a0f2afc299 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:21.324726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131bdd1-7473-4175-81da-99a0f2afc299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:21.325028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131bdd1-7473-4175-81da-99a0f2afc299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:21.325720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131bdd1-7473-4175-81da-99a0f2afc299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:21.328286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131bdd1-7473-4175-81da-99a0f2afc299 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:21.352268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1216/2455] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:33:21 2022] POST /identity/v3/projects => generated 357 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:21.356234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6502ac-073a-43a5-9e09-6f95b08c3367 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:21.365946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6502ac-073a-43a5-9e09-6f95b08c3367 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:21.421617 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4154729-0d62-4e9d-be5c-1c0c8cc4a27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:21.422207 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4154729-0d62-4e9d-be5c-1c0c8cc4a27d admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:21.422500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4154729-0d62-4e9d-be5c-1c0c8cc4a27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:21.422779 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4154729-0d62-4e9d-be5c-1c0c8cc4a27d admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:21.423472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4154729-0d62-4e9d-be5c-1c0c8cc4a27d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:21.425443 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4154729-0d62-4e9d-be5c-1c0c8cc4a27d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:21.445548 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1240/2456] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:33:21 2022] POST /identity/v3/users => generated 279 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:21.449714 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131bdd1-7473-4175-81da-99a0f2afc299 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:21.463584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131bdd1-7473-4175-81da-99a0f2afc299 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:21.469472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a4150-7c1c-4392-b012-df93e702f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:21.470136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4150-7c1c-4392-b012-df93e702f905 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:21.470417 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4150-7c1c-4392-b012-df93e702f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:21.470692 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4150-7c1c-4392-b012-df93e702f905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:21.471420 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a4150-7c1c-4392-b012-df93e702f905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:21.473030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a4150-7c1c-4392-b012-df93e702f905 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:21.483403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1217/2457] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:33:21.487390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4154729-0d62-4e9d-be5c-1c0c8cc4a27d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:21.497789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4154729-0d62-4e9d-be5c-1c0c8cc4a27d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:21.502993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ad752-fdaa-4868-8c40-68710c78881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:21.503611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ad752-fdaa-4868-8c40-68710c78881b admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:21.503930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ad752-fdaa-4868-8c40-68710c78881b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:21.504228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ad752-fdaa-4868-8c40-68710c78881b admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:21.504962 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ad752-fdaa-4868-8c40-68710c78881b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:21.506585 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ad752-fdaa-4868-8c40-68710c78881b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:21.517405 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1241/2458] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:21.521824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a4150-7c1c-4392-b012-df93e702f905 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:21.531697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a4150-7c1c-4392-b012-df93e702f905 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:21.536310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9125c2-9367-46ca-a14b-baccc1acd0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:21.537323 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9125c2-9367-46ca-a14b-baccc1acd0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:21.537607 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9125c2-9367-46ca-a14b-baccc1acd0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:21.537879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9125c2-9367-46ca-a14b-baccc1acd0dc admin admin] PATH_INFO: `/v3/projects/299ee9b3248d475faa991f39e973fe96/users/1d8eb432780747b7a258debd14e1fd2f/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:21.553494 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9125c2-9367-46ca-a14b-baccc1acd0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=299ee9b3248d475faa991f39e973fe96, user_id=1d8eb432780747b7a258debd14e1fd2f, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:21.556169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9125c2-9367-46ca-a14b-baccc1acd0dc admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:21.569397 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1218/2459] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:33:21 2022] PUT /identity/v3/projects/299ee9b3248d475faa991f39e973fe96/users/1d8eb432780747b7a258debd14e1fd2f/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:21.580104 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5f27-23c5-4cda-84c4-89e19f3cd645 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:21.580424 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5f27-23c5-4cda-84c4-89e19f3cd645 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:21.580739 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5f27-23c5-4cda-84c4-89e19f3cd645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:21.607240 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-cc6a5f27-23c5-4cda-84c4-89e19f3cd645 None None] MFA Rules not processed for user `1d8eb432780747b7a258debd14e1fd2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:21.609016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cc6a5f27-23c5-4cda-84c4-89e19f3cd645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:21.676226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1242/2460] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:21 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:21.680982 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9125c2-9367-46ca-a14b-baccc1acd0dc admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:21.742453 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9125c2-9367-46ca-a14b-baccc1acd0dc admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:21.747140 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba7558-72c0-42a6-a8e3-fde446888ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:21.747824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba7558-72c0-42a6-a8e3-fde446888ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:21.748103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba7558-72c0-42a6-a8e3-fde446888ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:21.748377 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba7558-72c0-42a6-a8e3-fde446888ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:21.749695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba7558-72c0-42a6-a8e3-fde446888ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:21.751580 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba7558-72c0-42a6-a8e3-fde446888ee2 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:21.776995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1219/2461] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:33:21 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:21.781181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a5f27-23c5-4cda-84c4-89e19f3cd645 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:21.791638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a5f27-23c5-4cda-84c4-89e19f3cd645 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:21.851895 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e8c1f-a8fa-4814-8022-96f8527d3394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:21.853088 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e8c1f-a8fa-4814-8022-96f8527d3394 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:21.853606 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e8c1f-a8fa-4814-8022-96f8527d3394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:21.854113 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e8c1f-a8fa-4814-8022-96f8527d3394 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:21.855414 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e8c1f-a8fa-4814-8022-96f8527d3394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:21.859761 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e8c1f-a8fa-4814-8022-96f8527d3394 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:21.884390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1243/2462] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:33:21 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:21.890312 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba7558-72c0-42a6-a8e3-fde446888ee2 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:21.900872 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba7558-72c0-42a6-a8e3-fde446888ee2 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:21.906062 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c3f1b-31d0-4ca5-b2ba-3ec2c2ada40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:21.906738 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c3f1b-31d0-4ca5-b2ba-3ec2c2ada40b admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:21.907017 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c3f1b-31d0-4ca5-b2ba-3ec2c2ada40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:21.907289 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c3f1b-31d0-4ca5-b2ba-3ec2c2ada40b admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:21.908009 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c3f1b-31d0-4ca5-b2ba-3ec2c2ada40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:21.913178 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c3f1b-31d0-4ca5-b2ba-3ec2c2ada40b admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:21.924745 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1220/2463] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:21.929883 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e8c1f-a8fa-4814-8022-96f8527d3394 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:21.939586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e8c1f-a8fa-4814-8022-96f8527d3394 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:21.944172 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d949695-4188-41e2-aaa5-de9a334b9aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:21.945089 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d949695-4188-41e2-aaa5-de9a334b9aba admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:21.945375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d949695-4188-41e2-aaa5-de9a334b9aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:21.945649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d949695-4188-41e2-aaa5-de9a334b9aba admin admin] PATH_INFO: `/v3/projects/1016a9832ec248c2b6ee4326814802a2/users/3a3cad63db5b458396c70137bc312414/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:21.961391 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d949695-4188-41e2-aaa5-de9a334b9aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1016a9832ec248c2b6ee4326814802a2, user_id=3a3cad63db5b458396c70137bc312414, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:21.964041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d949695-4188-41e2-aaa5-de9a334b9aba admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:21.978795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1244/2464] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:33:21 2022] PUT /identity/v3/projects/1016a9832ec248c2b6ee4326814802a2/users/3a3cad63db5b458396c70137bc312414/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:21.984833 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c3f1b-31d0-4ca5-b2ba-3ec2c2ada40b admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:21.994946 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c3f1b-31d0-4ca5-b2ba-3ec2c2ada40b admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:22.059070 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1caae3-754e-41b2-b1af-1bcb2efadcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:22.059739 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1caae3-754e-41b2-b1af-1bcb2efadcfe admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:22.060049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1caae3-754e-41b2-b1af-1bcb2efadcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:22.060316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1caae3-754e-41b2-b1af-1bcb2efadcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:22.061063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1caae3-754e-41b2-b1af-1bcb2efadcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:22.062640 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1caae3-754e-41b2-b1af-1bcb2efadcfe admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:22.075596 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1221/2465] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:22.079911 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d949695-4188-41e2-aaa5-de9a334b9aba admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:22.090007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d949695-4188-41e2-aaa5-de9a334b9aba admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:22.098524 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf47b93-2361-4dec-a419-9e66c8986dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:22.099414 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf47b93-2361-4dec-a419-9e66c8986dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:22.099692 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf47b93-2361-4dec-a419-9e66c8986dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:22.099963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf47b93-2361-4dec-a419-9e66c8986dbe admin admin] PATH_INFO: `/v3/projects/1016a9832ec248c2b6ee4326814802a2/users/3a3cad63db5b458396c70137bc312414/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:22.101966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf47b93-2361-4dec-a419-9e66c8986dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1016a9832ec248c2b6ee4326814802a2, user_id=3a3cad63db5b458396c70137bc312414, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:22.104644 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf47b93-2361-4dec-a419-9e66c8986dbe admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:22.116065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1245/2466] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:33:22 2022] PUT /identity/v3/projects/1016a9832ec248c2b6ee4326814802a2/users/3a3cad63db5b458396c70137bc312414/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:33:22.126205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f91e15-560c-4f29-85fe-efb66acae3f2 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:22.126533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f91e15-560c-4f29-85fe-efb66acae3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:22.126816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f91e15-560c-4f29-85fe-efb66acae3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:22.152634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-13f91e15-560c-4f29-85fe-efb66acae3f2 None None] MFA Rules not processed for user `3a3cad63db5b458396c70137bc312414`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:22.153877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-13f91e15-560c-4f29-85fe-efb66acae3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:22.219769 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1222/2467] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:22 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:22.230993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf47b93-2361-4dec-a419-9e66c8986dbe admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:22.232701 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ddf47b93-2361-4dec-a419-9e66c8986dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:22.289732 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf47b93-2361-4dec-a419-9e66c8986dbe admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:22.293365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d50a2-4a2d-4382-934a-3f9e846abf7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:22.293998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d50a2-4a2d-4382-934a-3f9e846abf7c service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:22.294281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d50a2-4a2d-4382-934a-3f9e846abf7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:22.294556 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d50a2-4a2d-4382-934a-3f9e846abf7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:22.303196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d50a2-4a2d-4382-934a-3f9e846abf7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:22.304623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d50a2-4a2d-4382-934a-3f9e846abf7c service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:22.313613 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1246/2468] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:22 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:22.383157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f91e15-560c-4f29-85fe-efb66acae3f2 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:22.393154 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f91e15-560c-4f29-85fe-efb66acae3f2 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:22.396991 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e26ccf-92c5-4c90-8c57-37676f829695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:22.397632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e26ccf-92c5-4c90-8c57-37676f829695 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:22.397916 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e26ccf-92c5-4c90-8c57-37676f829695 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:22.398194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e26ccf-92c5-4c90-8c57-37676f829695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:22.454311 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e26ccf-92c5-4c90-8c57-37676f829695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:22.455727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e26ccf-92c5-4c90-8c57-37676f829695 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:22.464310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1223/2469] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:22 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:37.387243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d50a2-4a2d-4382-934a-3f9e846abf7c service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:37.444852 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d50a2-4a2d-4382-934a-3f9e846abf7c service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:37.449313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe18f-7a85-4dde-a1eb-3dab2c5bfb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:37.450161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe18f-7a85-4dde-a1eb-3dab2c5bfb1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:37.450440 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe18f-7a85-4dde-a1eb-3dab2c5bfb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:37.450712 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe18f-7a85-4dde-a1eb-3dab2c5bfb1c admin admin] PATH_INFO: `/v3/users/1d8eb432780747b7a258debd14e1fd2f` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:37.452429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfe18f-7a85-4dde-a1eb-3dab2c5bfb1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d8eb432780747b7a258debd14e1fd2f)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:37.454374 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfe18f-7a85-4dde-a1eb-3dab2c5bfb1c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:37.496092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-83dfe18f-7a85-4dde-a1eb-3dab2c5bfb1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d8eb432780747b7a258debd14e1fd2f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:37.506917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-83dfe18f-7a85-4dde-a1eb-3dab2c5bfb1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d8eb432780747b7a258debd14e1fd2f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:37.513348 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-83dfe18f-7a85-4dde-a1eb-3dab2c5bfb1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d8eb432780747b7a258debd14e1fd2f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:37.514506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-83dfe18f-7a85-4dde-a1eb-3dab2c5bfb1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d8eb432780747b7a258debd14e1fd2f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:37.521449 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-83dfe18f-7a85-4dde-a1eb-3dab2c5bfb1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d8eb432780747b7a258debd14e1fd2f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:37.527105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1247/2470] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:33:37 2022] DELETE /identity/v3/users/1d8eb432780747b7a258debd14e1fd2f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:33:37.532266 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569f921-2f68-43fe-a6cd-e930ee6fbd94 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:37.532765 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569f921-2f68-43fe-a6cd-e930ee6fbd94 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:37.532861 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569f921-2f68-43fe-a6cd-e930ee6fbd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:37.549200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-a569f921-2f68-43fe-a6cd-e930ee6fbd94 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:37.550360 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a569f921-2f68-43fe-a6cd-e930ee6fbd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:37.605802 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1224/2471] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:37.615439 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe18f-7a85-4dde-a1eb-3dab2c5bfb1c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:37.616849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-83dfe18f-7a85-4dde-a1eb-3dab2c5bfb1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:37.673503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe18f-7a85-4dde-a1eb-3dab2c5bfb1c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:37.677160 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f14f3-5b0e-420c-9a7c-408ee7718607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:37.677801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f14f3-5b0e-420c-9a7c-408ee7718607 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:37.678086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f14f3-5b0e-420c-9a7c-408ee7718607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:37.678366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f14f3-5b0e-420c-9a7c-408ee7718607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:37.687856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f14f3-5b0e-420c-9a7c-408ee7718607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:37.689323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f14f3-5b0e-420c-9a7c-408ee7718607 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:37.698293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1248/2472] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:37.971753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569f921-2f68-43fe-a6cd-e930ee6fbd94 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:37.971753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a569f921-2f68-43fe-a6cd-e930ee6fbd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:37.985090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569f921-2f68-43fe-a6cd-e930ee6fbd94 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:37.990383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:37.991247 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:37.991552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:37.991793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] PATH_INFO: `/v3/projects/299ee9b3248d475faa991f39e973fe96` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:37.993110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=299ee9b3248d475faa991f39e973fe96)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:37.994920 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:38.043125 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299ee9b3248d475faa991f39e973fe96', 'request_id': 'req-06fb1731-2e5a-4543-9a55-afd4562835ba'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.051433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299ee9b3248d475faa991f39e973fe96', 'request_id': 'req-06fb1731-2e5a-4543-9a55-afd4562835ba'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.056787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299ee9b3248d475faa991f39e973fe96', 'request_id': 'req-06fb1731-2e5a-4543-9a55-afd4562835ba'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.072106 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] The token cache is being invalidate because project 299ee9b3248d475faa991f39e973fe96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:33:38.072424 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.073080 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.074655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1225/2473] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:33:37 2022] DELETE /identity/v3/projects/299ee9b3248d475faa991f39e973fe96 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:38.078976 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f14f3-5b0e-420c-9a7c-408ee7718607 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:38.088637 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f14f3-5b0e-420c-9a7c-408ee7718607 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:38.142474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc020045-5ecf-486e-8564-dc65d6253ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:38.143335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc020045-5ecf-486e-8564-dc65d6253ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:38.143619 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc020045-5ecf-486e-8564-dc65d6253ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:38.144264 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc020045-5ecf-486e-8564-dc65d6253ae9 admin admin] PATH_INFO: `/v3/users/3a3cad63db5b458396c70137bc312414` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:38.145488 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc020045-5ecf-486e-8564-dc65d6253ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3cad63db5b458396c70137bc312414)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:38.147383 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc020045-5ecf-486e-8564-dc65d6253ae9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:38.190079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc020045-5ecf-486e-8564-dc65d6253ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3cad63db5b458396c70137bc312414'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.200876 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc020045-5ecf-486e-8564-dc65d6253ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3cad63db5b458396c70137bc312414'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.207322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc020045-5ecf-486e-8564-dc65d6253ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3cad63db5b458396c70137bc312414'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.207972 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc020045-5ecf-486e-8564-dc65d6253ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3cad63db5b458396c70137bc312414'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.215011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bc020045-5ecf-486e-8564-dc65d6253ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3cad63db5b458396c70137bc312414'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.220869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1249/2474] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:33:38 2022] DELETE /identity/v3/users/3a3cad63db5b458396c70137bc312414 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:38.479911 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:38.481335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:38.494696 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb1731-2e5a-4543-9a55-afd4562835ba admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:38.550652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25d190-686b-4c10-b010-b402d9ed5781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:38.551509 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25d190-686b-4c10-b010-b402d9ed5781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:38.551788 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25d190-686b-4c10-b010-b402d9ed5781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:38.552063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25d190-686b-4c10-b010-b402d9ed5781 admin admin] PATH_INFO: `/v3/projects/1016a9832ec248c2b6ee4326814802a2` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:38.553255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25d190-686b-4c10-b010-b402d9ed5781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1016a9832ec248c2b6ee4326814802a2)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:38.555139 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25d190-686b-4c10-b010-b402d9ed5781 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:38.598550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6a25d190-686b-4c10-b010-b402d9ed5781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1016a9832ec248c2b6ee4326814802a2', 'request_id': 'req-6a25d190-686b-4c10-b010-b402d9ed5781'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.605230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6a25d190-686b-4c10-b010-b402d9ed5781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1016a9832ec248c2b6ee4326814802a2', 'request_id': 'req-6a25d190-686b-4c10-b010-b402d9ed5781'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.611318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6a25d190-686b-4c10-b010-b402d9ed5781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1016a9832ec248c2b6ee4326814802a2', 'request_id': 'req-6a25d190-686b-4c10-b010-b402d9ed5781'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.623867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6a25d190-686b-4c10-b010-b402d9ed5781 admin admin] The token cache is being invalidate because project 1016a9832ec248c2b6ee4326814802a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:33:38.624158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6a25d190-686b-4c10-b010-b402d9ed5781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.624880 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6a25d190-686b-4c10-b010-b402d9ed5781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:38.626661 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1226/2475] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:33:38 2022] DELETE /identity/v3/projects/1016a9832ec248c2b6ee4326814802a2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:38.631603 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bda0fe-850f-4cbf-8923-c9fe95edd529 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:38.632129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bda0fe-850f-4cbf-8923-c9fe95edd529 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:38.632253 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bda0fe-850f-4cbf-8923-c9fe95edd529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:38.650305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b2bda0fe-850f-4cbf-8923-c9fe95edd529 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:38.651490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b2bda0fe-850f-4cbf-8923-c9fe95edd529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:38.715166 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1250/2476] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:38.723390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdda669-ff15-4efd-a60b-9f4414bf86a5 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:38.723679 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdda669-ff15-4efd-a60b-9f4414bf86a5 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:38.723954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdda669-ff15-4efd-a60b-9f4414bf86a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:38.742218 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-ebdda669-ff15-4efd-a60b-9f4414bf86a5 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:38.743393 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ebdda669-ff15-4efd-a60b-9f4414bf86a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:38.751066 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1227/2477] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:38.755411 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bda0fe-850f-4cbf-8923-c9fe95edd529 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:38.765207 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bda0fe-850f-4cbf-8923-c9fe95edd529 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:38.769963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bee020-d3e6-49df-884d-eecca5a03595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:38.770604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bee020-d3e6-49df-884d-eecca5a03595 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:38.770882 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bee020-d3e6-49df-884d-eecca5a03595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:38.771153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bee020-d3e6-49df-884d-eecca5a03595 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:38.771868 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bee020-d3e6-49df-884d-eecca5a03595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:33:38.772176 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bee020-d3e6-49df-884d-eecca5a03595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:38.773787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bee020-d3e6-49df-884d-eecca5a03595 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:38.785550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1251/2478] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:33:38.789644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdda669-ff15-4efd-a60b-9f4414bf86a5 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:38.798519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdda669-ff15-4efd-a60b-9f4414bf86a5 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:38.803060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ca46d-da93-425b-ae45-12d36da64e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:38.803691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ca46d-da93-425b-ae45-12d36da64e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:38.803971 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ca46d-da93-425b-ae45-12d36da64e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:38.804242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ca46d-da93-425b-ae45-12d36da64e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:38.804927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ca46d-da93-425b-ae45-12d36da64e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:38.806837 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ca46d-da93-425b-ae45-12d36da64e25 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:38.840250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1228/2479] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:33:38 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:38.844890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bee020-d3e6-49df-884d-eecca5a03595 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:38.854634 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bee020-d3e6-49df-884d-eecca5a03595 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:38.908622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050a13e-7f41-4f13-8dbd-2898bc1af331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:38.909312 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050a13e-7f41-4f13-8dbd-2898bc1af331 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:38.909629 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050a13e-7f41-4f13-8dbd-2898bc1af331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:38.909906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050a13e-7f41-4f13-8dbd-2898bc1af331 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:38.910592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050a13e-7f41-4f13-8dbd-2898bc1af331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:38.912498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1050a13e-7f41-4f13-8dbd-2898bc1af331 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:38.931746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1252/2480] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:33:38 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:33:38.935766 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ca46d-da93-425b-ae45-12d36da64e25 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:38.945739 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ca46d-da93-425b-ae45-12d36da64e25 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:38.950423 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291ab97-cf90-4f76-9451-0bcb7fc99c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:38.951645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ab97-cf90-4f76-9451-0bcb7fc99c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:38.951914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ab97-cf90-4f76-9451-0bcb7fc99c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:38.952194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ab97-cf90-4f76-9451-0bcb7fc99c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:38.952922 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291ab97-cf90-4f76-9451-0bcb7fc99c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:38.954541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291ab97-cf90-4f76-9451-0bcb7fc99c00 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:38.967904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1229/2481] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:38.972165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050a13e-7f41-4f13-8dbd-2898bc1af331 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:38.982193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050a13e-7f41-4f13-8dbd-2898bc1af331 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:38.987310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0899d8-ac8d-416c-a5c6-df7b0a80910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:38.987975 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0899d8-ac8d-416c-a5c6-df7b0a80910e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:38.988257 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0899d8-ac8d-416c-a5c6-df7b0a80910e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:38.988661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0899d8-ac8d-416c-a5c6-df7b0a80910e admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:38.989435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0899d8-ac8d-416c-a5c6-df7b0a80910e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:38.991041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0899d8-ac8d-416c-a5c6-df7b0a80910e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:39.004010 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1253/2482] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:39.005326 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291ab97-cf90-4f76-9451-0bcb7fc99c00 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:39.019236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291ab97-cf90-4f76-9451-0bcb7fc99c00 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:39.025111 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51783ae2-ec4e-4e47-b013-1da1a9bc5621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:39.026253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51783ae2-ec4e-4e47-b013-1da1a9bc5621 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.026538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51783ae2-ec4e-4e47-b013-1da1a9bc5621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.026817 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51783ae2-ec4e-4e47-b013-1da1a9bc5621 admin admin] PATH_INFO: `/v3/projects/a5152ac8f53e4ef7910f9e542ce7e9bf/users/4dbdddbe3f42488aa9d462aafb647846/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:39.042438 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51783ae2-ec4e-4e47-b013-1da1a9bc5621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5152ac8f53e4ef7910f9e542ce7e9bf, user_id=4dbdddbe3f42488aa9d462aafb647846, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:39.045150 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51783ae2-ec4e-4e47-b013-1da1a9bc5621 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:39.058222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1230/2483] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:33:39 2022] PUT /identity/v3/projects/a5152ac8f53e4ef7910f9e542ce7e9bf/users/4dbdddbe3f42488aa9d462aafb647846/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:39.068408 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308c41-6121-48f4-8503-2e0e5c6b2dd8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.068925 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308c41-6121-48f4-8503-2e0e5c6b2dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.069308 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308c41-6121-48f4-8503-2e0e5c6b2dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:39.096522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ad308c41-6121-48f4-8503-2e0e5c6b2dd8 None None] MFA Rules not processed for user `4dbdddbe3f42488aa9d462aafb647846`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:39.097776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ad308c41-6121-48f4-8503-2e0e5c6b2dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:39.161151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1254/2484] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:39.165542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51783ae2-ec4e-4e47-b013-1da1a9bc5621 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:39.224917 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51783ae2-ec4e-4e47-b013-1da1a9bc5621 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:39.229646 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c08577-b462-4c79-b104-08d84ebc223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:39.230297 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c08577-b462-4c79-b104-08d84ebc223e admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.230580 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c08577-b462-4c79-b104-08d84ebc223e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.230855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c08577-b462-4c79-b104-08d84ebc223e admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:39.231536 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c08577-b462-4c79-b104-08d84ebc223e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:39.233527 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c08577-b462-4c79-b104-08d84ebc223e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:39.257765 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1231/2485] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:33:39 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:39.261694 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad308c41-6121-48f4-8503-2e0e5c6b2dd8 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:39.277537 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad308c41-6121-48f4-8503-2e0e5c6b2dd8 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:39.334108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb8862-6a44-4367-b62d-f37ffa39799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:39.334782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb8862-6a44-4367-b62d-f37ffa39799a admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.335067 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb8862-6a44-4367-b62d-f37ffa39799a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.335344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb8862-6a44-4367-b62d-f37ffa39799a admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:39.336071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb8862-6a44-4367-b62d-f37ffa39799a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:39.338062 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb8862-6a44-4367-b62d-f37ffa39799a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:39.357395 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1255/2486] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:33:39 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:39.361496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c08577-b462-4c79-b104-08d84ebc223e admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:39.371651 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c08577-b462-4c79-b104-08d84ebc223e admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:39.376740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916adbfd-22a5-404a-b850-08708a781e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:39.377424 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916adbfd-22a5-404a-b850-08708a781e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.377707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916adbfd-22a5-404a-b850-08708a781e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.377983 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916adbfd-22a5-404a-b850-08708a781e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:39.378699 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916adbfd-22a5-404a-b850-08708a781e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:39.380279 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916adbfd-22a5-404a-b850-08708a781e3d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:39.391168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1232/2487] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:39.395533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb8862-6a44-4367-b62d-f37ffa39799a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:39.405312 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb8862-6a44-4367-b62d-f37ffa39799a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:39.409886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd60bf-a383-4655-9feb-f47ad90c57ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:39.410538 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd60bf-a383-4655-9feb-f47ad90c57ab admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.410818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd60bf-a383-4655-9feb-f47ad90c57ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.411091 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd60bf-a383-4655-9feb-f47ad90c57ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:39.411814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd60bf-a383-4655-9feb-f47ad90c57ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:39.413434 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd60bf-a383-4655-9feb-f47ad90c57ab admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:39.423197 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1256/2488] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:39.426973 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916adbfd-22a5-404a-b850-08708a781e3d admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:39.437864 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916adbfd-22a5-404a-b850-08708a781e3d admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:39.442499 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4f07b-c86a-4776-89aa-97e4aad11ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:39.443371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4f07b-c86a-4776-89aa-97e4aad11ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.443656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4f07b-c86a-4776-89aa-97e4aad11ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.443932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4f07b-c86a-4776-89aa-97e4aad11ddf admin admin] PATH_INFO: `/v3/projects/458e2824768a4446971c805bf1c72dc7/users/0a8669e7ec5a4e82b176d86139847306/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:39.458409 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4f07b-c86a-4776-89aa-97e4aad11ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=458e2824768a4446971c805bf1c72dc7, user_id=0a8669e7ec5a4e82b176d86139847306, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:39.461075 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4f07b-c86a-4776-89aa-97e4aad11ddf admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:39.473763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1233/2489] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:33:39 2022] PUT /identity/v3/projects/458e2824768a4446971c805bf1c72dc7/users/0a8669e7ec5a4e82b176d86139847306/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:33:39.484706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52decb4-09c2-4005-a0c2-0ae4c3b9424f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.485022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52decb4-09c2-4005-a0c2-0ae4c3b9424f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.485310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52decb4-09c2-4005-a0c2-0ae4c3b9424f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:39.511691 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-d52decb4-09c2-4005-a0c2-0ae4c3b9424f None None] MFA Rules not processed for user `0a8669e7ec5a4e82b176d86139847306`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:39.512884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d52decb4-09c2-4005-a0c2-0ae4c3b9424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:39.577336 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1257/2490] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:39.581751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4f07b-c86a-4776-89aa-97e4aad11ddf admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:39.640808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4f07b-c86a-4776-89aa-97e4aad11ddf admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:39.645698 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42afec9-2284-42f9-9d2d-80836d0a063e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:39.646342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42afec9-2284-42f9-9d2d-80836d0a063e admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.646623 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42afec9-2284-42f9-9d2d-80836d0a063e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.646894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42afec9-2284-42f9-9d2d-80836d0a063e admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:39.647565 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42afec9-2284-42f9-9d2d-80836d0a063e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:39.649474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42afec9-2284-42f9-9d2d-80836d0a063e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:39.674717 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1234/2491] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:33:39 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:39.678622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52decb4-09c2-4005-a0c2-0ae4c3b9424f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:39.689978 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52decb4-09c2-4005-a0c2-0ae4c3b9424f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:39.745176 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88a2c6-f183-4c61-88a8-dc7236e29c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:39.745841 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88a2c6-f183-4c61-88a8-dc7236e29c79 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.746123 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88a2c6-f183-4c61-88a8-dc7236e29c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.746397 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88a2c6-f183-4c61-88a8-dc7236e29c79 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:39.747079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88a2c6-f183-4c61-88a8-dc7236e29c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:39.749705 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88a2c6-f183-4c61-88a8-dc7236e29c79 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:39.768299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1258/2492] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:33:39 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:39.772669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42afec9-2284-42f9-9d2d-80836d0a063e admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:39.782807 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42afec9-2284-42f9-9d2d-80836d0a063e admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:39.787495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72916f-7216-4778-9caf-03b5779b3a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:39.788145 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72916f-7216-4778-9caf-03b5779b3a22 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.788436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72916f-7216-4778-9caf-03b5779b3a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.788716 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72916f-7216-4778-9caf-03b5779b3a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:39.789511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72916f-7216-4778-9caf-03b5779b3a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:39.791097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72916f-7216-4778-9caf-03b5779b3a22 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:39.802783 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1235/2493] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:39.806745 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88a2c6-f183-4c61-88a8-dc7236e29c79 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:39.817140 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88a2c6-f183-4c61-88a8-dc7236e29c79 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:39.821620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff19dca-646b-46c7-b56b-b7210022bf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:39.822481 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff19dca-646b-46c7-b56b-b7210022bf4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.822788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff19dca-646b-46c7-b56b-b7210022bf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.823059 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff19dca-646b-46c7-b56b-b7210022bf4c admin admin] PATH_INFO: `/v3/projects/16e3430cbc58496d89ca81b3a77cc442/users/0df1facf76344bc4b2362712d7cbd52a/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:39.837196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff19dca-646b-46c7-b56b-b7210022bf4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e3430cbc58496d89ca81b3a77cc442, user_id=0df1facf76344bc4b2362712d7cbd52a, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:39.839956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff19dca-646b-46c7-b56b-b7210022bf4c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:39.851595 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1259/2494] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:33:39 2022] PUT /identity/v3/projects/16e3430cbc58496d89ca81b3a77cc442/users/0df1facf76344bc4b2362712d7cbd52a/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:39.855588 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72916f-7216-4778-9caf-03b5779b3a22 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:39.865696 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72916f-7216-4778-9caf-03b5779b3a22 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:39.921165 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88e530-fbf1-4ba1-875f-1e016f6584b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:39.921775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88e530-fbf1-4ba1-875f-1e016f6584b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.922056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88e530-fbf1-4ba1-875f-1e016f6584b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.922330 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88e530-fbf1-4ba1-875f-1e016f6584b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:39.923052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88e530-fbf1-4ba1-875f-1e016f6584b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:39.924656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88e530-fbf1-4ba1-875f-1e016f6584b8 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:39.937811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1236/2495] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:39.938960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff19dca-646b-46c7-b56b-b7210022bf4c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:39.948803 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff19dca-646b-46c7-b56b-b7210022bf4c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:39.953366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4565222-54b6-4b8d-adb9-4b79b0347e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:39.954228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4565222-54b6-4b8d-adb9-4b79b0347e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.954510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4565222-54b6-4b8d-adb9-4b79b0347e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.954782 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4565222-54b6-4b8d-adb9-4b79b0347e43 admin admin] PATH_INFO: `/v3/projects/16e3430cbc58496d89ca81b3a77cc442/users/0df1facf76344bc4b2362712d7cbd52a/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:39.956715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4565222-54b6-4b8d-adb9-4b79b0347e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16e3430cbc58496d89ca81b3a77cc442, user_id=0df1facf76344bc4b2362712d7cbd52a, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:39.959358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4565222-54b6-4b8d-adb9-4b79b0347e43 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:39.969533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1260/2496] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:33:39 2022] PUT /identity/v3/projects/16e3430cbc58496d89ca81b3a77cc442/users/0df1facf76344bc4b2362712d7cbd52a/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:39.979741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3c85c-33c2-4ac6-869b-3997d4525795 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:39.980031 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3c85c-33c2-4ac6-869b-3997d4525795 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:39.980311 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3c85c-33c2-4ac6-869b-3997d4525795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:40.006179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-3bb3c85c-33c2-4ac6-869b-3997d4525795 None None] MFA Rules not processed for user `0df1facf76344bc4b2362712d7cbd52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:40.007364 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3bb3c85c-33c2-4ac6-869b-3997d4525795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:40.073236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1237/2497] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:33:40.086478 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4565222-54b6-4b8d-adb9-4b79b0347e43 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:40.093264 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d4565222-54b6-4b8d-adb9-4b79b0347e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:40.153165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4565222-54b6-4b8d-adb9-4b79b0347e43 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:40.157331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b65a6-e26a-41fa-91bc-80b0ad306465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:40.157971 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b65a6-e26a-41fa-91bc-80b0ad306465 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:40.158248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b65a6-e26a-41fa-91bc-80b0ad306465 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:40.158522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b65a6-e26a-41fa-91bc-80b0ad306465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:40.167393 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b65a6-e26a-41fa-91bc-80b0ad306465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:40.168814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b65a6-e26a-41fa-91bc-80b0ad306465 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:40.179026 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1261/2498] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:40.657422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3c85c-33c2-4ac6-869b-3997d4525795 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:40.666727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3c85c-33c2-4ac6-869b-3997d4525795 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:40.671112 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db733329-459d-4124-bbe0-5faaedbee59c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:40.671747 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db733329-459d-4124-bbe0-5faaedbee59c service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:40.672056 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db733329-459d-4124-bbe0-5faaedbee59c service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:40.672329 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db733329-459d-4124-bbe0-5faaedbee59c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:40.728563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db733329-459d-4124-bbe0-5faaedbee59c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:40.729965 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db733329-459d-4124-bbe0-5faaedbee59c service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:40.739550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1238/2499] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:44.701112 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b65a6-e26a-41fa-91bc-80b0ad306465 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:44.702567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a04b65a6-e26a-41fa-91bc-80b0ad306465 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:44.714200 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b65a6-e26a-41fa-91bc-80b0ad306465 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:44.718413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc1163-d930-48bd-af91-cc746d9d6ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:44.719066 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1163-d930-48bd-af91-cc746d9d6ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:44.719344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1163-d930-48bd-af91-cc746d9d6ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:44.719621 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1163-d930-48bd-af91-cc746d9d6ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:44.780543 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc1163-d930-48bd-af91-cc746d9d6ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:44.782324 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc1163-d930-48bd-af91-cc746d9d6ac6 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:44.799275 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1262/2500] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:46.884794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db733329-459d-4124-bbe0-5faaedbee59c service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:46.950001 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db733329-459d-4124-bbe0-5faaedbee59c service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:46.955185 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9f713-2c28-4d6c-8b91-4d83aeff9182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:46.956052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9f713-2c28-4d6c-8b91-4d83aeff9182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:46.956341 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9f713-2c28-4d6c-8b91-4d83aeff9182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:46.956620 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9f713-2c28-4d6c-8b91-4d83aeff9182 admin admin] PATH_INFO: `/v3/users/4dbdddbe3f42488aa9d462aafb647846` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:46.957858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9f713-2c28-4d6c-8b91-4d83aeff9182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbdddbe3f42488aa9d462aafb647846)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:46.960607 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9f713-2c28-4d6c-8b91-4d83aeff9182 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:47.021704 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-54a9f713-2c28-4d6c-8b91-4d83aeff9182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbdddbe3f42488aa9d462aafb647846'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:47.024958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-54a9f713-2c28-4d6c-8b91-4d83aeff9182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbdddbe3f42488aa9d462aafb647846'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:47.047332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-54a9f713-2c28-4d6c-8b91-4d83aeff9182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbdddbe3f42488aa9d462aafb647846'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:47.061813 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-54a9f713-2c28-4d6c-8b91-4d83aeff9182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbdddbe3f42488aa9d462aafb647846'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:47.071161 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-54a9f713-2c28-4d6c-8b91-4d83aeff9182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbdddbe3f42488aa9d462aafb647846'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:47.082026 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1239/2501] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:33:46 2022] DELETE /identity/v3/users/4dbdddbe3f42488aa9d462aafb647846 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:47.088688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0d086-31e5-4107-a211-44f1f81def46 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:47.089742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0d086-31e5-4107-a211-44f1f81def46 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:47.090278 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0d086-31e5-4107-a211-44f1f81def46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:47.115976 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-cdb0d086-31e5-4107-a211-44f1f81def46 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:47.117920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cdb0d086-31e5-4107-a211-44f1f81def46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:47.146017 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9f713-2c28-4d6c-8b91-4d83aeff9182 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:47.147595 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-54a9f713-2c28-4d6c-8b91-4d83aeff9182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:47.225525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1263/2502] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:47.226954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc872a-f685-4152-b89d-e9c8a93290dd None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:47.227241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc872a-f685-4152-b89d-e9c8a93290dd None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:47.227690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc872a-f685-4152-b89d-e9c8a93290dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:47.252158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9f713-2c28-4d6c-8b91-4d83aeff9182 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:47.255387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-05bc872a-f685-4152-b89d-e9c8a93290dd None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:47.256857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-05bc872a-f685-4152-b89d-e9c8a93290dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:47.259342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f6474-5827-4b91-a374-91e2d9465c29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:47.260627 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f6474-5827-4b91-a374-91e2d9465c29 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:47.261401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f6474-5827-4b91-a374-91e2d9465c29 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:47.261689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f6474-5827-4b91-a374-91e2d9465c29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:47.263641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-998f6474-5827-4b91-a374-91e2d9465c29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:47.280759 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f6474-5827-4b91-a374-91e2d9465c29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:47.282540 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f6474-5827-4b91-a374-91e2d9465c29 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:47.296482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1240/2503] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:33:47.297703 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f6474-5827-4b91-a374-91e2d9465c29 service nova] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:47.298964 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-998f6474-5827-4b91-a374-91e2d9465c29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:47.342156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1264/2504] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:33:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:47.361346 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc872a-f685-4152-b89d-e9c8a93290dd None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:47.362745 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-05bc872a-f685-4152-b89d-e9c8a93290dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:47.391853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f6474-5827-4b91-a374-91e2d9465c29 service nova] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:47.402639 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2368197-1f42-4283-b710-838218a3cce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:47.403475 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2368197-1f42-4283-b710-838218a3cce5 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:47.404403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2368197-1f42-4283-b710-838218a3cce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:47.404784 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2368197-1f42-4283-b710-838218a3cce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:47.421938 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2368197-1f42-4283-b710-838218a3cce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:47.423583 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2368197-1f42-4283-b710-838218a3cce5 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:47.436501 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1241/2505] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:47.451007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc872a-f685-4152-b89d-e9c8a93290dd None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:47.456282 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dac89-2238-44e0-82da-46aff7d90817 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:47.456945 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dac89-2238-44e0-82da-46aff7d90817 service swift] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:47.457259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dac89-2238-44e0-82da-46aff7d90817 service swift] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:47.457537 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dac89-2238-44e0-82da-46aff7d90817 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:47.465869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dac89-2238-44e0-82da-46aff7d90817 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:47.468039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dac89-2238-44e0-82da-46aff7d90817 service swift] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:47.476820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1265/2506] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:33:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 20:33:48.040365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2368197-1f42-4283-b710-838218a3cce5 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:48.041839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a2368197-1f42-4283-b710-838218a3cce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:48.061312 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2368197-1f42-4283-b710-838218a3cce5 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:48.067363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:48.068459 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:48.068963 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:48.069408 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] PATH_INFO: `/v3/projects/a5152ac8f53e4ef7910f9e542ce7e9bf` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:48.071187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5152ac8f53e4ef7910f9e542ce7e9bf)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:48.073663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:48.177072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5152ac8f53e4ef7910f9e542ce7e9bf', 'request_id': 'req-33a267b4-5600-4b13-a5ab-bbd859bf29d1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:48.191268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5152ac8f53e4ef7910f9e542ce7e9bf', 'request_id': 'req-33a267b4-5600-4b13-a5ab-bbd859bf29d1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:48.209436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5152ac8f53e4ef7910f9e542ce7e9bf', 'request_id': 'req-33a267b4-5600-4b13-a5ab-bbd859bf29d1'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:48.247451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] The token cache is being invalidate because project a5152ac8f53e4ef7910f9e542ce7e9bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:33:48.254404 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:48.255027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:48.264385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1242/2507] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:33:48 2022] DELETE /identity/v3/projects/a5152ac8f53e4ef7910f9e542ce7e9bf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:48.265643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dac89-2238-44e0-82da-46aff7d90817 service swift] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:48.282769 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dac89-2238-44e0-82da-46aff7d90817 service swift] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:48.456594 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d0905-b9fb-49a4-a22d-6a437975476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:48.458078 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d0905-b9fb-49a4-a22d-6a437975476a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:48.458537 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d0905-b9fb-49a4-a22d-6a437975476a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:48.458971 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d0905-b9fb-49a4-a22d-6a437975476a admin admin] PATH_INFO: `/v3/users/0a8669e7ec5a4e82b176d86139847306` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:48.461063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d0905-b9fb-49a4-a22d-6a437975476a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8669e7ec5a4e82b176d86139847306)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:48.463676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d0905-b9fb-49a4-a22d-6a437975476a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:48.529313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-103d0905-b9fb-49a4-a22d-6a437975476a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8669e7ec5a4e82b176d86139847306'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:48.543302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-103d0905-b9fb-49a4-a22d-6a437975476a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8669e7ec5a4e82b176d86139847306'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:48.551626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-103d0905-b9fb-49a4-a22d-6a437975476a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8669e7ec5a4e82b176d86139847306'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:48.552697 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-103d0905-b9fb-49a4-a22d-6a437975476a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8669e7ec5a4e82b176d86139847306'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:48.562674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-103d0905-b9fb-49a4-a22d-6a437975476a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8669e7ec5a4e82b176d86139847306'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:48.572884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1266/2508] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:33:48 2022] DELETE /identity/v3/users/0a8669e7ec5a4e82b176d86139847306 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:49.009110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:49.010670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:49.033639 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a267b4-5600-4b13-a5ab-bbd859bf29d1 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:49.134408 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:49.136433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:49.136945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:49.137476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] PATH_INFO: `/v3/projects/458e2824768a4446971c805bf1c72dc7` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:49.139705 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] RBAC: Authorizing `identity:delete_project(project_id=458e2824768a4446971c805bf1c72dc7)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:49.141904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:49.234223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458e2824768a4446971c805bf1c72dc7', 'request_id': 'req-ca4556e7-92f1-473d-b721-1e8db5ef801e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:49.257088 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458e2824768a4446971c805bf1c72dc7', 'request_id': 'req-ca4556e7-92f1-473d-b721-1e8db5ef801e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:49.265164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458e2824768a4446971c805bf1c72dc7', 'request_id': 'req-ca4556e7-92f1-473d-b721-1e8db5ef801e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:49.277250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] The token cache is being invalidate because project 458e2824768a4446971c805bf1c72dc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:33:49.277622 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:49.278215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:49.280283 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1243/2509] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:33:49 2022] DELETE /identity/v3/projects/458e2824768a4446971c805bf1c72dc7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:49.284250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d0905-b9fb-49a4-a22d-6a437975476a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:49.286312 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-103d0905-b9fb-49a4-a22d-6a437975476a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:49.301954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d0905-b9fb-49a4-a22d-6a437975476a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:49.386239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce664f-42d4-4516-bd72-841186392713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:49.387312 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce664f-42d4-4516-bd72-841186392713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:49.387677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce664f-42d4-4516-bd72-841186392713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:49.388114 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce664f-42d4-4516-bd72-841186392713 admin admin] PATH_INFO: `/v3/users/0df1facf76344bc4b2362712d7cbd52a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:49.389777 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce664f-42d4-4516-bd72-841186392713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df1facf76344bc4b2362712d7cbd52a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:49.392146 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce664f-42d4-4516-bd72-841186392713 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:49.451254 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6dce664f-42d4-4516-bd72-841186392713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df1facf76344bc4b2362712d7cbd52a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:49.471823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6dce664f-42d4-4516-bd72-841186392713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df1facf76344bc4b2362712d7cbd52a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:49.479828 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6dce664f-42d4-4516-bd72-841186392713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df1facf76344bc4b2362712d7cbd52a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:49.480687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6dce664f-42d4-4516-bd72-841186392713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df1facf76344bc4b2362712d7cbd52a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:49.500027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6dce664f-42d4-4516-bd72-841186392713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df1facf76344bc4b2362712d7cbd52a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:49.507948 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1267/2510] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:33:49 2022] DELETE /identity/v3/users/0df1facf76344bc4b2362712d7cbd52a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:50.015797 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:50.017552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:50.043863 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4556e7-92f1-473d-b721-1e8db5ef801e admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:50.157469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c433c8-707c-4fd6-89ea-95eba78ddace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:50.158491 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c433c8-707c-4fd6-89ea-95eba78ddace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:50.158879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c433c8-707c-4fd6-89ea-95eba78ddace admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:50.161482 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c433c8-707c-4fd6-89ea-95eba78ddace admin admin] PATH_INFO: `/v3/projects/16e3430cbc58496d89ca81b3a77cc442` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:50.164548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c433c8-707c-4fd6-89ea-95eba78ddace admin admin] RBAC: Authorizing `identity:delete_project(project_id=16e3430cbc58496d89ca81b3a77cc442)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:50.166885 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c433c8-707c-4fd6-89ea-95eba78ddace admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:50.238551 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-20c433c8-707c-4fd6-89ea-95eba78ddace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e3430cbc58496d89ca81b3a77cc442', 'request_id': 'req-20c433c8-707c-4fd6-89ea-95eba78ddace'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:50.266637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-20c433c8-707c-4fd6-89ea-95eba78ddace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e3430cbc58496d89ca81b3a77cc442', 'request_id': 'req-20c433c8-707c-4fd6-89ea-95eba78ddace'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:50.278477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-20c433c8-707c-4fd6-89ea-95eba78ddace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e3430cbc58496d89ca81b3a77cc442', 'request_id': 'req-20c433c8-707c-4fd6-89ea-95eba78ddace'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:50.292294 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-20c433c8-707c-4fd6-89ea-95eba78ddace admin admin] The token cache is being invalidate because project 16e3430cbc58496d89ca81b3a77cc442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:33:50.292836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-20c433c8-707c-4fd6-89ea-95eba78ddace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:50.293645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-20c433c8-707c-4fd6-89ea-95eba78ddace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:50.300812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1244/2511] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:33:50 2022] DELETE /identity/v3/projects/16e3430cbc58496d89ca81b3a77cc442 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:50.311042 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f42bb-3849-4c63-9887-8b7112ce1f6b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:50.311610 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f42bb-3849-4c63-9887-8b7112ce1f6b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:50.311610 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f42bb-3849-4c63-9887-8b7112ce1f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:50.340869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-e51f42bb-3849-4c63-9887-8b7112ce1f6b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:50.342749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e51f42bb-3849-4c63-9887-8b7112ce1f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:50.429137 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1268/2512] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:50.432764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1e7ed-4f90-4b7a-bf42-2935d2629cc0 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:50.433148 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1e7ed-4f90-4b7a-bf42-2935d2629cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:50.433448 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1e7ed-4f90-4b7a-bf42-2935d2629cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:50.465892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-f2b1e7ed-4f90-4b7a-bf42-2935d2629cc0 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:50.467648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f2b1e7ed-4f90-4b7a-bf42-2935d2629cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:50.503324 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1245/2513] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:50.504792 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f42bb-3849-4c63-9887-8b7112ce1f6b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:50.520393 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f42bb-3849-4c63-9887-8b7112ce1f6b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:50.526074 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6e887-07a0-4c64-b70f-a267127314e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:50.526811 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6e887-07a0-4c64-b70f-a267127314e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:50.527094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6e887-07a0-4c64-b70f-a267127314e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:50.527367 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6e887-07a0-4c64-b70f-a267127314e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:50.528418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6e887-07a0-4c64-b70f-a267127314e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:33:50.529291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6e887-07a0-4c64-b70f-a267127314e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:50.530990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6e887-07a0-4c64-b70f-a267127314e5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:50.549021 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1269/2514] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:33:50.553121 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1e7ed-4f90-4b7a-bf42-2935d2629cc0 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:50.567634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1e7ed-4f90-4b7a-bf42-2935d2629cc0 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:50.576181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52f598-935b-4103-bf01-fe5283af49f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:50.576860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52f598-935b-4103-bf01-fe5283af49f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:50.577175 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52f598-935b-4103-bf01-fe5283af49f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:50.577454 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52f598-935b-4103-bf01-fe5283af49f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:50.578149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52f598-935b-4103-bf01-fe5283af49f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:50.580151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52f598-935b-4103-bf01-fe5283af49f7 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:50.619545 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1246/2515] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:33:50 2022] POST /identity/v3/projects => generated 393 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:50.621341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6e887-07a0-4c64-b70f-a267127314e5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:50.633865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6e887-07a0-4c64-b70f-a267127314e5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:50.713472 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8df6f-eb79-4782-908a-21b93920c5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:50.714483 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8df6f-eb79-4782-908a-21b93920c5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:50.714773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8df6f-eb79-4782-908a-21b93920c5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:50.715052 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8df6f-eb79-4782-908a-21b93920c5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:50.715775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8df6f-eb79-4782-908a-21b93920c5b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:50.720137 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8df6f-eb79-4782-908a-21b93920c5b6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:50.746276 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1270/2516] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:33:50 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:50.750495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52f598-935b-4103-bf01-fe5283af49f7 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:50.761855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52f598-935b-4103-bf01-fe5283af49f7 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:50.769726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd338473-1d92-49a8-8676-d6c8f2e75382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:50.770475 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd338473-1d92-49a8-8676-d6c8f2e75382 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:50.770689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd338473-1d92-49a8-8676-d6c8f2e75382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:50.770978 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd338473-1d92-49a8-8676-d6c8f2e75382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:50.771717 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd338473-1d92-49a8-8676-d6c8f2e75382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:50.773421 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd338473-1d92-49a8-8676-d6c8f2e75382 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:50.790727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1247/2517] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:50.792042 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8df6f-eb79-4782-908a-21b93920c5b6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:50.802404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8df6f-eb79-4782-908a-21b93920c5b6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:50.808886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c19213-ab52-4620-a82c-b7672209e58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:50.809438 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19213-ab52-4620-a82c-b7672209e58a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:50.809809 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19213-ab52-4620-a82c-b7672209e58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:50.810295 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c19213-ab52-4620-a82c-b7672209e58a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:50.811213 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c19213-ab52-4620-a82c-b7672209e58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:50.813481 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c19213-ab52-4620-a82c-b7672209e58a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:50.824932 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1271/2518] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:50.831101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd338473-1d92-49a8-8676-d6c8f2e75382 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:50.843451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd338473-1d92-49a8-8676-d6c8f2e75382 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:50.854689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a25ce4-f773-408a-9f86-102a8d64d92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:50.856779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a25ce4-f773-408a-9f86-102a8d64d92c admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:50.856779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a25ce4-f773-408a-9f86-102a8d64d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:50.856779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a25ce4-f773-408a-9f86-102a8d64d92c admin admin] PATH_INFO: `/v3/projects/fd1fccded2e744e584e28806c68f6ce3/users/b78a4c3f2fc24bd894b2c5dc534e48c5/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:50.876520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a25ce4-f773-408a-9f86-102a8d64d92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd1fccded2e744e584e28806c68f6ce3, user_id=b78a4c3f2fc24bd894b2c5dc534e48c5, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:50.879275 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a25ce4-f773-408a-9f86-102a8d64d92c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:50.917289 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1248/2519] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:33:50 2022] PUT /identity/v3/projects/fd1fccded2e744e584e28806c68f6ce3/users/b78a4c3f2fc24bd894b2c5dc534e48c5/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:50.921478 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eed8bb-45dc-4f48-9a94-0c17171b94d0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:50.922084 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eed8bb-45dc-4f48-9a94-0c17171b94d0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:50.922565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eed8bb-45dc-4f48-9a94-0c17171b94d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:50.977952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-09eed8bb-45dc-4f48-9a94-0c17171b94d0 None None] MFA Rules not processed for user `b78a4c3f2fc24bd894b2c5dc534e48c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:50.979209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-09eed8bb-45dc-4f48-9a94-0c17171b94d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:51.057814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1272/2520] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:51.062810 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a25ce4-f773-408a-9f86-102a8d64d92c admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:51.154863 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a25ce4-f773-408a-9f86-102a8d64d92c admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:51.163367 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2219ad9-7b28-4850-9267-a93bd89bec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:51.164353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2219ad9-7b28-4850-9267-a93bd89bec40 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:51.164719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2219ad9-7b28-4850-9267-a93bd89bec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:51.165237 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2219ad9-7b28-4850-9267-a93bd89bec40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:51.166038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2219ad9-7b28-4850-9267-a93bd89bec40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:51.175841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2219ad9-7b28-4850-9267-a93bd89bec40 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:51.226628 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1249/2521] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:33:51 2022] POST /identity/v3/projects => generated 391 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:51.230455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eed8bb-45dc-4f48-9a94-0c17171b94d0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:51.260647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eed8bb-45dc-4f48-9a94-0c17171b94d0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:51.411661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ad07b-ee2b-4ae6-b5bf-6aa1ba37ed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:51.414725 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ad07b-ee2b-4ae6-b5bf-6aa1ba37ed80 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:51.415301 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ad07b-ee2b-4ae6-b5bf-6aa1ba37ed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:51.415805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ad07b-ee2b-4ae6-b5bf-6aa1ba37ed80 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:51.416760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ad07b-ee2b-4ae6-b5bf-6aa1ba37ed80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:51.419278 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ad07b-ee2b-4ae6-b5bf-6aa1ba37ed80 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:51.455577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1273/2522] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:33:51 2022] POST /identity/v3/users => generated 302 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:33:51.459492 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2219ad9-7b28-4850-9267-a93bd89bec40 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:51.543517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2219ad9-7b28-4850-9267-a93bd89bec40 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:51.561040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba34b56-4ece-4e8d-b518-9312340805fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:51.561417 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba34b56-4ece-4e8d-b518-9312340805fa admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:51.561595 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba34b56-4ece-4e8d-b518-9312340805fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:51.561860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba34b56-4ece-4e8d-b518-9312340805fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:51.562612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba34b56-4ece-4e8d-b518-9312340805fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:51.564248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba34b56-4ece-4e8d-b518-9312340805fa admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:51.590863 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1250/2523] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:51.599363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ad07b-ee2b-4ae6-b5bf-6aa1ba37ed80 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:51.631385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ad07b-ee2b-4ae6-b5bf-6aa1ba37ed80 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:51.662615 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3efc26-15d8-46a9-85b7-8da56f6f9000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:51.663635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3efc26-15d8-46a9-85b7-8da56f6f9000 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:51.664013 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3efc26-15d8-46a9-85b7-8da56f6f9000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:51.665272 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3efc26-15d8-46a9-85b7-8da56f6f9000 admin admin] PATH_INFO: `/v3/projects/799ffb45f1464e5687c36cb728fc9816/users/901dd54b2c064c1bbe38fe48b09766fe/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:51.723554 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3efc26-15d8-46a9-85b7-8da56f6f9000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=799ffb45f1464e5687c36cb728fc9816, user_id=901dd54b2c064c1bbe38fe48b09766fe, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:51.728500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3efc26-15d8-46a9-85b7-8da56f6f9000 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:51.758618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1274/2524] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:33:51 2022] PUT /identity/v3/projects/799ffb45f1464e5687c36cb728fc9816/users/901dd54b2c064c1bbe38fe48b09766fe/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:33:51.763436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba34b56-4ece-4e8d-b518-9312340805fa admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:51.784197 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba34b56-4ece-4e8d-b518-9312340805fa admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:51.868233 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a7794-e8db-460e-aa7a-5e649569cc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:51.868927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a7794-e8db-460e-aa7a-5e649569cc12 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:51.869347 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a7794-e8db-460e-aa7a-5e649569cc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:51.869631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a7794-e8db-460e-aa7a-5e649569cc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:51.870535 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a7794-e8db-460e-aa7a-5e649569cc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:51.873681 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a7794-e8db-460e-aa7a-5e649569cc12 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:51.893745 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3efc26-15d8-46a9-85b7-8da56f6f9000 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:51.901190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1251/2525] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:33:51.922581 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3efc26-15d8-46a9-85b7-8da56f6f9000 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:51.928670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dd1e8-797c-4c2a-b658-2d8e2fbd0b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:51.929611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dd1e8-797c-4c2a-b658-2d8e2fbd0b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:51.929895 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dd1e8-797c-4c2a-b658-2d8e2fbd0b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:51.930385 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dd1e8-797c-4c2a-b658-2d8e2fbd0b31 admin admin] PATH_INFO: `/v3/projects/799ffb45f1464e5687c36cb728fc9816/users/901dd54b2c064c1bbe38fe48b09766fe/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:51.945428 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dd1e8-797c-4c2a-b658-2d8e2fbd0b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=799ffb45f1464e5687c36cb728fc9816, user_id=901dd54b2c064c1bbe38fe48b09766fe, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:51.953608 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76dd1e8-797c-4c2a-b658-2d8e2fbd0b31 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:52.001499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1275/2526] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:33:51 2022] PUT /identity/v3/projects/799ffb45f1464e5687c36cb728fc9816/users/901dd54b2c064c1bbe38fe48b09766fe/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:52.003319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac84a79-a21b-465d-beb4-85f50839e0cc None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:52.003789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac84a79-a21b-465d-beb4-85f50839e0cc None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:52.004076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac84a79-a21b-465d-beb4-85f50839e0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:52.064049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-1ac84a79-a21b-465d-beb4-85f50839e0cc None None] MFA Rules not processed for user `901dd54b2c064c1bbe38fe48b09766fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:52.065524 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-1ac84a79-a21b-465d-beb4-85f50839e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:52.169933 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1252/2527] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:52.182375 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dd1e8-797c-4c2a-b658-2d8e2fbd0b31 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:52.184996 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f76dd1e8-797c-4c2a-b658-2d8e2fbd0b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:52.315677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dd1e8-797c-4c2a-b658-2d8e2fbd0b31 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:52.321555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab3c6f-98c4-4abc-a359-7b2e8e333028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:52.322228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab3c6f-98c4-4abc-a359-7b2e8e333028 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:52.322517 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab3c6f-98c4-4abc-a359-7b2e8e333028 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:52.322804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab3c6f-98c4-4abc-a359-7b2e8e333028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:52.339800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab3c6f-98c4-4abc-a359-7b2e8e333028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:52.342063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab3c6f-98c4-4abc-a359-7b2e8e333028 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:52.354674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1276/2528] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:52.408400 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac84a79-a21b-465d-beb4-85f50839e0cc None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:52.409909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-1ac84a79-a21b-465d-beb4-85f50839e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:52.448724 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac84a79-a21b-465d-beb4-85f50839e0cc None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:52.454064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69889e10-d99b-4f18-b8fb-ddece022a4a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:52.454901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69889e10-d99b-4f18-b8fb-ddece022a4a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:52.455353 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69889e10-d99b-4f18-b8fb-ddece022a4a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:52.455776 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69889e10-d99b-4f18-b8fb-ddece022a4a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:52.570508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69889e10-d99b-4f18-b8fb-ddece022a4a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:52.574111 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69889e10-d99b-4f18-b8fb-ddece022a4a2 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:52.588704 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1253/2529] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:53.306822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338e198-7529-4681-a1af-8d7daafb1c28 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:53.307434 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338e198-7529-4681-a1af-8d7daafb1c28 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:53.307602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338e198-7529-4681-a1af-8d7daafb1c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:53.328088 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0338e198-7529-4681-a1af-8d7daafb1c28 None None] MFA Rules not processed for user `17f6eadae19c4b7b8bd66e21ae302363`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:53.329750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0338e198-7529-4681-a1af-8d7daafb1c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:53.397951 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1277/2530] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:56.705632 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69889e10-d99b-4f18-b8fb-ddece022a4a2 service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:56.821116 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69889e10-d99b-4f18-b8fb-ddece022a4a2 service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:56.836054 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa31a6-5fa7-4c84-825b-4e21aa965842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:56.836957 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa31a6-5fa7-4c84-825b-4e21aa965842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:56.837276 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa31a6-5fa7-4c84-825b-4e21aa965842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:56.837559 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa31a6-5fa7-4c84-825b-4e21aa965842 admin admin] PATH_INFO: `/v3/users/b78a4c3f2fc24bd894b2c5dc534e48c5` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:56.840009 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa31a6-5fa7-4c84-825b-4e21aa965842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b78a4c3f2fc24bd894b2c5dc534e48c5)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:56.847223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa31a6-5fa7-4c84-825b-4e21aa965842 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:56.918828 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338e198-7529-4681-a1af-8d7daafb1c28 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:56.920343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0338e198-7529-4681-a1af-8d7daafb1c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:56.925073 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7ffa31a6-5fa7-4c84-825b-4e21aa965842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b78a4c3f2fc24bd894b2c5dc534e48c5'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:56.925942 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7ffa31a6-5fa7-4c84-825b-4e21aa965842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b78a4c3f2fc24bd894b2c5dc534e48c5'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:56.938990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7ffa31a6-5fa7-4c84-825b-4e21aa965842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b78a4c3f2fc24bd894b2c5dc534e48c5'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:56.948541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7ffa31a6-5fa7-4c84-825b-4e21aa965842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b78a4c3f2fc24bd894b2c5dc534e48c5'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:56.961024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-7ffa31a6-5fa7-4c84-825b-4e21aa965842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b78a4c3f2fc24bd894b2c5dc534e48c5'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:56.971870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1254/2531] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:33:56 2022] DELETE /identity/v3/users/b78a4c3f2fc24bd894b2c5dc534e48c5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:56.976452 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72a3dc-6888-483c-85f3-fc9859adf1a7 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:56.976633 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72a3dc-6888-483c-85f3-fc9859adf1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:56.976855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72a3dc-6888-483c-85f3-fc9859adf1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:57.003137 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-3d72a3dc-6888-483c-85f3-fc9859adf1a7 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:57.004457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3d72a3dc-6888-483c-85f3-fc9859adf1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:57.009337 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338e198-7529-4681-a1af-8d7daafb1c28 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:57.064160 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f68827-de11-45ba-a502-1b4472e9d024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:57.065124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f68827-de11-45ba-a502-1b4472e9d024 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:57.065562 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f68827-de11-45ba-a502-1b4472e9d024 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:57.065989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f68827-de11-45ba-a502-1b4472e9d024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:57.069268 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-86f68827-de11-45ba-a502-1b4472e9d024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:57.102823 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1255/2532] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:33:57.104038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72a3dc-6888-483c-85f3-fc9859adf1a7 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:57.105678 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3d72a3dc-6888-483c-85f3-fc9859adf1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:57.125508 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d72a3dc-6888-483c-85f3-fc9859adf1a7 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:57.130452 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a657f2-b724-4ba8-9d28-6d96c15fa67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:57.131692 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a657f2-b724-4ba8-9d28-6d96c15fa67f service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:57.131983 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a657f2-b724-4ba8-9d28-6d96c15fa67f service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:57.132491 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a657f2-b724-4ba8-9d28-6d96c15fa67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:57.146195 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a657f2-b724-4ba8-9d28-6d96c15fa67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:57.147582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a657f2-b724-4ba8-9d28-6d96c15fa67f service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:57.149794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f68827-de11-45ba-a502-1b4472e9d024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:57.152135 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f68827-de11-45ba-a502-1b4472e9d024 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:57.161134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1256/2533] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:33:57.167023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1278/2534] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:33:58.144740 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a657f2-b724-4ba8-9d28-6d96c15fa67f service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:58.150453 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-07a657f2-b724-4ba8-9d28-6d96c15fa67f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:58.172121 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a657f2-b724-4ba8-9d28-6d96c15fa67f service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:58.186919 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:58.187945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:58.188331 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:58.188730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] PATH_INFO: `/v3/projects/fd1fccded2e744e584e28806c68f6ce3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:58.192004 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd1fccded2e744e584e28806c68f6ce3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:58.194081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:58.315947 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd1fccded2e744e584e28806c68f6ce3', 'request_id': 'req-d77938da-18b4-4d37-9b2a-234cb6b5e374'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:58.332456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd1fccded2e744e584e28806c68f6ce3', 'request_id': 'req-d77938da-18b4-4d37-9b2a-234cb6b5e374'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:58.341641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd1fccded2e744e584e28806c68f6ce3', 'request_id': 'req-d77938da-18b4-4d37-9b2a-234cb6b5e374'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:58.355163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] The token cache is being invalidate because project fd1fccded2e744e584e28806c68f6ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:33:58.355620 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:58.356405 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:58.359217 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1257/2535] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:33:58 2022] DELETE /identity/v3/projects/fd1fccded2e744e584e28806c68f6ce3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:58.363128 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f68827-de11-45ba-a502-1b4472e9d024 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:58.377234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f68827-de11-45ba-a502-1b4472e9d024 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:58.447383 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441f080-709a-433b-a3f6-6af8236052d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:58.448182 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441f080-709a-433b-a3f6-6af8236052d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:58.448647 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441f080-709a-433b-a3f6-6af8236052d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:58.449137 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441f080-709a-433b-a3f6-6af8236052d9 admin admin] PATH_INFO: `/v3/users/901dd54b2c064c1bbe38fe48b09766fe` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:58.450561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441f080-709a-433b-a3f6-6af8236052d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=901dd54b2c064c1bbe38fe48b09766fe)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:58.452841 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441f080-709a-433b-a3f6-6af8236052d9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:58.537218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8441f080-709a-433b-a3f6-6af8236052d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901dd54b2c064c1bbe38fe48b09766fe'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:58.560989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8441f080-709a-433b-a3f6-6af8236052d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901dd54b2c064c1bbe38fe48b09766fe'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:58.580886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8441f080-709a-433b-a3f6-6af8236052d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901dd54b2c064c1bbe38fe48b09766fe'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:58.583737 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8441f080-709a-433b-a3f6-6af8236052d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901dd54b2c064c1bbe38fe48b09766fe'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:58.599043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-8441f080-709a-433b-a3f6-6af8236052d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901dd54b2c064c1bbe38fe48b09766fe'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:58.616814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1279/2536] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:33:58 2022] DELETE /identity/v3/users/901dd54b2c064c1bbe38fe48b09766fe => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:33:59.235089 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:59.237278 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:59.256710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77938da-18b4-4d37-9b2a-234cb6b5e374 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:59.364321 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a59ea3-38be-414c-8851-a2544cc1e72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:59.365618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a59ea3-38be-414c-8851-a2544cc1e72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:59.366082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a59ea3-38be-414c-8851-a2544cc1e72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:59.366526 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a59ea3-38be-414c-8851-a2544cc1e72b admin admin] PATH_INFO: `/v3/projects/799ffb45f1464e5687c36cb728fc9816` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:59.368179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a59ea3-38be-414c-8851-a2544cc1e72b admin admin] RBAC: Authorizing `identity:delete_project(project_id=799ffb45f1464e5687c36cb728fc9816)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:59.370420 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a59ea3-38be-414c-8851-a2544cc1e72b admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:59.437245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c3a59ea3-38be-414c-8851-a2544cc1e72b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799ffb45f1464e5687c36cb728fc9816', 'request_id': 'req-c3a59ea3-38be-414c-8851-a2544cc1e72b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:59.449569 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c3a59ea3-38be-414c-8851-a2544cc1e72b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799ffb45f1464e5687c36cb728fc9816', 'request_id': 'req-c3a59ea3-38be-414c-8851-a2544cc1e72b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:59.461445 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c3a59ea3-38be-414c-8851-a2544cc1e72b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799ffb45f1464e5687c36cb728fc9816', 'request_id': 'req-c3a59ea3-38be-414c-8851-a2544cc1e72b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:59.474976 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c3a59ea3-38be-414c-8851-a2544cc1e72b admin admin] The token cache is being invalidate because project 799ffb45f1464e5687c36cb728fc9816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:33:59.475268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c3a59ea3-38be-414c-8851-a2544cc1e72b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:59.475934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-c3a59ea3-38be-414c-8851-a2544cc1e72b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:33:59.478453 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1258/2537] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:33:59 2022] DELETE /identity/v3/projects/799ffb45f1464e5687c36cb728fc9816 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:33:59.483343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76730b2a-5b8d-43df-b20b-427af3b68968 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:59.483897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76730b2a-5b8d-43df-b20b-427af3b68968 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:59.483897 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76730b2a-5b8d-43df-b20b-427af3b68968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:59.510363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-76730b2a-5b8d-43df-b20b-427af3b68968 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:59.511829 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-76730b2a-5b8d-43df-b20b-427af3b68968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:59.603580 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1280/2538] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:59.605331 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5e42f-9cdd-4c03-85c6-6487d705a5fe None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:59.605631 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5e42f-9cdd-4c03-85c6-6487d705a5fe None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:59.605912 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5e42f-9cdd-4c03-85c6-6487d705a5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:59.634914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-ecd5e42f-9cdd-4c03-85c6-6487d705a5fe None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:33:59.637951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-ecd5e42f-9cdd-4c03-85c6-6487d705a5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:33:59.663134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1259/2539] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:33:59.664947 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76730b2a-5b8d-43df-b20b-427af3b68968 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:59.703020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76730b2a-5b8d-43df-b20b-427af3b68968 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:59.721125 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d28a82-ef97-460f-bfa3-58f583a00ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:59.722362 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d28a82-ef97-460f-bfa3-58f583a00ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:59.722850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d28a82-ef97-460f-bfa3-58f583a00ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:59.723328 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d28a82-ef97-460f-bfa3-58f583a00ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:59.724428 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d28a82-ef97-460f-bfa3-58f583a00ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:33:59.725186 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d28a82-ef97-460f-bfa3-58f583a00ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:59.727565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d28a82-ef97-460f-bfa3-58f583a00ee2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:59.751854 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5e42f-9cdd-4c03-85c6-6487d705a5fe None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:59.752314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1281/2540] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:33:59.771692 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5e42f-9cdd-4c03-85c6-6487d705a5fe None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:59.778356 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b6b3b-8650-40e9-86a3-af6d2af5519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:59.779365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b6b3b-8650-40e9-86a3-af6d2af5519a admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:59.779986 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b6b3b-8650-40e9-86a3-af6d2af5519a admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:59.780583 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b6b3b-8650-40e9-86a3-af6d2af5519a admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:59.781570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b6b3b-8650-40e9-86a3-af6d2af5519a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:59.783904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b6b3b-8650-40e9-86a3-af6d2af5519a admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:59.831840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1260/2541] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:33:59 2022] POST /identity/v3/projects => generated 369 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:59.835493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d28a82-ef97-460f-bfa3-58f583a00ee2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:59.846952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d28a82-ef97-460f-bfa3-58f583a00ee2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:59.917485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeab843-59db-4839-9ae0-5497a1707991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:59.918311 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeab843-59db-4839-9ae0-5497a1707991 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:59.918689 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeab843-59db-4839-9ae0-5497a1707991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:59.919631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeab843-59db-4839-9ae0-5497a1707991 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:59.921298 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeab843-59db-4839-9ae0-5497a1707991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:59.926566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeab843-59db-4839-9ae0-5497a1707991 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:33:59.954708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1282/2542] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:33:59 2022] POST /identity/v3/users => generated 285 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:33:59.959464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b6b3b-8650-40e9-86a3-af6d2af5519a admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:33:59.979483 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b6b3b-8650-40e9-86a3-af6d2af5519a admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:33:59.986893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c8f0b-1615-40c4-b219-a061c9b0f826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:33:59.987586 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c8f0b-1615-40c4-b219-a061c9b0f826 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:33:59.988009 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c8f0b-1615-40c4-b219-a061c9b0f826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:33:59.988301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c8f0b-1615-40c4-b219-a061c9b0f826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:33:59.989424 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c8f0b-1615-40c4-b219-a061c9b0f826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:33:59.992630 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c8f0b-1615-40c4-b219-a061c9b0f826 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:00.015261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1261/2543] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:34:00.016156 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeab843-59db-4839-9ae0-5497a1707991 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:00.039229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeab843-59db-4839-9ae0-5497a1707991 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:00.045113 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784c0af-faf9-4727-9ee3-043d4fdeb1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:00.045976 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784c0af-faf9-4727-9ee3-043d4fdeb1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:00.049485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784c0af-faf9-4727-9ee3-043d4fdeb1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:00.049485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784c0af-faf9-4727-9ee3-043d4fdeb1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:00.049485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784c0af-faf9-4727-9ee3-043d4fdeb1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:00.050343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784c0af-faf9-4727-9ee3-043d4fdeb1f5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:00.082352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1283/2544] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:00.086431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c8f0b-1615-40c4-b219-a061c9b0f826 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:00.110240 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c8f0b-1615-40c4-b219-a061c9b0f826 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:00.126832 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430aa27-011c-42d5-8b84-bced86cee2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:00.129027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430aa27-011c-42d5-8b84-bced86cee2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:00.129027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430aa27-011c-42d5-8b84-bced86cee2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:00.129027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430aa27-011c-42d5-8b84-bced86cee2b7 admin admin] PATH_INFO: `/v3/projects/19c5e8b6b39345b793ebe2923f5728b2/users/fc3f7a595ec74a5ba5961e76c01bc999/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:00.162063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430aa27-011c-42d5-8b84-bced86cee2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c5e8b6b39345b793ebe2923f5728b2, user_id=fc3f7a595ec74a5ba5961e76c01bc999, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:00.181281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430aa27-011c-42d5-8b84-bced86cee2b7 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:00.207881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1262/2545] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:00 2022] PUT /identity/v3/projects/19c5e8b6b39345b793ebe2923f5728b2/users/fc3f7a595ec74a5ba5961e76c01bc999/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:00.218663 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859ddb4-0d6d-4f12-9e29-a9afd73afc10 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:00.218953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859ddb4-0d6d-4f12-9e29-a9afd73afc10 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:00.219237 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859ddb4-0d6d-4f12-9e29-a9afd73afc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:00.267037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c859ddb4-0d6d-4f12-9e29-a9afd73afc10 None None] MFA Rules not processed for user `fc3f7a595ec74a5ba5961e76c01bc999`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:00.270155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c859ddb4-0d6d-4f12-9e29-a9afd73afc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:00.393833 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430aa27-011c-42d5-8b84-bced86cee2b7 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:00.396007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-1430aa27-011c-42d5-8b84-bced86cee2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:00.397277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1284/2546] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:00.462489 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430aa27-011c-42d5-8b84-bced86cee2b7 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:00.467249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40010166-171b-4612-bcbd-375edbd137bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f59e7ae8da841dc809355fa8e4be488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:00.467899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40010166-171b-4612-bcbd-375edbd137bd service glance] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:00.468182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40010166-171b-4612-bcbd-375edbd137bd service glance] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:00.468456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40010166-171b-4612-bcbd-375edbd137bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:00.477772 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40010166-171b-4612-bcbd-375edbd137bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:00.479236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40010166-171b-4612-bcbd-375edbd137bd service glance] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:00.493618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1263/2547] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:34:02.599975 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859ddb4-0d6d-4f12-9e29-a9afd73afc10 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:02.601522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c859ddb4-0d6d-4f12-9e29-a9afd73afc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:02.667633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859ddb4-0d6d-4f12-9e29-a9afd73afc10 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:02.672179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fca1ae-475e-40db-8fe9-f46048886412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:02.673064 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fca1ae-475e-40db-8fe9-f46048886412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:02.673349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fca1ae-475e-40db-8fe9-f46048886412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:02.673624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fca1ae-475e-40db-8fe9-f46048886412 admin admin] PATH_INFO: `/v3/users/e092796100394b63a7304abae7e25f7d` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:02.674806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fca1ae-475e-40db-8fe9-f46048886412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e092796100394b63a7304abae7e25f7d)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:02.676885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fca1ae-475e-40db-8fe9-f46048886412 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:02.722271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-65fca1ae-475e-40db-8fe9-f46048886412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e092796100394b63a7304abae7e25f7d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:02.736144 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-65fca1ae-475e-40db-8fe9-f46048886412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e092796100394b63a7304abae7e25f7d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:02.742715 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-65fca1ae-475e-40db-8fe9-f46048886412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e092796100394b63a7304abae7e25f7d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:02.743456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-65fca1ae-475e-40db-8fe9-f46048886412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e092796100394b63a7304abae7e25f7d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:02.751319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-65fca1ae-475e-40db-8fe9-f46048886412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e092796100394b63a7304abae7e25f7d'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:02.757386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1285/2548] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:34:02 2022] DELETE /identity/v3/users/e092796100394b63a7304abae7e25f7d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:02.929245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40010166-171b-4612-bcbd-375edbd137bd service glance] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:02.941558 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40010166-171b-4612-bcbd-375edbd137bd service glance] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:03.004709 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:03.005624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:03.005909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:03.006216 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9 admin admin] PATH_INFO: `/v3/projects/638a84064b2244e0b938b063e13cb944` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:03.007403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=638a84064b2244e0b938b063e13cb944)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:03.009653 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:03.060248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638a84064b2244e0b938b063e13cb944', 'request_id': 'req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:03.068616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638a84064b2244e0b938b063e13cb944', 'request_id': 'req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:03.074397 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638a84064b2244e0b938b063e13cb944', 'request_id': 'req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:03.085323 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9 admin admin] The token cache is being invalidate because project 638a84064b2244e0b938b063e13cb944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:34:03.085612 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:03.086240 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a3d69383-c921-4df1-a2e1-2d064f0c9fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:03.087781 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1264/2549] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:34:02 2022] DELETE /identity/v3/projects/638a84064b2244e0b938b063e13cb944 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:03.093465 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed47d1-cd3b-4d6a-966e-7e16b7d28a01 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:03.093757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed47d1-cd3b-4d6a-966e-7e16b7d28a01 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:03.094062 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed47d1-cd3b-4d6a-966e-7e16b7d28a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:03.113604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a5ed47d1-cd3b-4d6a-966e-7e16b7d28a01 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:03.114741 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a5ed47d1-cd3b-4d6a-966e-7e16b7d28a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:03.174683 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1286/2550] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:03.183525 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78654dc3-b173-481e-8e2f-4e80f10471f9 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:03.183815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78654dc3-b173-481e-8e2f-4e80f10471f9 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:03.184093 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78654dc3-b173-481e-8e2f-4e80f10471f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:03.209030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-78654dc3-b173-481e-8e2f-4e80f10471f9 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:03.210233 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-78654dc3-b173-481e-8e2f-4e80f10471f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:03.218736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1265/2551] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:03.223313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed47d1-cd3b-4d6a-966e-7e16b7d28a01 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:03.233331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed47d1-cd3b-4d6a-966e-7e16b7d28a01 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:03.238635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed43f4c-566d-40c3-8dee-853fb0ef18e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:03.239317 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43f4c-566d-40c3-8dee-853fb0ef18e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:03.239602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43f4c-566d-40c3-8dee-853fb0ef18e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:03.239880 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed43f4c-566d-40c3-8dee-853fb0ef18e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:03.240611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed43f4c-566d-40c3-8dee-853fb0ef18e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:34:03.240921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed43f4c-566d-40c3-8dee-853fb0ef18e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:03.242573 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed43f4c-566d-40c3-8dee-853fb0ef18e4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:03.254937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1287/2552] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:34:03.259598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78654dc3-b173-481e-8e2f-4e80f10471f9 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:03.269194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78654dc3-b173-481e-8e2f-4e80f10471f9 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:03.274236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796868f8-986b-40ae-a67f-ac4422025649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:03.275082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796868f8-986b-40ae-a67f-ac4422025649 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:03.275372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796868f8-986b-40ae-a67f-ac4422025649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:03.275649 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796868f8-986b-40ae-a67f-ac4422025649 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:03.276359 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796868f8-986b-40ae-a67f-ac4422025649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:03.278924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796868f8-986b-40ae-a67f-ac4422025649 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:03.309998 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1266/2553] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:34:03 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:03.311445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed43f4c-566d-40c3-8dee-853fb0ef18e4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:03.322155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed43f4c-566d-40c3-8dee-853fb0ef18e4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:03.377825 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d68e0b-861a-4de0-8062-3129891d0109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:03.378499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d68e0b-861a-4de0-8062-3129891d0109 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:03.378779 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d68e0b-861a-4de0-8062-3129891d0109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:03.379054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d68e0b-861a-4de0-8062-3129891d0109 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:03.379734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d68e0b-861a-4de0-8062-3129891d0109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:03.381685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d68e0b-861a-4de0-8062-3129891d0109 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:03.401303 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1288/2554] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:34:03 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:03.405824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796868f8-986b-40ae-a67f-ac4422025649 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:03.416554 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796868f8-986b-40ae-a67f-ac4422025649 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:03.421868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52e1be-d6fb-4fbc-9221-67fafe453b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:03.422541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52e1be-d6fb-4fbc-9221-67fafe453b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:03.422825 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52e1be-d6fb-4fbc-9221-67fafe453b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:03.423103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52e1be-d6fb-4fbc-9221-67fafe453b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:03.423830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52e1be-d6fb-4fbc-9221-67fafe453b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:03.425495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52e1be-d6fb-4fbc-9221-67fafe453b8d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:03.436704 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1267/2555] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:03.440598 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d68e0b-861a-4de0-8062-3129891d0109 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:03.450458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d68e0b-861a-4de0-8062-3129891d0109 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:03.455359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b658e-6812-4dca-aa82-2b498f7deec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:03.456310 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b658e-6812-4dca-aa82-2b498f7deec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:03.456508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b658e-6812-4dca-aa82-2b498f7deec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:03.456783 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b658e-6812-4dca-aa82-2b498f7deec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:03.457556 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b658e-6812-4dca-aa82-2b498f7deec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:03.459183 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b658e-6812-4dca-aa82-2b498f7deec3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:03.472941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1289/2556] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:03.474300 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52e1be-d6fb-4fbc-9221-67fafe453b8d admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:03.484485 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52e1be-d6fb-4fbc-9221-67fafe453b8d admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:03.489196 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90664d8-a403-4815-85ce-443e679f836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:03.490075 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90664d8-a403-4815-85ce-443e679f836a admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:03.490544 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90664d8-a403-4815-85ce-443e679f836a admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:03.490746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90664d8-a403-4815-85ce-443e679f836a admin admin] PATH_INFO: `/v3/projects/38eee225df5643128077103601503a19/users/1c610df955cd4d8eb92d49c4a473b002/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:03.507734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90664d8-a403-4815-85ce-443e679f836a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38eee225df5643128077103601503a19, user_id=1c610df955cd4d8eb92d49c4a473b002, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:03.510471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90664d8-a403-4815-85ce-443e679f836a admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:03.526924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1268/2557] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:03 2022] PUT /identity/v3/projects/38eee225df5643128077103601503a19/users/1c610df955cd4d8eb92d49c4a473b002/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:34:03.538945 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace1fb-e04b-460a-a37e-3e3e1b567424 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:03.539234 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace1fb-e04b-460a-a37e-3e3e1b567424 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:03.539512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace1fb-e04b-460a-a37e-3e3e1b567424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:03.571273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-b9ace1fb-e04b-460a-a37e-3e3e1b567424 None None] MFA Rules not processed for user `1c610df955cd4d8eb92d49c4a473b002`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:03.572487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b9ace1fb-e04b-460a-a37e-3e3e1b567424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:03.644342 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1290/2558] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:03.646138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90664d8-a403-4815-85ce-443e679f836a admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:03.722040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90664d8-a403-4815-85ce-443e679f836a admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:03.726857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caac623-609a-4ca1-bcde-4043b0026ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:03.727532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caac623-609a-4ca1-bcde-4043b0026ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:03.727822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caac623-609a-4ca1-bcde-4043b0026ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:03.728096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caac623-609a-4ca1-bcde-4043b0026ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:03.728920 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caac623-609a-4ca1-bcde-4043b0026ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:03.730901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caac623-609a-4ca1-bcde-4043b0026ad4 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:03.762350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1269/2559] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:34:03 2022] POST /identity/v3/projects => generated 369 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:03.766891 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ace1fb-e04b-460a-a37e-3e3e1b567424 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:03.780048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ace1fb-e04b-460a-a37e-3e3e1b567424 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:03.838572 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60ef28-ad22-4d99-a3cf-872cced32bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:03.839249 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60ef28-ad22-4d99-a3cf-872cced32bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:03.839531 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60ef28-ad22-4d99-a3cf-872cced32bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:03.839805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60ef28-ad22-4d99-a3cf-872cced32bc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:03.840509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60ef28-ad22-4d99-a3cf-872cced32bc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:03.843130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60ef28-ad22-4d99-a3cf-872cced32bc4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:03.862438 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1291/2560] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:34:03 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:03.866431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caac623-609a-4ca1-bcde-4043b0026ad4 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:03.877057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caac623-609a-4ca1-bcde-4043b0026ad4 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:03.881971 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf18faa-9e4b-4e49-883a-2364a274622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:03.882654 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf18faa-9e4b-4e49-883a-2364a274622e admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:03.882940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf18faa-9e4b-4e49-883a-2364a274622e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:03.883219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf18faa-9e4b-4e49-883a-2364a274622e admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:03.883955 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf18faa-9e4b-4e49-883a-2364a274622e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:03.885606 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf18faa-9e4b-4e49-883a-2364a274622e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:03.897362 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1270/2561] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:03.901405 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60ef28-ad22-4d99-a3cf-872cced32bc4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:03.912022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60ef28-ad22-4d99-a3cf-872cced32bc4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:03.916747 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d25d7-512d-42c8-8d0b-c61b18a60c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:03.917681 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d25d7-512d-42c8-8d0b-c61b18a60c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:03.918015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d25d7-512d-42c8-8d0b-c61b18a60c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:03.918292 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d25d7-512d-42c8-8d0b-c61b18a60c8d admin admin] PATH_INFO: `/v3/projects/973a0ddff85d435ead4078fd5aba0e47/users/616bae009d074a8783dec362e521f3e3/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:03.933717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d25d7-512d-42c8-8d0b-c61b18a60c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=973a0ddff85d435ead4078fd5aba0e47, user_id=616bae009d074a8783dec362e521f3e3, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:03.936928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d25d7-512d-42c8-8d0b-c61b18a60c8d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:03.949452 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1292/2562] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:03 2022] PUT /identity/v3/projects/973a0ddff85d435ead4078fd5aba0e47/users/616bae009d074a8783dec362e521f3e3/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:03.953999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf18faa-9e4b-4e49-883a-2364a274622e admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:03.963822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf18faa-9e4b-4e49-883a-2364a274622e admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:04.023248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82d9a4-145c-425b-90bf-62574fba00fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:04.023928 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82d9a4-145c-425b-90bf-62574fba00fa admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:04.024212 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82d9a4-145c-425b-90bf-62574fba00fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:04.024494 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82d9a4-145c-425b-90bf-62574fba00fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:04.025260 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82d9a4-145c-425b-90bf-62574fba00fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:04.026849 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82d9a4-145c-425b-90bf-62574fba00fa admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:04.037222 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1271/2563] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:04.041183 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d25d7-512d-42c8-8d0b-c61b18a60c8d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:04.051468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d25d7-512d-42c8-8d0b-c61b18a60c8d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:04.056054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfb600-988d-4fd7-92e4-3be6ded82af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:04.056930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfb600-988d-4fd7-92e4-3be6ded82af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:04.057242 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfb600-988d-4fd7-92e4-3be6ded82af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:04.057521 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfb600-988d-4fd7-92e4-3be6ded82af6 admin admin] PATH_INFO: `/v3/projects/973a0ddff85d435ead4078fd5aba0e47/users/616bae009d074a8783dec362e521f3e3/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:04.060007 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfb600-988d-4fd7-92e4-3be6ded82af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973a0ddff85d435ead4078fd5aba0e47, user_id=616bae009d074a8783dec362e521f3e3, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:04.062717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfb600-988d-4fd7-92e4-3be6ded82af6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:04.073272 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1293/2564] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:04 2022] PUT /identity/v3/projects/973a0ddff85d435ead4078fd5aba0e47/users/616bae009d074a8783dec362e521f3e3/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:04.083798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e784562-742b-43c6-97e8-41976f012d9b None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:04.084235 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e784562-742b-43c6-97e8-41976f012d9b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:04.084580 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e784562-742b-43c6-97e8-41976f012d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:04.111520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-9e784562-742b-43c6-97e8-41976f012d9b None None] MFA Rules not processed for user `616bae009d074a8783dec362e521f3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:04.112724 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9e784562-742b-43c6-97e8-41976f012d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:04.180361 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1272/2565] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:04 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:04.192468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfb600-988d-4fd7-92e4-3be6ded82af6 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:04.194399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-56cfb600-988d-4fd7-92e4-3be6ded82af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:04.258521 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfb600-988d-4fd7-92e4-3be6ded82af6 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:04.262187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659577a-c13a-4f62-bd18-aafaece79095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:04.263493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659577a-c13a-4f62-bd18-aafaece79095 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:04.263770 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659577a-c13a-4f62-bd18-aafaece79095 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:04.264041 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659577a-c13a-4f62-bd18-aafaece79095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:04.275667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659577a-c13a-4f62-bd18-aafaece79095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:04.279405 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659577a-c13a-4f62-bd18-aafaece79095 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:04.292071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1294/2566] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:04 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:04.341457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e784562-742b-43c6-97e8-41976f012d9b None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:04.343047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9e784562-742b-43c6-97e8-41976f012d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:04.354893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e784562-742b-43c6-97e8-41976f012d9b None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:04.359547 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa4437-49ba-4b1f-9b50-530899a21930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:04.360205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4437-49ba-4b1f-9b50-530899a21930 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:04.360497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4437-49ba-4b1f-9b50-530899a21930 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:04.360779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa4437-49ba-4b1f-9b50-530899a21930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:04.420668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa4437-49ba-4b1f-9b50-530899a21930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:04.422140 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa4437-49ba-4b1f-9b50-530899a21930 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:04.432790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1273/2567] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:05.695773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659577a-c13a-4f62-bd18-aafaece79095 service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:05.697464 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c659577a-c13a-4f62-bd18-aafaece79095 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:05.760920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659577a-c13a-4f62-bd18-aafaece79095 service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:05.768857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee8d0d-c40b-42fe-b42e-0a1d47d1137f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:05.773775 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee8d0d-c40b-42fe-b42e-0a1d47d1137f service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:05.774066 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee8d0d-c40b-42fe-b42e-0a1d47d1137f service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:05.774343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee8d0d-c40b-42fe-b42e-0a1d47d1137f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:05.776661 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3aee8d0d-c40b-42fe-b42e-0a1d47d1137f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:05.788118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee8d0d-c40b-42fe-b42e-0a1d47d1137f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:05.789614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee8d0d-c40b-42fe-b42e-0a1d47d1137f service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:05.801037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1295/2568] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:07.851303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d8542-47af-4889-9421-93552ddbd377 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:07.851859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d8542-47af-4889-9421-93552ddbd377 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:07.851859 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d8542-47af-4889-9421-93552ddbd377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:07.881049 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-049d8542-47af-4889-9421-93552ddbd377 None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:07.881677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-049d8542-47af-4889-9421-93552ddbd377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:07.943364 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1274/2569] 10.222.0.61 () {58 vars in 1009 bytes} [Tue May 10 20:34:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:07.952722 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee8d0d-c40b-42fe-b42e-0a1d47d1137f service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:07.955516 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d8542-47af-4889-9421-93552ddbd377 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:07.956828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-049d8542-47af-4889-9421-93552ddbd377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:08.020315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee8d0d-c40b-42fe-b42e-0a1d47d1137f service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:08.025639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2d1df-8c79-44e7-b15f-5b203c70ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:08.028012 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2d1df-8c79-44e7-b15f-5b203c70ae97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:08.028820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2d1df-8c79-44e7-b15f-5b203c70ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:08.029142 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2d1df-8c79-44e7-b15f-5b203c70ae97 admin admin] PATH_INFO: `/v3/users/1c610df955cd4d8eb92d49c4a473b002` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:08.030550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2d1df-8c79-44e7-b15f-5b203c70ae97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c610df955cd4d8eb92d49c4a473b002)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:08.032650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2d1df-8c79-44e7-b15f-5b203c70ae97 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:08.036306 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d8542-47af-4889-9421-93552ddbd377 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:08.043950 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e69f26-f4b4-4012-ba51-32b00f630f49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:08.044672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e69f26-f4b4-4012-ba51-32b00f630f49 service swift] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:08.044960 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e69f26-f4b4-4012-ba51-32b00f630f49 service swift] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:08.045261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e69f26-f4b4-4012-ba51-32b00f630f49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:08.054336 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e69f26-f4b4-4012-ba51-32b00f630f49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:08.055953 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e69f26-f4b4-4012-ba51-32b00f630f49 service swift] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:08.066267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1275/2570] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:34:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 20:34:08.082849 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-59f2d1df-8c79-44e7-b15f-5b203c70ae97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c610df955cd4d8eb92d49c4a473b002'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:08.098429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-59f2d1df-8c79-44e7-b15f-5b203c70ae97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c610df955cd4d8eb92d49c4a473b002'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:08.106285 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-59f2d1df-8c79-44e7-b15f-5b203c70ae97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c610df955cd4d8eb92d49c4a473b002'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:08.107419 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-59f2d1df-8c79-44e7-b15f-5b203c70ae97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c610df955cd4d8eb92d49c4a473b002'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:08.119667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-59f2d1df-8c79-44e7-b15f-5b203c70ae97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c610df955cd4d8eb92d49c4a473b002'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:08.130668 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1296/2571] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:34:07 2022] DELETE /identity/v3/users/1c610df955cd4d8eb92d49c4a473b002 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:08.141173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a6def-2e01-4663-b2c4-eac9a1bcca75 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:08.141753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a6def-2e01-4663-b2c4-eac9a1bcca75 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:08.142408 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a6def-2e01-4663-b2c4-eac9a1bcca75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:08.176959 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-a68a6def-2e01-4663-b2c4-eac9a1bcca75 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:08.179843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a68a6def-2e01-4663-b2c4-eac9a1bcca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:08.281904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1276/2572] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:08.291615 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2d1df-8c79-44e7-b15f-5b203c70ae97 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:08.293321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-59f2d1df-8c79-44e7-b15f-5b203c70ae97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:08.356165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2d1df-8c79-44e7-b15f-5b203c70ae97 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:08.360197 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ed583-ad61-4454-94f2-e35dad36af00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:08.361376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ed583-ad61-4454-94f2-e35dad36af00 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:08.361931 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ed583-ad61-4454-94f2-e35dad36af00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:08.362370 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ed583-ad61-4454-94f2-e35dad36af00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:08.381035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ed583-ad61-4454-94f2-e35dad36af00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:08.382903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ed583-ad61-4454-94f2-e35dad36af00 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:08.396032 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1297/2573] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:08.872841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a6def-2e01-4663-b2c4-eac9a1bcca75 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:08.874557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a68a6def-2e01-4663-b2c4-eac9a1bcca75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:08.893725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a6def-2e01-4663-b2c4-eac9a1bcca75 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:08.904517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:08.905813 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:08.906554 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:08.906996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] PATH_INFO: `/v3/projects/38eee225df5643128077103601503a19` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:08.908458 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=38eee225df5643128077103601503a19)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:08.910599 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:08.994663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38eee225df5643128077103601503a19', 'request_id': 'req-e5e16809-37b2-46c3-ab67-207dfa27edbd'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.011220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38eee225df5643128077103601503a19', 'request_id': 'req-e5e16809-37b2-46c3-ab67-207dfa27edbd'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.017329 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38eee225df5643128077103601503a19', 'request_id': 'req-e5e16809-37b2-46c3-ab67-207dfa27edbd'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.033561 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] The token cache is being invalidate because project 38eee225df5643128077103601503a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:34:09.033852 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.034512 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.036786 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1277/2574] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:34:08 2022] DELETE /identity/v3/projects/38eee225df5643128077103601503a19 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:09.041336 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ed583-ad61-4454-94f2-e35dad36af00 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:09.055997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ed583-ad61-4454-94f2-e35dad36af00 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:09.119711 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7414913-1bcf-4581-a269-d16f10da28c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:09.120724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7414913-1bcf-4581-a269-d16f10da28c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:09.121037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7414913-1bcf-4581-a269-d16f10da28c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:09.121513 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7414913-1bcf-4581-a269-d16f10da28c4 admin admin] PATH_INFO: `/v3/users/616bae009d074a8783dec362e521f3e3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:09.123458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7414913-1bcf-4581-a269-d16f10da28c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=616bae009d074a8783dec362e521f3e3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:09.125915 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7414913-1bcf-4581-a269-d16f10da28c4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:09.178877 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a7414913-1bcf-4581-a269-d16f10da28c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616bae009d074a8783dec362e521f3e3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.196644 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a7414913-1bcf-4581-a269-d16f10da28c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616bae009d074a8783dec362e521f3e3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.205832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a7414913-1bcf-4581-a269-d16f10da28c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616bae009d074a8783dec362e521f3e3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.206772 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a7414913-1bcf-4581-a269-d16f10da28c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616bae009d074a8783dec362e521f3e3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.214905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a7414913-1bcf-4581-a269-d16f10da28c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616bae009d074a8783dec362e521f3e3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.222537 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1298/2575] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:34:09 2022] DELETE /identity/v3/users/616bae009d074a8783dec362e521f3e3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:09.551418 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:09.555396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:09.584168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e16809-37b2-46c3-ab67-207dfa27edbd admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:09.666519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d04ef3-1ffe-4397-8735-a8a47ec07989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:09.667440 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d04ef3-1ffe-4397-8735-a8a47ec07989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:09.667726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d04ef3-1ffe-4397-8735-a8a47ec07989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:09.668028 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d04ef3-1ffe-4397-8735-a8a47ec07989 admin admin] PATH_INFO: `/v3/projects/973a0ddff85d435ead4078fd5aba0e47` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:09.669914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d04ef3-1ffe-4397-8735-a8a47ec07989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=973a0ddff85d435ead4078fd5aba0e47)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:09.671950 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d04ef3-1ffe-4397-8735-a8a47ec07989 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:09.726314 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-88d04ef3-1ffe-4397-8735-a8a47ec07989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973a0ddff85d435ead4078fd5aba0e47', 'request_id': 'req-88d04ef3-1ffe-4397-8735-a8a47ec07989'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.735207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-88d04ef3-1ffe-4397-8735-a8a47ec07989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973a0ddff85d435ead4078fd5aba0e47', 'request_id': 'req-88d04ef3-1ffe-4397-8735-a8a47ec07989'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.741171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-88d04ef3-1ffe-4397-8735-a8a47ec07989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973a0ddff85d435ead4078fd5aba0e47', 'request_id': 'req-88d04ef3-1ffe-4397-8735-a8a47ec07989'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.759156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-88d04ef3-1ffe-4397-8735-a8a47ec07989 admin admin] The token cache is being invalidate because project 973a0ddff85d435ead4078fd5aba0e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:34:09.759504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-88d04ef3-1ffe-4397-8735-a8a47ec07989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.760110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-88d04ef3-1ffe-4397-8735-a8a47ec07989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:09.761896 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1278/2576] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:34:09 2022] DELETE /identity/v3/projects/973a0ddff85d435ead4078fd5aba0e47 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:09.766867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f59fc-a7f8-4692-bd56-4e3c8d7a1eb5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:09.767158 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f59fc-a7f8-4692-bd56-4e3c8d7a1eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:09.767438 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f59fc-a7f8-4692-bd56-4e3c8d7a1eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:09.787643 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-eb7f59fc-a7f8-4692-bd56-4e3c8d7a1eb5 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:09.789016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-eb7f59fc-a7f8-4692-bd56-4e3c8d7a1eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:09.854722 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1299/2577] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:09.862803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5942-332c-48ad-b39c-b786a1009835 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:09.863083 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5942-332c-48ad-b39c-b786a1009835 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:09.863451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5942-332c-48ad-b39c-b786a1009835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:09.884048 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-279c5942-332c-48ad-b39c-b786a1009835 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:09.885713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-279c5942-332c-48ad-b39c-b786a1009835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:09.896878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1279/2578] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:09.902435 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f59fc-a7f8-4692-bd56-4e3c8d7a1eb5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:09.917340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f59fc-a7f8-4692-bd56-4e3c8d7a1eb5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:09.920121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce8eb0-fd35-49a5-931c-390a7092058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:09.920803 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce8eb0-fd35-49a5-931c-390a7092058e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:09.921127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce8eb0-fd35-49a5-931c-390a7092058e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:09.921412 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce8eb0-fd35-49a5-931c-390a7092058e admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:09.922150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce8eb0-fd35-49a5-931c-390a7092058e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:34:09.922464 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce8eb0-fd35-49a5-931c-390a7092058e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:09.924083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce8eb0-fd35-49a5-931c-390a7092058e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:09.937250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1300/2579] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:34:09.941890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5942-332c-48ad-b39c-b786a1009835 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:09.952668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5942-332c-48ad-b39c-b786a1009835 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:09.957891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645556a-6669-41ca-a879-d51682c1ec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:09.958484 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645556a-6669-41ca-a879-d51682c1ec2d admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:09.958798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645556a-6669-41ca-a879-d51682c1ec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:09.959076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645556a-6669-41ca-a879-d51682c1ec2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:09.959825 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645556a-6669-41ca-a879-d51682c1ec2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:09.961753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645556a-6669-41ca-a879-d51682c1ec2d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:10.011043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1280/2580] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:34:09 2022] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:10.016364 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce8eb0-fd35-49a5-931c-390a7092058e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:10.032811 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce8eb0-fd35-49a5-931c-390a7092058e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:10.124549 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42afe7-487b-4f22-b86b-4c74d4015766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:10.125317 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42afe7-487b-4f22-b86b-4c74d4015766 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:10.125791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42afe7-487b-4f22-b86b-4c74d4015766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:10.126295 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42afe7-487b-4f22-b86b-4c74d4015766 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:10.127356 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42afe7-487b-4f22-b86b-4c74d4015766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:10.131309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42afe7-487b-4f22-b86b-4c74d4015766 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:10.175947 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1301/2581] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:34:10 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:10.176449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645556a-6669-41ca-a879-d51682c1ec2d admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:10.193007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645556a-6669-41ca-a879-d51682c1ec2d admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:10.214035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc4212-d764-4160-93b4-ea256f8b963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:10.216846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc4212-d764-4160-93b4-ea256f8b963c admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:10.217361 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc4212-d764-4160-93b4-ea256f8b963c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:10.222686 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc4212-d764-4160-93b4-ea256f8b963c admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:10.223777 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc4212-d764-4160-93b4-ea256f8b963c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:10.229905 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc4212-d764-4160-93b4-ea256f8b963c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:10.252654 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1281/2582] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:34:10.254133 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42afe7-487b-4f22-b86b-4c74d4015766 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:10.266096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42afe7-487b-4f22-b86b-4c74d4015766 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:10.270937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6ce7e-5572-42db-a30f-bbe314fe9194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:10.271667 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6ce7e-5572-42db-a30f-bbe314fe9194 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:10.272071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6ce7e-5572-42db-a30f-bbe314fe9194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:10.272422 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6ce7e-5572-42db-a30f-bbe314fe9194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:10.273568 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6ce7e-5572-42db-a30f-bbe314fe9194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:10.275894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6ce7e-5572-42db-a30f-bbe314fe9194 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:10.289433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1302/2583] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:10.294766 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc4212-d764-4160-93b4-ea256f8b963c admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:10.305630 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc4212-d764-4160-93b4-ea256f8b963c admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:10.315776 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ed333-cc06-47f6-a1b1-0d1a4d5e6d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:10.316682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ed333-cc06-47f6-a1b1-0d1a4d5e6d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:10.316966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ed333-cc06-47f6-a1b1-0d1a4d5e6d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:10.317270 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ed333-cc06-47f6-a1b1-0d1a4d5e6d45 admin admin] PATH_INFO: `/v3/projects/2bf74aa1cb534ff8a683bb8d250c62e1/users/e8d7f3136215423b85cd480fde2a010f/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:10.332686 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ed333-cc06-47f6-a1b1-0d1a4d5e6d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf74aa1cb534ff8a683bb8d250c62e1, user_id=e8d7f3136215423b85cd480fde2a010f, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:10.335478 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ed333-cc06-47f6-a1b1-0d1a4d5e6d45 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:10.353965 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1282/2584] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:10 2022] PUT /identity/v3/projects/2bf74aa1cb534ff8a683bb8d250c62e1/users/e8d7f3136215423b85cd480fde2a010f/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:34:10.365935 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9eb89-ed8a-4d03-ba98-34e2b97286f4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:10.366237 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9eb89-ed8a-4d03-ba98-34e2b97286f4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:10.366481 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9eb89-ed8a-4d03-ba98-34e2b97286f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:10.395823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-29b9eb89-ed8a-4d03-ba98-34e2b97286f4 None None] MFA Rules not processed for user `e8d7f3136215423b85cd480fde2a010f`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:10.397048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-29b9eb89-ed8a-4d03-ba98-34e2b97286f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:10.466858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1303/2585] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:10.471452 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ed333-cc06-47f6-a1b1-0d1a4d5e6d45 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:10.561636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ed333-cc06-47f6-a1b1-0d1a4d5e6d45 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:10.566925 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4253c1a-24e6-4dc7-b9cc-326779a691d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:10.567596 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4253c1a-24e6-4dc7-b9cc-326779a691d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:10.567882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4253c1a-24e6-4dc7-b9cc-326779a691d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:10.568157 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4253c1a-24e6-4dc7-b9cc-326779a691d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:10.568998 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4253c1a-24e6-4dc7-b9cc-326779a691d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:10.571029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4253c1a-24e6-4dc7-b9cc-326779a691d7 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:10.604929 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1283/2586] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:34:10 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:34:10.608386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9eb89-ed8a-4d03-ba98-34e2b97286f4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:10.626333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9eb89-ed8a-4d03-ba98-34e2b97286f4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:10.701240 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f205255-5c66-48dd-8de2-c46392581061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:10.701920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f205255-5c66-48dd-8de2-c46392581061 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:10.702319 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f205255-5c66-48dd-8de2-c46392581061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:10.702622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f205255-5c66-48dd-8de2-c46392581061 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:10.703340 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f205255-5c66-48dd-8de2-c46392581061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:10.705480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f205255-5c66-48dd-8de2-c46392581061 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:10.730801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1304/2587] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:34:10 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:34:10.732485 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4253c1a-24e6-4dc7-b9cc-326779a691d7 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:10.743514 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4253c1a-24e6-4dc7-b9cc-326779a691d7 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:10.749614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43de3b-8b0f-4d26-980e-1f682e092e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:10.753484 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43de3b-8b0f-4d26-980e-1f682e092e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:10.753824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43de3b-8b0f-4d26-980e-1f682e092e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:10.754102 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43de3b-8b0f-4d26-980e-1f682e092e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:10.755059 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43de3b-8b0f-4d26-980e-1f682e092e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:10.756778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43de3b-8b0f-4d26-980e-1f682e092e4c admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:10.769672 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1284/2588] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:10.773858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f205255-5c66-48dd-8de2-c46392581061 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:10.785451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f205255-5c66-48dd-8de2-c46392581061 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:10.795486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8d1ff-e29a-4a10-abc0-016972bbf184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:10.796404 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8d1ff-e29a-4a10-abc0-016972bbf184 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:10.796687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8d1ff-e29a-4a10-abc0-016972bbf184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:10.796954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8d1ff-e29a-4a10-abc0-016972bbf184 admin admin] PATH_INFO: `/v3/projects/b456e7c3192c47d18c6a242a09aeabb7/users/41c242635b4842f39ab361566d31350f/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:10.814790 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8d1ff-e29a-4a10-abc0-016972bbf184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b456e7c3192c47d18c6a242a09aeabb7, user_id=41c242635b4842f39ab361566d31350f, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:10.817589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d8d1ff-e29a-4a10-abc0-016972bbf184 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:10.834130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1305/2589] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:10 2022] PUT /identity/v3/projects/b456e7c3192c47d18c6a242a09aeabb7/users/41c242635b4842f39ab361566d31350f/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:34:10.835565 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43de3b-8b0f-4d26-980e-1f682e092e4c admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:10.847602 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43de3b-8b0f-4d26-980e-1f682e092e4c admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:10.908009 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b6ab1f-94f9-4a4d-ac70-0d2622e1bcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:10.908794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6ab1f-94f9-4a4d-ac70-0d2622e1bcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:10.909141 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6ab1f-94f9-4a4d-ac70-0d2622e1bcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:10.909426 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b6ab1f-94f9-4a4d-ac70-0d2622e1bcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:10.910166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6ab1f-94f9-4a4d-ac70-0d2622e1bcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:10.912059 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b6ab1f-94f9-4a4d-ac70-0d2622e1bcb6 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:10.926853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1285/2590] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:10.928520 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8d1ff-e29a-4a10-abc0-016972bbf184 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:10.940390 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d8d1ff-e29a-4a10-abc0-016972bbf184 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:10.945433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2820071-5d57-4067-a6a4-971244155a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:10.946346 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2820071-5d57-4067-a6a4-971244155a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:10.946631 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2820071-5d57-4067-a6a4-971244155a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:10.946909 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2820071-5d57-4067-a6a4-971244155a92 admin admin] PATH_INFO: `/v3/projects/b456e7c3192c47d18c6a242a09aeabb7/users/41c242635b4842f39ab361566d31350f/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:10.948957 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2820071-5d57-4067-a6a4-971244155a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b456e7c3192c47d18c6a242a09aeabb7, user_id=41c242635b4842f39ab361566d31350f, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:10.951685 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2820071-5d57-4067-a6a4-971244155a92 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:10.962971 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1306/2591] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:10 2022] PUT /identity/v3/projects/b456e7c3192c47d18c6a242a09aeabb7/users/41c242635b4842f39ab361566d31350f/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:10.973918 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63eec5-3bc9-4327-8bcd-07ac1d62b54c None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:10.974491 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63eec5-3bc9-4327-8bcd-07ac1d62b54c None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:10.974858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63eec5-3bc9-4327-8bcd-07ac1d62b54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:11.011525 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-9d63eec5-3bc9-4327-8bcd-07ac1d62b54c None None] MFA Rules not processed for user `41c242635b4842f39ab361566d31350f`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:11.013298 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9d63eec5-3bc9-4327-8bcd-07ac1d62b54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:11.105311 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1286/2592] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:11.116525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2820071-5d57-4067-a6a4-971244155a92 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:11.118239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a2820071-5d57-4067-a6a4-971244155a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:11.186220 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2820071-5d57-4067-a6a4-971244155a92 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:11.190429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbe287-487b-4d97-88f4-f141ab321622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:11.191150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbe287-487b-4d97-88f4-f141ab321622 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:11.191512 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbe287-487b-4d97-88f4-f141ab321622 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:11.191854 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbe287-487b-4d97-88f4-f141ab321622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:11.203637 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbe287-487b-4d97-88f4-f141ab321622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:11.205214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbe287-487b-4d97-88f4-f141ab321622 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:11.217228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1307/2593] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:11.247523 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63eec5-3bc9-4327-8bcd-07ac1d62b54c None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:11.347674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63eec5-3bc9-4327-8bcd-07ac1d62b54c None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:11.360074 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc3e87-93bf-4490-b447-f94bcc362cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:11.361844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc3e87-93bf-4490-b447-f94bcc362cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:11.362429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc3e87-93bf-4490-b447-f94bcc362cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:11.362935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc3e87-93bf-4490-b447-f94bcc362cdc admin admin] PATH_INFO: `/v3/users/e8d7f3136215423b85cd480fde2a010f` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:11.366515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc3e87-93bf-4490-b447-f94bcc362cdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d7f3136215423b85cd480fde2a010f)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:11.369149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc3e87-93bf-4490-b447-f94bcc362cdc admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:11.452815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4efc3e87-93bf-4490-b447-f94bcc362cdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d7f3136215423b85cd480fde2a010f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:11.459203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4efc3e87-93bf-4490-b447-f94bcc362cdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d7f3136215423b85cd480fde2a010f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:11.495261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4efc3e87-93bf-4490-b447-f94bcc362cdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d7f3136215423b85cd480fde2a010f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:11.523808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4efc3e87-93bf-4490-b447-f94bcc362cdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d7f3136215423b85cd480fde2a010f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:11.533412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4efc3e87-93bf-4490-b447-f94bcc362cdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d7f3136215423b85cd480fde2a010f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:11.546130 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1287/2594] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:34:11 2022] DELETE /identity/v3/users/e8d7f3136215423b85cd480fde2a010f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:11.550807 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e5620-259e-4643-a141-42c387541585 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:11.551153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e5620-259e-4643-a141-42c387541585 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:11.552009 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e5620-259e-4643-a141-42c387541585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:11.583497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-794e5620-259e-4643-a141-42c387541585 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:11.584700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-794e5620-259e-4643-a141-42c387541585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:11.658079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1308/2595] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:11.669116 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc3e87-93bf-4490-b447-f94bcc362cdc admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:11.670592 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-4efc3e87-93bf-4490-b447-f94bcc362cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:11.739745 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc3e87-93bf-4490-b447-f94bcc362cdc admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:11.743804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf192874-613f-45dd-8d5b-6fd3158e8a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:11.744460 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf192874-613f-45dd-8d5b-6fd3158e8a31 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:11.744746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf192874-613f-45dd-8d5b-6fd3158e8a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:11.745059 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf192874-613f-45dd-8d5b-6fd3158e8a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:11.754871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf192874-613f-45dd-8d5b-6fd3158e8a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:11.756345 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf192874-613f-45dd-8d5b-6fd3158e8a31 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:11.766579 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1288/2596] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:12.061758 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e5620-259e-4643-a141-42c387541585 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:12.063223 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-794e5620-259e-4643-a141-42c387541585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:12.080131 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e5620-259e-4643-a141-42c387541585 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:12.088870 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:12.092309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:12.093035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:12.097318 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] PATH_INFO: `/v3/projects/2bf74aa1cb534ff8a683bb8d250c62e1` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:12.098639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf74aa1cb534ff8a683bb8d250c62e1)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:12.100865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:12.159204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf74aa1cb534ff8a683bb8d250c62e1', 'request_id': 'req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:12.164910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf74aa1cb534ff8a683bb8d250c62e1', 'request_id': 'req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:12.171536 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf74aa1cb534ff8a683bb8d250c62e1', 'request_id': 'req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:12.186196 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] The token cache is being invalidate because project 2bf74aa1cb534ff8a683bb8d250c62e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:34:12.186487 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:12.187127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:12.188822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1309/2597] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:34:12 2022] DELETE /identity/v3/projects/2bf74aa1cb534ff8a683bb8d250c62e1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:12.192736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf192874-613f-45dd-8d5b-6fd3158e8a31 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:12.202983 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf192874-613f-45dd-8d5b-6fd3158e8a31 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:12.270258 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fc035-f247-47bd-8f64-ca1a76291bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:12.271141 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fc035-f247-47bd-8f64-ca1a76291bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:12.271434 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fc035-f247-47bd-8f64-ca1a76291bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:12.271716 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fc035-f247-47bd-8f64-ca1a76291bed admin admin] PATH_INFO: `/v3/users/41c242635b4842f39ab361566d31350f` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:12.273111 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fc035-f247-47bd-8f64-ca1a76291bed admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c242635b4842f39ab361566d31350f)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:12.275053 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fc035-f247-47bd-8f64-ca1a76291bed admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:12.323149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e45fc035-f247-47bd-8f64-ca1a76291bed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c242635b4842f39ab361566d31350f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:12.323935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e45fc035-f247-47bd-8f64-ca1a76291bed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c242635b4842f39ab361566d31350f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:12.336664 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e45fc035-f247-47bd-8f64-ca1a76291bed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c242635b4842f39ab361566d31350f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:12.351281 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e45fc035-f247-47bd-8f64-ca1a76291bed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c242635b4842f39ab361566d31350f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:12.362741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e45fc035-f247-47bd-8f64-ca1a76291bed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c242635b4842f39ab361566d31350f'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:12.370400 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1289/2598] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:34:12 2022] DELETE /identity/v3/users/41c242635b4842f39ab361566d31350f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:12.824284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:12.826713 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:12.840945 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23cd34-d1cf-482f-ae9c-b72cf1d75d64 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:12.960187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:12.961710 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:12.962028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:12.962280 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83 admin admin] PATH_INFO: `/v3/projects/b456e7c3192c47d18c6a242a09aeabb7` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:12.963490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b456e7c3192c47d18c6a242a09aeabb7)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:12.966193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:13.038706 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b456e7c3192c47d18c6a242a09aeabb7', 'request_id': 'req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:13.045368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b456e7c3192c47d18c6a242a09aeabb7', 'request_id': 'req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:13.052549 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b456e7c3192c47d18c6a242a09aeabb7', 'request_id': 'req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:13.071360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83 admin admin] The token cache is being invalidate because project b456e7c3192c47d18c6a242a09aeabb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:34:13.071648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:13.072290 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4a1b4077-e8aa-4c4e-9157-f33d8c0aba83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:13.073891 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1310/2599] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:34:12 2022] DELETE /identity/v3/projects/b456e7c3192c47d18c6a242a09aeabb7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:13.078892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c29515-8a96-4393-a9cb-39f984f02249 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:13.079183 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c29515-8a96-4393-a9cb-39f984f02249 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:13.079465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c29515-8a96-4393-a9cb-39f984f02249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:13.098184 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b5c29515-8a96-4393-a9cb-39f984f02249 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:13.099385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b5c29515-8a96-4393-a9cb-39f984f02249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:13.165163 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1290/2600] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:34:13.173544 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514fd99-f09d-45df-bb93-7b062a7520f7 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:13.174084 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514fd99-f09d-45df-bb93-7b062a7520f7 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:13.174525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514fd99-f09d-45df-bb93-7b062a7520f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:13.192721 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-3514fd99-f09d-45df-bb93-7b062a7520f7 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:13.193963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3514fd99-f09d-45df-bb93-7b062a7520f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:13.202151 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1311/2601] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:13.206254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c29515-8a96-4393-a9cb-39f984f02249 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:13.216203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c29515-8a96-4393-a9cb-39f984f02249 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:13.221130 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d23e1-35d3-4500-85b6-c04e35ecaf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:13.221788 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d23e1-35d3-4500-85b6-c04e35ecaf20 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:13.222064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d23e1-35d3-4500-85b6-c04e35ecaf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:13.222335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83d23e1-35d3-4500-85b6-c04e35ecaf20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:13.223060 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d23e1-35d3-4500-85b6-c04e35ecaf20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:34:13.223366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d23e1-35d3-4500-85b6-c04e35ecaf20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:13.224943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83d23e1-35d3-4500-85b6-c04e35ecaf20 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:13.237416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1291/2602] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:34:13.241640 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514fd99-f09d-45df-bb93-7b062a7520f7 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:13.251115 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514fd99-f09d-45df-bb93-7b062a7520f7 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:13.255806 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abbb49-402e-4a57-9142-cbae15ef366c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:13.256457 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abbb49-402e-4a57-9142-cbae15ef366c admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:13.256735 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abbb49-402e-4a57-9142-cbae15ef366c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:13.257038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abbb49-402e-4a57-9142-cbae15ef366c admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:13.257736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abbb49-402e-4a57-9142-cbae15ef366c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:13.259626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abbb49-402e-4a57-9142-cbae15ef366c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:13.289736 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1312/2603] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:34:13 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:34:13.290763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d23e1-35d3-4500-85b6-c04e35ecaf20 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:13.302868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83d23e1-35d3-4500-85b6-c04e35ecaf20 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:13.362339 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e46c16-cf65-4ea2-add3-9524e4550155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:13.363080 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46c16-cf65-4ea2-add3-9524e4550155 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:13.363366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46c16-cf65-4ea2-add3-9524e4550155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:13.363647 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e46c16-cf65-4ea2-add3-9524e4550155 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:13.364348 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e46c16-cf65-4ea2-add3-9524e4550155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:13.366355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e46c16-cf65-4ea2-add3-9524e4550155 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:13.388626 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1292/2604] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:34:13 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:13.393086 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abbb49-402e-4a57-9142-cbae15ef366c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:13.404956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abbb49-402e-4a57-9142-cbae15ef366c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:13.409971 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db203e1-f1e6-4c24-a33a-b526be22882c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:13.410730 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db203e1-f1e6-4c24-a33a-b526be22882c admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:13.411088 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db203e1-f1e6-4c24-a33a-b526be22882c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:13.411437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db203e1-f1e6-4c24-a33a-b526be22882c admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:13.412241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db203e1-f1e6-4c24-a33a-b526be22882c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:13.413966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db203e1-f1e6-4c24-a33a-b526be22882c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:13.426697 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1313/2605] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:13.431483 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e46c16-cf65-4ea2-add3-9524e4550155 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:13.443999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e46c16-cf65-4ea2-add3-9524e4550155 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:13.450142 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f60296-370c-490d-aa9a-ee86fe844cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:13.451343 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f60296-370c-490d-aa9a-ee86fe844cae admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:13.451627 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f60296-370c-490d-aa9a-ee86fe844cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:13.453170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f60296-370c-490d-aa9a-ee86fe844cae admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:13.454240 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f60296-370c-490d-aa9a-ee86fe844cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:13.456180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f60296-370c-490d-aa9a-ee86fe844cae admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:13.467534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1293/2606] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:34:13.471798 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db203e1-f1e6-4c24-a33a-b526be22882c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:13.482169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db203e1-f1e6-4c24-a33a-b526be22882c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:13.487814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a15580-9f0c-4de3-b4a2-67365fe46284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:13.488710 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15580-9f0c-4de3-b4a2-67365fe46284 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:13.489020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15580-9f0c-4de3-b4a2-67365fe46284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:13.489306 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a15580-9f0c-4de3-b4a2-67365fe46284 admin admin] PATH_INFO: `/v3/projects/1c58a64421944fe1a5f12808477a57da/users/c3e082a66d0d4734ac32a17a698a8300/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:13.508481 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a15580-9f0c-4de3-b4a2-67365fe46284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c58a64421944fe1a5f12808477a57da, user_id=c3e082a66d0d4734ac32a17a698a8300, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:13.511415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a15580-9f0c-4de3-b4a2-67365fe46284 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:13.525942 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1314/2607] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:13 2022] PUT /identity/v3/projects/1c58a64421944fe1a5f12808477a57da/users/c3e082a66d0d4734ac32a17a698a8300/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:13.538385 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c921ef3-f4b7-40fb-a1ab-774e335bbef2 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:13.538675 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c921ef3-f4b7-40fb-a1ab-774e335bbef2 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:13.538953 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c921ef3-f4b7-40fb-a1ab-774e335bbef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:13.566748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-4c921ef3-f4b7-40fb-a1ab-774e335bbef2 None None] MFA Rules not processed for user `c3e082a66d0d4734ac32a17a698a8300`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:13.567875 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-4c921ef3-f4b7-40fb-a1ab-774e335bbef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:13.641805 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1294/2608] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:13.647076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a15580-9f0c-4de3-b4a2-67365fe46284 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:13.710517 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a15580-9f0c-4de3-b4a2-67365fe46284 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:13.715246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c313a-f596-4ae6-affc-65e915d3b66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:13.715908 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c313a-f596-4ae6-affc-65e915d3b66f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:13.716192 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c313a-f596-4ae6-affc-65e915d3b66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:13.716473 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c313a-f596-4ae6-affc-65e915d3b66f admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:13.717228 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c313a-f596-4ae6-affc-65e915d3b66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:13.719139 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c313a-f596-4ae6-affc-65e915d3b66f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:13.747000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1315/2609] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:34:13 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:13.750790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c921ef3-f4b7-40fb-a1ab-774e335bbef2 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:13.762850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c921ef3-f4b7-40fb-a1ab-774e335bbef2 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:13.821070 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275c36e-6738-4285-84b6-fb298b13f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:13.821691 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275c36e-6738-4285-84b6-fb298b13f8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:13.821978 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275c36e-6738-4285-84b6-fb298b13f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:13.822259 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275c36e-6738-4285-84b6-fb298b13f8e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:13.822965 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275c36e-6738-4285-84b6-fb298b13f8e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:13.825845 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275c36e-6738-4285-84b6-fb298b13f8e8 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:13.854696 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1295/2610] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:34:13 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:13.858777 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c313a-f596-4ae6-affc-65e915d3b66f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:13.869322 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c313a-f596-4ae6-affc-65e915d3b66f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:13.874890 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157ab87-c0a5-488e-9ded-4472ebd208ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:13.875663 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157ab87-c0a5-488e-9ded-4472ebd208ae admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:13.875962 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157ab87-c0a5-488e-9ded-4472ebd208ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:13.876235 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157ab87-c0a5-488e-9ded-4472ebd208ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:13.876985 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157ab87-c0a5-488e-9ded-4472ebd208ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:13.878628 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157ab87-c0a5-488e-9ded-4472ebd208ae admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:13.890510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1316/2611] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:34:13.894838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275c36e-6738-4285-84b6-fb298b13f8e8 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:13.906239 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275c36e-6738-4285-84b6-fb298b13f8e8 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:13.911203 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038f08d-8e1b-43af-af5b-57af71e38b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:13.912484 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f08d-8e1b-43af-af5b-57af71e38b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:13.912837 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f08d-8e1b-43af-af5b-57af71e38b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:13.913226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f08d-8e1b-43af-af5b-57af71e38b65 admin admin] PATH_INFO: `/v3/projects/ceb00deda3d9428fa728f5ec2c154d43/users/b89ff1e6f48d4a18b44e5231d7b70c44/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:13.930400 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038f08d-8e1b-43af-af5b-57af71e38b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb00deda3d9428fa728f5ec2c154d43, user_id=b89ff1e6f48d4a18b44e5231d7b70c44, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:13.933167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038f08d-8e1b-43af-af5b-57af71e38b65 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:13.957609 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1296/2612] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:13 2022] PUT /identity/v3/projects/ceb00deda3d9428fa728f5ec2c154d43/users/b89ff1e6f48d4a18b44e5231d7b70c44/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:13.958161 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157ab87-c0a5-488e-9ded-4472ebd208ae admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:13.971461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157ab87-c0a5-488e-9ded-4472ebd208ae admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:14.051398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da57066-c6ed-430a-9d0c-2e76f2951401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:14.052080 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57066-c6ed-430a-9d0c-2e76f2951401 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:14.052364 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57066-c6ed-430a-9d0c-2e76f2951401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:14.052638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da57066-c6ed-430a-9d0c-2e76f2951401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:14.053417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da57066-c6ed-430a-9d0c-2e76f2951401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:14.055017 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da57066-c6ed-430a-9d0c-2e76f2951401 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:14.068011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1317/2613] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:34:14.072180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038f08d-8e1b-43af-af5b-57af71e38b65 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:14.091563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038f08d-8e1b-43af-af5b-57af71e38b65 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:14.096655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cf60b-8dcb-4289-9470-b94a95134fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:14.097864 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cf60b-8dcb-4289-9470-b94a95134fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:14.098536 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cf60b-8dcb-4289-9470-b94a95134fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:14.099241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9cf60b-8dcb-4289-9470-b94a95134fd1 admin admin] PATH_INFO: `/v3/projects/ceb00deda3d9428fa728f5ec2c154d43/users/b89ff1e6f48d4a18b44e5231d7b70c44/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:14.102158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cf60b-8dcb-4289-9470-b94a95134fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb00deda3d9428fa728f5ec2c154d43, user_id=b89ff1e6f48d4a18b44e5231d7b70c44, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:14.105549 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9cf60b-8dcb-4289-9470-b94a95134fd1 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:14.124838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1297/2614] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:14 2022] PUT /identity/v3/projects/ceb00deda3d9428fa728f5ec2c154d43/users/b89ff1e6f48d4a18b44e5231d7b70c44/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:34:14.136219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf82ae0-0265-45b1-b3e4-948f568be863 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:14.136468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf82ae0-0265-45b1-b3e4-948f568be863 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:14.136710 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf82ae0-0265-45b1-b3e4-948f568be863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:14.206152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-baf82ae0-0265-45b1-b3e4-948f568be863 None None] MFA Rules not processed for user `b89ff1e6f48d4a18b44e5231d7b70c44`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:14.207370 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-baf82ae0-0265-45b1-b3e4-948f568be863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:14.290515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1318/2615] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:14.301775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cf60b-8dcb-4289-9470-b94a95134fd1 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:14.303462 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fc9cf60b-8dcb-4289-9470-b94a95134fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:14.372959 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9cf60b-8dcb-4289-9470-b94a95134fd1 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:14.376621 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8aa4-2d35-4075-aad2-fd85e34bea0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:14.377299 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8aa4-2d35-4075-aad2-fd85e34bea0e service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:14.377584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8aa4-2d35-4075-aad2-fd85e34bea0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:14.377862 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f8aa4-2d35-4075-aad2-fd85e34bea0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:14.388018 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f8aa4-2d35-4075-aad2-fd85e34bea0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:14.389502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f8aa4-2d35-4075-aad2-fd85e34bea0e service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:14.411563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1298/2616] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:14.535411 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf82ae0-0265-45b1-b3e4-948f568be863 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:14.545462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf82ae0-0265-45b1-b3e4-948f568be863 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:14.549858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecfe7e-ab01-49eb-baf9-2b6366ca9621 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:14.550522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecfe7e-ab01-49eb-baf9-2b6366ca9621 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:14.550794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecfe7e-ab01-49eb-baf9-2b6366ca9621 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:14.551075 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecfe7e-ab01-49eb-baf9-2b6366ca9621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:14.609486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecfe7e-ab01-49eb-baf9-2b6366ca9621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:14.610966 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecfe7e-ab01-49eb-baf9-2b6366ca9621 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:14.620550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1319/2617] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:17.240637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8aa4-2d35-4075-aad2-fd85e34bea0e service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:17.301267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f8aa4-2d35-4075-aad2-fd85e34bea0e service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:17.306102 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372d400-2e95-43fd-a533-5eea82ecc902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:17.306993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372d400-2e95-43fd-a533-5eea82ecc902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:17.307277 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372d400-2e95-43fd-a533-5eea82ecc902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:17.307555 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3372d400-2e95-43fd-a533-5eea82ecc902 admin admin] PATH_INFO: `/v3/users/c3e082a66d0d4734ac32a17a698a8300` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:17.308745 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372d400-2e95-43fd-a533-5eea82ecc902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e082a66d0d4734ac32a17a698a8300)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:17.311298 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3372d400-2e95-43fd-a533-5eea82ecc902 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:17.359919 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-3372d400-2e95-43fd-a533-5eea82ecc902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e082a66d0d4734ac32a17a698a8300'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:17.360660 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-3372d400-2e95-43fd-a533-5eea82ecc902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e082a66d0d4734ac32a17a698a8300'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:17.380913 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-3372d400-2e95-43fd-a533-5eea82ecc902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e082a66d0d4734ac32a17a698a8300'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:17.391767 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-3372d400-2e95-43fd-a533-5eea82ecc902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e082a66d0d4734ac32a17a698a8300'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:17.399057 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-3372d400-2e95-43fd-a533-5eea82ecc902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e082a66d0d4734ac32a17a698a8300'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:17.406376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1299/2618] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:34:17 2022] DELETE /identity/v3/users/c3e082a66d0d4734ac32a17a698a8300 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:17.411063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468e7a-1985-4b09-a207-5b1254c8267d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:17.411586 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468e7a-1985-4b09-a207-5b1254c8267d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:17.411688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468e7a-1985-4b09-a207-5b1254c8267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:17.434242 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-44468e7a-1985-4b09-a207-5b1254c8267d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:17.435463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-44468e7a-1985-4b09-a207-5b1254c8267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:17.497321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1320/2619] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:17.506987 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372d400-2e95-43fd-a533-5eea82ecc902 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:17.508528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3372d400-2e95-43fd-a533-5eea82ecc902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:17.565283 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3372d400-2e95-43fd-a533-5eea82ecc902 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:17.568899 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465c04a-ee53-4521-a5eb-3bb63eef63b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:17.569571 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465c04a-ee53-4521-a5eb-3bb63eef63b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:17.569855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465c04a-ee53-4521-a5eb-3bb63eef63b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:17.570128 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465c04a-ee53-4521-a5eb-3bb63eef63b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:17.579000 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465c04a-ee53-4521-a5eb-3bb63eef63b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:17.580416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465c04a-ee53-4521-a5eb-3bb63eef63b7 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:17.589674 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1300/2620] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:17.876384 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44468e7a-1985-4b09-a207-5b1254c8267d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:17.878065 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-44468e7a-1985-4b09-a207-5b1254c8267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:17.891868 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44468e7a-1985-4b09-a207-5b1254c8267d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:17.897673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:17.898622 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:17.898949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:17.899236 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] PATH_INFO: `/v3/projects/1c58a64421944fe1a5f12808477a57da` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:17.900536 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c58a64421944fe1a5f12808477a57da)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:17.902558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:17.952049 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c58a64421944fe1a5f12808477a57da', 'request_id': 'req-af8eda66-87ab-4595-b78f-b7ff77949ed4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:17.965063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c58a64421944fe1a5f12808477a57da', 'request_id': 'req-af8eda66-87ab-4595-b78f-b7ff77949ed4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:17.978824 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c58a64421944fe1a5f12808477a57da', 'request_id': 'req-af8eda66-87ab-4595-b78f-b7ff77949ed4'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:17.995561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] The token cache is being invalidate because project 1c58a64421944fe1a5f12808477a57da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:34:17.995788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:17.996445 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:17.998060 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1321/2621] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:34:17 2022] DELETE /identity/v3/projects/1c58a64421944fe1a5f12808477a57da => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:18.002015 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465c04a-ee53-4521-a5eb-3bb63eef63b7 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:18.011512 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465c04a-ee53-4521-a5eb-3bb63eef63b7 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:18.072924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27502b6-d0b0-4b00-a0cc-2ec2c1666aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:18.073936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27502b6-d0b0-4b00-a0cc-2ec2c1666aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:18.074229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27502b6-d0b0-4b00-a0cc-2ec2c1666aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:18.075218 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27502b6-d0b0-4b00-a0cc-2ec2c1666aa8 admin admin] PATH_INFO: `/v3/users/b89ff1e6f48d4a18b44e5231d7b70c44` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:18.076432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27502b6-d0b0-4b00-a0cc-2ec2c1666aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89ff1e6f48d4a18b44e5231d7b70c44)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:18.078443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27502b6-d0b0-4b00-a0cc-2ec2c1666aa8 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:18.125052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a27502b6-d0b0-4b00-a0cc-2ec2c1666aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89ff1e6f48d4a18b44e5231d7b70c44'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:18.125703 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a27502b6-d0b0-4b00-a0cc-2ec2c1666aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89ff1e6f48d4a18b44e5231d7b70c44'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:18.138172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a27502b6-d0b0-4b00-a0cc-2ec2c1666aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89ff1e6f48d4a18b44e5231d7b70c44'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:18.145124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a27502b6-d0b0-4b00-a0cc-2ec2c1666aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89ff1e6f48d4a18b44e5231d7b70c44'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:18.152591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a27502b6-d0b0-4b00-a0cc-2ec2c1666aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89ff1e6f48d4a18b44e5231d7b70c44'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:18.158604 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1301/2622] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:34:18 2022] DELETE /identity/v3/users/b89ff1e6f48d4a18b44e5231d7b70c44 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:18.421965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:18.424039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:18.438299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8eda66-87ab-4595-b78f-b7ff77949ed4 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:18.500965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eabbae-304f-44c2-8f20-d0f5eb41ddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:18.501974 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eabbae-304f-44c2-8f20-d0f5eb41ddae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:18.502258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eabbae-304f-44c2-8f20-d0f5eb41ddae admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:18.502535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eabbae-304f-44c2-8f20-d0f5eb41ddae admin admin] PATH_INFO: `/v3/projects/ceb00deda3d9428fa728f5ec2c154d43` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:18.503766 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eabbae-304f-44c2-8f20-d0f5eb41ddae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb00deda3d9428fa728f5ec2c154d43)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:18.505920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eabbae-304f-44c2-8f20-d0f5eb41ddae admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:18.564391 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-76eabbae-304f-44c2-8f20-d0f5eb41ddae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb00deda3d9428fa728f5ec2c154d43', 'request_id': 'req-76eabbae-304f-44c2-8f20-d0f5eb41ddae'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:18.571261 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-76eabbae-304f-44c2-8f20-d0f5eb41ddae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb00deda3d9428fa728f5ec2c154d43', 'request_id': 'req-76eabbae-304f-44c2-8f20-d0f5eb41ddae'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:18.578814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-76eabbae-304f-44c2-8f20-d0f5eb41ddae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb00deda3d9428fa728f5ec2c154d43', 'request_id': 'req-76eabbae-304f-44c2-8f20-d0f5eb41ddae'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:18.596624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-76eabbae-304f-44c2-8f20-d0f5eb41ddae admin admin] The token cache is being invalidate because project ceb00deda3d9428fa728f5ec2c154d43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:34:18.597241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-76eabbae-304f-44c2-8f20-d0f5eb41ddae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:18.597776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-76eabbae-304f-44c2-8f20-d0f5eb41ddae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:18.602587 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1322/2623] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:34:18 2022] DELETE /identity/v3/projects/ceb00deda3d9428fa728f5ec2c154d43 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:18.605189 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c5b7d-2ac0-49c1-af2f-d635f0cbbcdd None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:18.606435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c5b7d-2ac0-49c1-af2f-d635f0cbbcdd None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:18.606721 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c5b7d-2ac0-49c1-af2f-d635f0cbbcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:18.629069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-fc7c5b7d-2ac0-49c1-af2f-d635f0cbbcdd None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:18.630027 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fc7c5b7d-2ac0-49c1-af2f-d635f0cbbcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:18.709544 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1302/2624] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:18.718591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3d9cb-c29c-4a2b-adb6-104634cd13c1 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:18.718591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3d9cb-c29c-4a2b-adb6-104634cd13c1 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:18.718591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3d9cb-c29c-4a2b-adb6-104634cd13c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:18.738349 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2ec3d9cb-c29c-4a2b-adb6-104634cd13c1 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:18.739547 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2ec3d9cb-c29c-4a2b-adb6-104634cd13c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:18.748323 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1323/2625] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:18.752873 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c5b7d-2ac0-49c1-af2f-d635f0cbbcdd None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:18.762753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c5b7d-2ac0-49c1-af2f-d635f0cbbcdd None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:18.767827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ea01-b859-461b-9654-2227c2f642bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:18.768766 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ea01-b859-461b-9654-2227c2f642bc admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:18.769077 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ea01-b859-461b-9654-2227c2f642bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:18.769378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ea01-b859-461b-9654-2227c2f642bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:18.770268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4ea01-b859-461b-9654-2227c2f642bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:34:18.770551 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4ea01-b859-461b-9654-2227c2f642bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:18.772195 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4ea01-b859-461b-9654-2227c2f642bc admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:18.787090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1303/2626] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:34:18.788246 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3d9cb-c29c-4a2b-adb6-104634cd13c1 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:18.797937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3d9cb-c29c-4a2b-adb6-104634cd13c1 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:18.802626 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d292d6-1903-43eb-95fe-d15b35b9fa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:18.803282 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d292d6-1903-43eb-95fe-d15b35b9fa4f admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:18.803562 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d292d6-1903-43eb-95fe-d15b35b9fa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:18.803837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d292d6-1903-43eb-95fe-d15b35b9fa4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:18.804565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d292d6-1903-43eb-95fe-d15b35b9fa4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:18.806497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d292d6-1903-43eb-95fe-d15b35b9fa4f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:18.834702 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1324/2627] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:34:18 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:18.835933 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ea01-b859-461b-9654-2227c2f642bc admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:18.845782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ea01-b859-461b-9654-2227c2f642bc admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:18.908069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c54580-14ed-47b7-a0a5-086e2ed7ce18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:18.908746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c54580-14ed-47b7-a0a5-086e2ed7ce18 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:18.909063 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c54580-14ed-47b7-a0a5-086e2ed7ce18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:18.909347 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c54580-14ed-47b7-a0a5-086e2ed7ce18 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:18.910040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c54580-14ed-47b7-a0a5-086e2ed7ce18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:18.911939 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c54580-14ed-47b7-a0a5-086e2ed7ce18 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:18.937769 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1304/2628] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:34:18 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:18.938010 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d292d6-1903-43eb-95fe-d15b35b9fa4f admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:18.947833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d292d6-1903-43eb-95fe-d15b35b9fa4f admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:18.952565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab163c18-9b6c-4b5a-a1f8-c8253173749a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:18.953279 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab163c18-9b6c-4b5a-a1f8-c8253173749a admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:18.953566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab163c18-9b6c-4b5a-a1f8-c8253173749a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:18.953847 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab163c18-9b6c-4b5a-a1f8-c8253173749a admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:18.954584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab163c18-9b6c-4b5a-a1f8-c8253173749a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:18.956209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab163c18-9b6c-4b5a-a1f8-c8253173749a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:18.969257 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1325/2629] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:18.972574 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c54580-14ed-47b7-a0a5-086e2ed7ce18 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:18.985689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c54580-14ed-47b7-a0a5-086e2ed7ce18 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:18.990967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8540e-67ac-4bfb-ba8b-312a3ddeb5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:18.991147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8540e-67ac-4bfb-ba8b-312a3ddeb5de admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:18.991435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8540e-67ac-4bfb-ba8b-312a3ddeb5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:18.991713 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8540e-67ac-4bfb-ba8b-312a3ddeb5de admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:18.992568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8540e-67ac-4bfb-ba8b-312a3ddeb5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:18.994316 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8540e-67ac-4bfb-ba8b-312a3ddeb5de admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:19.006272 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1305/2630] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:34:19.010708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab163c18-9b6c-4b5a-a1f8-c8253173749a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:19.022121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab163c18-9b6c-4b5a-a1f8-c8253173749a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:19.027014 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375f6a3-9faf-48db-bb6b-214ac65ac35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:19.027981 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375f6a3-9faf-48db-bb6b-214ac65ac35a admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:19.028262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375f6a3-9faf-48db-bb6b-214ac65ac35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:19.028704 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375f6a3-9faf-48db-bb6b-214ac65ac35a admin admin] PATH_INFO: `/v3/projects/27188f6530fe4ff48f73e1cdc018b786/users/5b37fe0198f240cdab923e161a3bddf8/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:19.044823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375f6a3-9faf-48db-bb6b-214ac65ac35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=27188f6530fe4ff48f73e1cdc018b786, user_id=5b37fe0198f240cdab923e161a3bddf8, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:19.047651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375f6a3-9faf-48db-bb6b-214ac65ac35a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:19.064900 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1326/2631] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:19 2022] PUT /identity/v3/projects/27188f6530fe4ff48f73e1cdc018b786/users/5b37fe0198f240cdab923e161a3bddf8/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:34:19.076418 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996e9be-dc0b-40de-a976-39d943cf6f74 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:19.076797 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996e9be-dc0b-40de-a976-39d943cf6f74 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:19.077012 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996e9be-dc0b-40de-a976-39d943cf6f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:19.108864 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-5996e9be-dc0b-40de-a976-39d943cf6f74 None None] MFA Rules not processed for user `5b37fe0198f240cdab923e161a3bddf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:19.110147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5996e9be-dc0b-40de-a976-39d943cf6f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:19.183081 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1306/2632] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:19.188047 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375f6a3-9faf-48db-bb6b-214ac65ac35a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:19.250726 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375f6a3-9faf-48db-bb6b-214ac65ac35a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:19.255427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81e47-3d32-48a7-ab00-b346825f07a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:19.256084 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81e47-3d32-48a7-ab00-b346825f07a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:19.256421 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81e47-3d32-48a7-ab00-b346825f07a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:19.256650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f81e47-3d32-48a7-ab00-b346825f07a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:19.257387 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f81e47-3d32-48a7-ab00-b346825f07a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:19.259399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f81e47-3d32-48a7-ab00-b346825f07a8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:19.287398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1327/2633] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:34:19 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:19.288822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996e9be-dc0b-40de-a976-39d943cf6f74 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:19.300135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996e9be-dc0b-40de-a976-39d943cf6f74 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:19.355449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd53eb-909a-4835-bbf0-ad13815b5b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:19.356650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd53eb-909a-4835-bbf0-ad13815b5b99 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:19.356930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd53eb-909a-4835-bbf0-ad13815b5b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:19.357221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd53eb-909a-4835-bbf0-ad13815b5b99 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:19.357907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd53eb-909a-4835-bbf0-ad13815b5b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:19.359804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd53eb-909a-4835-bbf0-ad13815b5b99 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:19.380358 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1307/2634] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:34:19 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:19.384309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81e47-3d32-48a7-ab00-b346825f07a8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:19.395002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f81e47-3d32-48a7-ab00-b346825f07a8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:19.399743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa81a8-82af-4002-b8db-621496d06e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:19.400506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa81a8-82af-4002-b8db-621496d06e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:19.400856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa81a8-82af-4002-b8db-621496d06e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:19.401225 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa81a8-82af-4002-b8db-621496d06e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:19.402022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa81a8-82af-4002-b8db-621496d06e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:19.403757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa81a8-82af-4002-b8db-621496d06e14 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:19.414176 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1328/2635] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:34:19.418767 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd53eb-909a-4835-bbf0-ad13815b5b99 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:19.428498 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd53eb-909a-4835-bbf0-ad13815b5b99 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:19.433245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb99a7-a13d-405f-88b0-a83b9a2ce9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:19.434694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb99a7-a13d-405f-88b0-a83b9a2ce9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:19.434982 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb99a7-a13d-405f-88b0-a83b9a2ce9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:19.435263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb99a7-a13d-405f-88b0-a83b9a2ce9a5 admin admin] PATH_INFO: `/v3/projects/74880c9a4a994776b7b401ae5997f8e6/users/d0bcb62b6aa645b19b9ccf816699a85b/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:19.450176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb99a7-a13d-405f-88b0-a83b9a2ce9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74880c9a4a994776b7b401ae5997f8e6, user_id=d0bcb62b6aa645b19b9ccf816699a85b, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:19.452847 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb99a7-a13d-405f-88b0-a83b9a2ce9a5 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:19.466742 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1308/2636] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:19 2022] PUT /identity/v3/projects/74880c9a4a994776b7b401ae5997f8e6/users/d0bcb62b6aa645b19b9ccf816699a85b/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:19.470601 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa81a8-82af-4002-b8db-621496d06e14 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:19.481232 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa81a8-82af-4002-b8db-621496d06e14 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:19.537271 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa2a74-386c-446a-a490-26a3e2aee8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:19.537868 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa2a74-386c-446a-a490-26a3e2aee8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:19.538153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa2a74-386c-446a-a490-26a3e2aee8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:19.538432 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa2a74-386c-446a-a490-26a3e2aee8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:19.539162 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa2a74-386c-446a-a490-26a3e2aee8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:19.540768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa2a74-386c-446a-a490-26a3e2aee8f6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:19.551830 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1329/2637] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:34:19.555909 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb99a7-a13d-405f-88b0-a83b9a2ce9a5 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:19.566619 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb99a7-a13d-405f-88b0-a83b9a2ce9a5 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:19.571279 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c1e2e-aeb6-4fd2-883a-902787bbb453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:19.572164 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c1e2e-aeb6-4fd2-883a-902787bbb453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:19.572451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c1e2e-aeb6-4fd2-883a-902787bbb453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:19.572741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c1e2e-aeb6-4fd2-883a-902787bbb453 admin admin] PATH_INFO: `/v3/projects/74880c9a4a994776b7b401ae5997f8e6/users/d0bcb62b6aa645b19b9ccf816699a85b/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:19.574785 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c1e2e-aeb6-4fd2-883a-902787bbb453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74880c9a4a994776b7b401ae5997f8e6, user_id=d0bcb62b6aa645b19b9ccf816699a85b, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:19.577465 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c1e2e-aeb6-4fd2-883a-902787bbb453 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:19.587925 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1309/2638] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:19 2022] PUT /identity/v3/projects/74880c9a4a994776b7b401ae5997f8e6/users/d0bcb62b6aa645b19b9ccf816699a85b/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:19.598326 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24069cf7-f0c2-42b6-9851-11e2ed3606e4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:19.599033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24069cf7-f0c2-42b6-9851-11e2ed3606e4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:19.599033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24069cf7-f0c2-42b6-9851-11e2ed3606e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:19.625345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-24069cf7-f0c2-42b6-9851-11e2ed3606e4 None None] MFA Rules not processed for user `d0bcb62b6aa645b19b9ccf816699a85b`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:19.626558 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-24069cf7-f0c2-42b6-9851-11e2ed3606e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:19.693803 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1330/2639] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:19.704814 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c1e2e-aeb6-4fd2-883a-902787bbb453 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:19.706625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2c2c1e2e-aeb6-4fd2-883a-902787bbb453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:19.770999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c1e2e-aeb6-4fd2-883a-902787bbb453 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:19.774758 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37674ac-f220-4968-bee2-68a5637177ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:19.775407 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37674ac-f220-4968-bee2-68a5637177ef service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:19.775692 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37674ac-f220-4968-bee2-68a5637177ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:19.775966 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37674ac-f220-4968-bee2-68a5637177ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:19.830900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37674ac-f220-4968-bee2-68a5637177ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:19.832245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37674ac-f220-4968-bee2-68a5637177ef service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:19.841530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1310/2640] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:24.424075 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938a5e6-6b56-4efb-b484-9ab5bb6742b9 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:24.424637 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938a5e6-6b56-4efb-b484-9ab5bb6742b9 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:24.424816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938a5e6-6b56-4efb-b484-9ab5bb6742b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:24.444576 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1938a5e6-6b56-4efb-b484-9ab5bb6742b9 None None] MFA Rules not processed for user `7cb2f98e2f844526b48475c783703d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:24.445986 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1938a5e6-6b56-4efb-b484-9ab5bb6742b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:24.499262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1331/2641] 10.222.0.61 () {58 vars in 967 bytes} [Tue May 10 20:34:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:34:24.521613 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37674ac-f220-4968-bee2-68a5637177ef service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:24.523066 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e37674ac-f220-4968-bee2-68a5637177ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:24.589320 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37674ac-f220-4968-bee2-68a5637177ef service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:24.594293 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2e3cd-2a09-432e-b12f-3cb5a0e66b93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6acfba37d6b84bf3a63d40e6e4096f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:24.594933 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2e3cd-2a09-432e-b12f-3cb5a0e66b93 service swift] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:24.595213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2e3cd-2a09-432e-b12f-3cb5a0e66b93 service swift] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:24.595488 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2e3cd-2a09-432e-b12f-3cb5a0e66b93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:24.603242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2e3cd-2a09-432e-b12f-3cb5a0e66b93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:24.604797 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2e3cd-2a09-432e-b12f-3cb5a0e66b93 service swift] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:24.613119 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1311/2642] 10.222.0.61 () {60 vars in 1384 bytes} [Tue May 10 20:34:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:34:25.072327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938a5e6-6b56-4efb-b484-9ab5bb6742b9 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:25.073818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1938a5e6-6b56-4efb-b484-9ab5bb6742b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:25.096039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938a5e6-6b56-4efb-b484-9ab5bb6742b9 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:25.099931 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f1b24-f198-4f6b-819a-9ed729dbe929 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:25.100588 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1b24-f198-4f6b-819a-9ed729dbe929 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:25.100869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1b24-f198-4f6b-819a-9ed729dbe929 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:25.101188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1b24-f198-4f6b-819a-9ed729dbe929 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:25.112134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f1b24-f198-4f6b-819a-9ed729dbe929 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:25.113690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f1b24-f198-4f6b-819a-9ed729dbe929 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:25.123656 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1332/2643] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:27.509670 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2e3cd-2a09-432e-b12f-3cb5a0e66b93 service swift] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:27.511055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d2f2e3cd-2a09-432e-b12f-3cb5a0e66b93 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:27.572778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2e3cd-2a09-432e-b12f-3cb5a0e66b93 service swift] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:27.577853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21324e1f-8cde-444e-b970-9f1adeb7a095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:27.578719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21324e1f-8cde-444e-b970-9f1adeb7a095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:27.578997 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21324e1f-8cde-444e-b970-9f1adeb7a095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:27.579268 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21324e1f-8cde-444e-b970-9f1adeb7a095 admin admin] PATH_INFO: `/v3/users/fc3f7a595ec74a5ba5961e76c01bc999` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:27.580428 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21324e1f-8cde-444e-b970-9f1adeb7a095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc3f7a595ec74a5ba5961e76c01bc999)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:27.582420 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21324e1f-8cde-444e-b970-9f1adeb7a095 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:27.625024 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-21324e1f-8cde-444e-b970-9f1adeb7a095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc3f7a595ec74a5ba5961e76c01bc999'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:27.625668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-21324e1f-8cde-444e-b970-9f1adeb7a095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc3f7a595ec74a5ba5961e76c01bc999'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:27.637303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-21324e1f-8cde-444e-b970-9f1adeb7a095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc3f7a595ec74a5ba5961e76c01bc999'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:27.644231 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-21324e1f-8cde-444e-b970-9f1adeb7a095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc3f7a595ec74a5ba5961e76c01bc999'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:27.651377 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-21324e1f-8cde-444e-b970-9f1adeb7a095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc3f7a595ec74a5ba5961e76c01bc999'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:27.657723 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1312/2644] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:34:27 2022] DELETE /identity/v3/users/fc3f7a595ec74a5ba5961e76c01bc999 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:27.662259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa41d36-0719-4c7e-a438-2cfe28f940df None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:27.662738 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa41d36-0719-4c7e-a438-2cfe28f940df None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:27.662869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa41d36-0719-4c7e-a438-2cfe28f940df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:27.679783 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-bfa41d36-0719-4c7e-a438-2cfe28f940df None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:27.680991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bfa41d36-0719-4c7e-a438-2cfe28f940df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:27.740804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1333/2645] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:27.750218 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21324e1f-8cde-444e-b970-9f1adeb7a095 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:27.751636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-21324e1f-8cde-444e-b970-9f1adeb7a095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:27.811669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21324e1f-8cde-444e-b970-9f1adeb7a095 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:27.815374 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d10f4-1135-46cd-a7b8-6abf6d07c9dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:27.816015 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d10f4-1135-46cd-a7b8-6abf6d07c9dd service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:27.816293 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d10f4-1135-46cd-a7b8-6abf6d07c9dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:27.816574 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d10f4-1135-46cd-a7b8-6abf6d07c9dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:27.826754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d10f4-1135-46cd-a7b8-6abf6d07c9dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:27.828172 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d10f4-1135-46cd-a7b8-6abf6d07c9dd service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:27.837447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1313/2646] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:28.104930 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa41d36-0719-4c7e-a438-2cfe28f940df None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:28.106436 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bfa41d36-0719-4c7e-a438-2cfe28f940df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:28.117746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa41d36-0719-4c7e-a438-2cfe28f940df None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:28.123879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:28.124753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:28.125060 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:28.125334 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44 admin admin] PATH_INFO: `/v3/projects/19c5e8b6b39345b793ebe2923f5728b2` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:28.126521 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c5e8b6b39345b793ebe2923f5728b2)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:28.128400 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:28.172744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c5e8b6b39345b793ebe2923f5728b2', 'request_id': 'req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:28.177939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c5e8b6b39345b793ebe2923f5728b2', 'request_id': 'req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:28.184193 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c5e8b6b39345b793ebe2923f5728b2', 'request_id': 'req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:28.196020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44 admin admin] The token cache is being invalidate because project 19c5e8b6b39345b793ebe2923f5728b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:34:28.196309 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:28.196929 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b1bf63f1-c685-4dff-8aa3-8735cc9f3a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:28.198494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1334/2647] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:34:28 2022] DELETE /identity/v3/projects/19c5e8b6b39345b793ebe2923f5728b2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:28.204325 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209cf0b-3e63-490c-a5c1-a206da4f3fc0 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:28.204619 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209cf0b-3e63-490c-a5c1-a206da4f3fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:28.204900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209cf0b-3e63-490c-a5c1-a206da4f3fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:28.222158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e209cf0b-3e63-490c-a5c1-a206da4f3fc0 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:28.223350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e209cf0b-3e63-490c-a5c1-a206da4f3fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:28.280781 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1314/2648] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:28.288152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff8e4c-99f4-4d76-9c34-9b666102a118 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:28.288442 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff8e4c-99f4-4d76-9c34-9b666102a118 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:28.288722 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff8e4c-99f4-4d76-9c34-9b666102a118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:28.307394 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-cfff8e4c-99f4-4d76-9c34-9b666102a118 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:28.309219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-cfff8e4c-99f4-4d76-9c34-9b666102a118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:28.316873 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1335/2649] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:28.320901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209cf0b-3e63-490c-a5c1-a206da4f3fc0 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:28.330816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209cf0b-3e63-490c-a5c1-a206da4f3fc0 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:28.335333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccef19-d45e-44a5-8c4c-054db1054f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:28.335975 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccef19-d45e-44a5-8c4c-054db1054f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:28.336257 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccef19-d45e-44a5-8c4c-054db1054f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:28.336539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccef19-d45e-44a5-8c4c-054db1054f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:28.337294 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccef19-d45e-44a5-8c4c-054db1054f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:34:28.337604 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccef19-d45e-44a5-8c4c-054db1054f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:28.339174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccef19-d45e-44a5-8c4c-054db1054f07 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:28.350748 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1315/2650] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:34:28.354861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff8e4c-99f4-4d76-9c34-9b666102a118 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:28.363672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff8e4c-99f4-4d76-9c34-9b666102a118 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:28.368233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ec548-0861-467f-99a6-71702b58ffd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:28.368867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ec548-0861-467f-99a6-71702b58ffd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:28.369183 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ec548-0861-467f-99a6-71702b58ffd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:28.369460 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ec548-0861-467f-99a6-71702b58ffd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:28.370152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ec548-0861-467f-99a6-71702b58ffd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:28.372087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ec548-0861-467f-99a6-71702b58ffd2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:28.397371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1336/2651] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:34:28 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:34:28.401303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccef19-d45e-44a5-8c4c-054db1054f07 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:28.411559 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccef19-d45e-44a5-8c4c-054db1054f07 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:28.465804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969e548-3751-499a-9760-c26144048091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:28.466472 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969e548-3751-499a-9760-c26144048091 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:28.466759 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969e548-3751-499a-9760-c26144048091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:28.467037 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969e548-3751-499a-9760-c26144048091 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:28.467732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969e548-3751-499a-9760-c26144048091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:28.469818 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969e548-3751-499a-9760-c26144048091 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:28.488365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1316/2652] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:34:28 2022] POST /identity/v3/users => generated 283 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:34:28.492517 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ec548-0861-467f-99a6-71702b58ffd2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:28.502922 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ec548-0861-467f-99a6-71702b58ffd2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:28.507539 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4de76-63b6-4926-b6af-d0bb21bb2b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:28.508187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4de76-63b6-4926-b6af-d0bb21bb2b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:28.508468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4de76-63b6-4926-b6af-d0bb21bb2b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:28.508742 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4de76-63b6-4926-b6af-d0bb21bb2b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:28.509498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4de76-63b6-4926-b6af-d0bb21bb2b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:28.511095 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df4de76-63b6-4926-b6af-d0bb21bb2b91 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:28.521277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1337/2653] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:28.524931 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969e548-3751-499a-9760-c26144048091 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:28.534585 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969e548-3751-499a-9760-c26144048091 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:28.539232 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91567026-f6f0-4a4e-aaf2-f3f02132ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:28.539889 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91567026-f6f0-4a4e-aaf2-f3f02132ebdf admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:28.540175 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91567026-f6f0-4a4e-aaf2-f3f02132ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:28.540455 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91567026-f6f0-4a4e-aaf2-f3f02132ebdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:28.541209 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91567026-f6f0-4a4e-aaf2-f3f02132ebdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:28.543325 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91567026-f6f0-4a4e-aaf2-f3f02132ebdf admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:28.553528 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1317/2654] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:28.557455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4de76-63b6-4926-b6af-d0bb21bb2b91 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:28.567610 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df4de76-63b6-4926-b6af-d0bb21bb2b91 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:28.572355 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86325ba-85d5-4c75-afe4-feb355701038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:28.573253 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86325ba-85d5-4c75-afe4-feb355701038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:28.573534 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86325ba-85d5-4c75-afe4-feb355701038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:28.573808 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86325ba-85d5-4c75-afe4-feb355701038 admin admin] PATH_INFO: `/v3/projects/0f82ebb83c5f40c59d2d54a073567887/users/8b8a2e21eb5c4cc28f366cf8fd4d4f6e/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:28.588660 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86325ba-85d5-4c75-afe4-feb355701038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f82ebb83c5f40c59d2d54a073567887, user_id=8b8a2e21eb5c4cc28f366cf8fd4d4f6e, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:28.591307 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86325ba-85d5-4c75-afe4-feb355701038 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:28.603373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1338/2655] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:28 2022] PUT /identity/v3/projects/0f82ebb83c5f40c59d2d54a073567887/users/8b8a2e21eb5c4cc28f366cf8fd4d4f6e/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:34:28.614497 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c902814-27f0-46b0-af2a-e6b813a1b1e7 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:28.614789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c902814-27f0-46b0-af2a-e6b813a1b1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:28.615097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c902814-27f0-46b0-af2a-e6b813a1b1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:28.641038 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-3c902814-27f0-46b0-af2a-e6b813a1b1e7 None None] MFA Rules not processed for user `8b8a2e21eb5c4cc28f366cf8fd4d4f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:28.642218 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3c902814-27f0-46b0-af2a-e6b813a1b1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:28.706761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1318/2656] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:28.718273 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86325ba-85d5-4c75-afe4-feb355701038 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:28.720027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e86325ba-85d5-4c75-afe4-feb355701038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:28.773665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86325ba-85d5-4c75-afe4-feb355701038 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:28.778029 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d64e3-8687-4c60-b74a-157c3f00262f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:28.778700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d64e3-8687-4c60-b74a-157c3f00262f service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:28.778980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d64e3-8687-4c60-b74a-157c3f00262f service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:28.779253 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d64e3-8687-4c60-b74a-157c3f00262f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:28.787414 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d64e3-8687-4c60-b74a-157c3f00262f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:28.788768 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d64e3-8687-4c60-b74a-157c3f00262f service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:28.797716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1339/2657] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:29.981830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c902814-27f0-46b0-af2a-e6b813a1b1e7 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:29.983344 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3c902814-27f0-46b0-af2a-e6b813a1b1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:30.045170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c902814-27f0-46b0-af2a-e6b813a1b1e7 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:30.049655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc670333-9e32-4206-8db6-b1db0ad5c862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:30.050520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc670333-9e32-4206-8db6-b1db0ad5c862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:30.050800 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc670333-9e32-4206-8db6-b1db0ad5c862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:30.051193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc670333-9e32-4206-8db6-b1db0ad5c862 admin admin] PATH_INFO: `/v3/users/5b37fe0198f240cdab923e161a3bddf8` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:30.052270 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc670333-9e32-4206-8db6-b1db0ad5c862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b37fe0198f240cdab923e161a3bddf8)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:30.054200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc670333-9e32-4206-8db6-b1db0ad5c862 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:30.098254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-fc670333-9e32-4206-8db6-b1db0ad5c862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b37fe0198f240cdab923e161a3bddf8'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.098915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-fc670333-9e32-4206-8db6-b1db0ad5c862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b37fe0198f240cdab923e161a3bddf8'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.111354 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-fc670333-9e32-4206-8db6-b1db0ad5c862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b37fe0198f240cdab923e161a3bddf8'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.117821 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-fc670333-9e32-4206-8db6-b1db0ad5c862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b37fe0198f240cdab923e161a3bddf8'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.125869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-fc670333-9e32-4206-8db6-b1db0ad5c862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b37fe0198f240cdab923e161a3bddf8'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.132072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1319/2658] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:34:29 2022] DELETE /identity/v3/users/5b37fe0198f240cdab923e161a3bddf8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:30.136466 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4940c46-9a95-40d2-be3e-6d9142c1cb07 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:30.136896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4940c46-9a95-40d2-be3e-6d9142c1cb07 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:30.137206 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4940c46-9a95-40d2-be3e-6d9142c1cb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:30.156045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c4940c46-9a95-40d2-be3e-6d9142c1cb07 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:30.157293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c4940c46-9a95-40d2-be3e-6d9142c1cb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:30.216195 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1340/2659] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:30.225667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc670333-9e32-4206-8db6-b1db0ad5c862 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:30.227160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fc670333-9e32-4206-8db6-b1db0ad5c862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:30.291382 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc670333-9e32-4206-8db6-b1db0ad5c862 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:30.295683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f26d6-2e4b-4e9e-830b-ab2fe2a64af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:30.296328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f26d6-2e4b-4e9e-830b-ab2fe2a64af6 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:30.296611 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f26d6-2e4b-4e9e-830b-ab2fe2a64af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:30.296884 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f26d6-2e4b-4e9e-830b-ab2fe2a64af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:30.305779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f26d6-2e4b-4e9e-830b-ab2fe2a64af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:30.307199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f26d6-2e4b-4e9e-830b-ab2fe2a64af6 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:30.316537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1320/2660] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:30.596087 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4940c46-9a95-40d2-be3e-6d9142c1cb07 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:30.597633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c4940c46-9a95-40d2-be3e-6d9142c1cb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:30.620861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4940c46-9a95-40d2-be3e-6d9142c1cb07 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:30.631402 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:30.632284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:30.632566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:30.632840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] PATH_INFO: `/v3/projects/27188f6530fe4ff48f73e1cdc018b786` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:30.634126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27188f6530fe4ff48f73e1cdc018b786)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:30.636050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:30.682448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27188f6530fe4ff48f73e1cdc018b786', 'request_id': 'req-ce3f06c7-e6c9-4ad9-af80-22accf35c970'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.688463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27188f6530fe4ff48f73e1cdc018b786', 'request_id': 'req-ce3f06c7-e6c9-4ad9-af80-22accf35c970'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.698433 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27188f6530fe4ff48f73e1cdc018b786', 'request_id': 'req-ce3f06c7-e6c9-4ad9-af80-22accf35c970'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.713809 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] The token cache is being invalidate because project 27188f6530fe4ff48f73e1cdc018b786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:34:30.714099 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.715257 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.717014 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1341/2661] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:34:30 2022] DELETE /identity/v3/projects/27188f6530fe4ff48f73e1cdc018b786 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:30.720910 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f26d6-2e4b-4e9e-830b-ab2fe2a64af6 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:30.730308 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f26d6-2e4b-4e9e-830b-ab2fe2a64af6 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:30.785603 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed4ddc-dea8-4424-af53-f5c45969850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:30.786464 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed4ddc-dea8-4424-af53-f5c45969850d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:30.786746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed4ddc-dea8-4424-af53-f5c45969850d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:30.787021 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed4ddc-dea8-4424-af53-f5c45969850d admin admin] PATH_INFO: `/v3/users/d0bcb62b6aa645b19b9ccf816699a85b` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:30.788198 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed4ddc-dea8-4424-af53-f5c45969850d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0bcb62b6aa645b19b9ccf816699a85b)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:30.790243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed4ddc-dea8-4424-af53-f5c45969850d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:30.835669 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-90ed4ddc-dea8-4424-af53-f5c45969850d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0bcb62b6aa645b19b9ccf816699a85b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.836340 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-90ed4ddc-dea8-4424-af53-f5c45969850d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0bcb62b6aa645b19b9ccf816699a85b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.848122 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-90ed4ddc-dea8-4424-af53-f5c45969850d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0bcb62b6aa645b19b9ccf816699a85b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.854955 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-90ed4ddc-dea8-4424-af53-f5c45969850d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0bcb62b6aa645b19b9ccf816699a85b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.861788 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-90ed4ddc-dea8-4424-af53-f5c45969850d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0bcb62b6aa645b19b9ccf816699a85b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:30.867515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1321/2662] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:34:30 2022] DELETE /identity/v3/users/d0bcb62b6aa645b19b9ccf816699a85b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:31.130037 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:31.131500 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:31.150741 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f06c7-e6c9-4ad9-af80-22accf35c970 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:31.204503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26dcba-1797-4902-940d-384e71c929b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:31.205394 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26dcba-1797-4902-940d-384e71c929b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:31.205680 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26dcba-1797-4902-940d-384e71c929b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:31.205957 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26dcba-1797-4902-940d-384e71c929b7 admin admin] PATH_INFO: `/v3/projects/74880c9a4a994776b7b401ae5997f8e6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:31.207117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26dcba-1797-4902-940d-384e71c929b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74880c9a4a994776b7b401ae5997f8e6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:31.209045 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26dcba-1797-4902-940d-384e71c929b7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:31.252513 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7b26dcba-1797-4902-940d-384e71c929b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74880c9a4a994776b7b401ae5997f8e6', 'request_id': 'req-7b26dcba-1797-4902-940d-384e71c929b7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:31.259598 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7b26dcba-1797-4902-940d-384e71c929b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74880c9a4a994776b7b401ae5997f8e6', 'request_id': 'req-7b26dcba-1797-4902-940d-384e71c929b7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:31.266046 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7b26dcba-1797-4902-940d-384e71c929b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74880c9a4a994776b7b401ae5997f8e6', 'request_id': 'req-7b26dcba-1797-4902-940d-384e71c929b7'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:31.278211 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7b26dcba-1797-4902-940d-384e71c929b7 admin admin] The token cache is being invalidate because project 74880c9a4a994776b7b401ae5997f8e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:34:31.278494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7b26dcba-1797-4902-940d-384e71c929b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:31.279118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-7b26dcba-1797-4902-940d-384e71c929b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:31.280638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1342/2663] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:34:31 2022] DELETE /identity/v3/projects/74880c9a4a994776b7b401ae5997f8e6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:31.286481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0f24-b59d-463f-a036-ec12b196c01e None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:31.286969 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0f24-b59d-463f-a036-ec12b196c01e None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:31.287070 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0f24-b59d-463f-a036-ec12b196c01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:31.304521 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-79dd0f24-b59d-463f-a036-ec12b196c01e None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:31.305736 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-79dd0f24-b59d-463f-a036-ec12b196c01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:31.362249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1322/2664] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:34:31.372207 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d98b4b-1167-4b8c-a4a8-dd9d728edc0a None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:31.372499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d98b4b-1167-4b8c-a4a8-dd9d728edc0a None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:31.372773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d98b4b-1167-4b8c-a4a8-dd9d728edc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:31.390414 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-f1d98b4b-1167-4b8c-a4a8-dd9d728edc0a None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:31.391581 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f1d98b4b-1167-4b8c-a4a8-dd9d728edc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:31.399550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1343/2665] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:31.403702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0f24-b59d-463f-a036-ec12b196c01e None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:31.413334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0f24-b59d-463f-a036-ec12b196c01e None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:31.418425 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4bc1-20e2-47e7-ba39-be574e12788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:31.419077 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4bc1-20e2-47e7-ba39-be574e12788f admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:31.419363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4bc1-20e2-47e7-ba39-be574e12788f admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:31.419643 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4bc1-20e2-47e7-ba39-be574e12788f admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:31.420371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde4bc1-20e2-47e7-ba39-be574e12788f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:34:31.420686 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde4bc1-20e2-47e7-ba39-be574e12788f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:31.422361 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde4bc1-20e2-47e7-ba39-be574e12788f admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:31.434182 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1323/2666] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:34:31.438452 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d98b4b-1167-4b8c-a4a8-dd9d728edc0a None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:31.447415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d98b4b-1167-4b8c-a4a8-dd9d728edc0a None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:31.452015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aa0b9-8003-457a-9d9a-b71bae824420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:31.452651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aa0b9-8003-457a-9d9a-b71bae824420 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:31.452931 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aa0b9-8003-457a-9d9a-b71bae824420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:31.453233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3aa0b9-8003-457a-9d9a-b71bae824420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:31.453920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3aa0b9-8003-457a-9d9a-b71bae824420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:31.455832 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3aa0b9-8003-457a-9d9a-b71bae824420 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:31.480499 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1344/2667] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:34:31 2022] POST /identity/v3/projects => generated 369 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:31.484082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4bc1-20e2-47e7-ba39-be574e12788f admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:31.493775 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4bc1-20e2-47e7-ba39-be574e12788f admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:31.548667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e303a4-f395-4325-9d2f-349b60d2d337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:31.549241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e303a4-f395-4325-9d2f-349b60d2d337 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:31.549520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e303a4-f395-4325-9d2f-349b60d2d337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:31.549803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e303a4-f395-4325-9d2f-349b60d2d337 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:31.550470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e303a4-f395-4325-9d2f-349b60d2d337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:31.552426 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e303a4-f395-4325-9d2f-349b60d2d337 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:31.570954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1324/2668] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:34:31 2022] POST /identity/v3/users => generated 285 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:31.575055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aa0b9-8003-457a-9d9a-b71bae824420 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:31.585342 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3aa0b9-8003-457a-9d9a-b71bae824420 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:31.590096 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8f60d-25fa-42cd-a81f-40f30d683f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:31.590760 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8f60d-25fa-42cd-a81f-40f30d683f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:31.591043 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8f60d-25fa-42cd-a81f-40f30d683f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:31.591318 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8f60d-25fa-42cd-a81f-40f30d683f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:31.592039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8f60d-25fa-42cd-a81f-40f30d683f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:31.593676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8f60d-25fa-42cd-a81f-40f30d683f0e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:31.603948 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1345/2669] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:31.608603 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e303a4-f395-4325-9d2f-349b60d2d337 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:31.628302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e303a4-f395-4325-9d2f-349b60d2d337 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:31.628302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb8fe0-642c-41dd-b3fe-0ee2bfcaff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:31.628302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb8fe0-642c-41dd-b3fe-0ee2bfcaff46 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:31.628302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb8fe0-642c-41dd-b3fe-0ee2bfcaff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:31.628667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb8fe0-642c-41dd-b3fe-0ee2bfcaff46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:31.628667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb8fe0-642c-41dd-b3fe-0ee2bfcaff46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:31.628667 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb8fe0-642c-41dd-b3fe-0ee2bfcaff46 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:31.637328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1325/2670] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:31.641338 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8f60d-25fa-42cd-a81f-40f30d683f0e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:31.651418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8f60d-25fa-42cd-a81f-40f30d683f0e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:31.656494 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d4d70-c036-4a45-a24e-ed701578d033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:31.657469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d4d70-c036-4a45-a24e-ed701578d033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:31.657907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d4d70-c036-4a45-a24e-ed701578d033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:31.658194 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d4d70-c036-4a45-a24e-ed701578d033 admin admin] PATH_INFO: `/v3/projects/4bfee9248c574961a5339c32c14fbdfc/users/26e4844f05434b5182904fad110c9b6a/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:31.678979 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d4d70-c036-4a45-a24e-ed701578d033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfee9248c574961a5339c32c14fbdfc, user_id=26e4844f05434b5182904fad110c9b6a, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:31.681729 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d4d70-c036-4a45-a24e-ed701578d033 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:31.695024 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1346/2671] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:31 2022] PUT /identity/v3/projects/4bfee9248c574961a5339c32c14fbdfc/users/26e4844f05434b5182904fad110c9b6a/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:31.706121 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8318a4-68b6-4449-a8ae-5305185b739b None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:31.706416 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8318a4-68b6-4449-a8ae-5305185b739b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:31.706689 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8318a4-68b6-4449-a8ae-5305185b739b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:31.736790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-7e8318a4-68b6-4449-a8ae-5305185b739b None None] MFA Rules not processed for user `26e4844f05434b5182904fad110c9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:31.738003 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7e8318a4-68b6-4449-a8ae-5305185b739b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:31.802065 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1326/2672] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:31.813527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d4d70-c036-4a45-a24e-ed701578d033 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:31.815181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e28d4d70-c036-4a45-a24e-ed701578d033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:31.868611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d4d70-c036-4a45-a24e-ed701578d033 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:31.872229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48535fe0-e90c-4c95-b5ad-a1bc3684ecb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:31.872860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48535fe0-e90c-4c95-b5ad-a1bc3684ecb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:31.873173 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48535fe0-e90c-4c95-b5ad-a1bc3684ecb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:31.873446 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48535fe0-e90c-4c95-b5ad-a1bc3684ecb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:31.881599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48535fe0-e90c-4c95-b5ad-a1bc3684ecb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:31.883215 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48535fe0-e90c-4c95-b5ad-a1bc3684ecb4 service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:31.892199 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1347/2673] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:31.912226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8318a4-68b6-4449-a8ae-5305185b739b None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:31.973125 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8318a4-68b6-4449-a8ae-5305185b739b None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:31.978000 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c2758-4a3a-4a22-bfbf-ae29af7ea8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:31.978868 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c2758-4a3a-4a22-bfbf-ae29af7ea8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:31.979156 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c2758-4a3a-4a22-bfbf-ae29af7ea8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:31.979432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c2758-4a3a-4a22-bfbf-ae29af7ea8bd admin admin] PATH_INFO: `/v3/users/26e4844f05434b5182904fad110c9b6a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:31.981259 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c2758-4a3a-4a22-bfbf-ae29af7ea8bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e4844f05434b5182904fad110c9b6a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:31.983180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c2758-4a3a-4a22-bfbf-ae29af7ea8bd admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:32.026778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d23c2758-4a3a-4a22-bfbf-ae29af7ea8bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e4844f05434b5182904fad110c9b6a'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:32.027990 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d23c2758-4a3a-4a22-bfbf-ae29af7ea8bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e4844f05434b5182904fad110c9b6a'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:32.039227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d23c2758-4a3a-4a22-bfbf-ae29af7ea8bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e4844f05434b5182904fad110c9b6a'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:32.045750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d23c2758-4a3a-4a22-bfbf-ae29af7ea8bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e4844f05434b5182904fad110c9b6a'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:32.052853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-d23c2758-4a3a-4a22-bfbf-ae29af7ea8bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e4844f05434b5182904fad110c9b6a'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:32.058827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1327/2674] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:34:31 2022] DELETE /identity/v3/users/26e4844f05434b5182904fad110c9b6a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:32.063299 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b4101-7fed-4cf8-a4f2-9e96621e5a73 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:32.063609 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b4101-7fed-4cf8-a4f2-9e96621e5a73 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:32.063941 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b4101-7fed-4cf8-a4f2-9e96621e5a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:32.081463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5e1b4101-7fed-4cf8-a4f2-9e96621e5a73 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:32.082650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5e1b4101-7fed-4cf8-a4f2-9e96621e5a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:32.139638 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1348/2675] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:32.149648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c2758-4a3a-4a22-bfbf-ae29af7ea8bd admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:32.151052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d23c2758-4a3a-4a22-bfbf-ae29af7ea8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:32.206101 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c2758-4a3a-4a22-bfbf-ae29af7ea8bd admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:32.209793 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f5a39-7bb1-491e-9b54-66feaee2276c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:32.210432 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f5a39-7bb1-491e-9b54-66feaee2276c service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:32.210719 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f5a39-7bb1-491e-9b54-66feaee2276c service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:32.210996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f5a39-7bb1-491e-9b54-66feaee2276c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:32.220152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f5a39-7bb1-491e-9b54-66feaee2276c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:32.221614 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f5a39-7bb1-491e-9b54-66feaee2276c service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:32.230888 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1328/2676] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:34:32.485480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b4101-7fed-4cf8-a4f2-9e96621e5a73 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:32.486894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5e1b4101-7fed-4cf8-a4f2-9e96621e5a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:32.499284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b4101-7fed-4cf8-a4f2-9e96621e5a73 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:32.504111 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:32.505080 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:32.505455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:32.505735 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5 admin admin] PATH_INFO: `/v3/projects/4bfee9248c574961a5339c32c14fbdfc` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:32.506908 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bfee9248c574961a5339c32c14fbdfc)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:32.508837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:32.554188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bfee9248c574961a5339c32c14fbdfc', 'request_id': 'req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:32.559916 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bfee9248c574961a5339c32c14fbdfc', 'request_id': 'req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:32.565804 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bfee9248c574961a5339c32c14fbdfc', 'request_id': 'req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:32.577784 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5 admin admin] The token cache is being invalidate because project 4bfee9248c574961a5339c32c14fbdfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:34:32.578008 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:32.578618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fc5638ab-7443-4814-87b7-b3ae9bfe6da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:34:32.580129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1349/2677] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:34:32 2022] DELETE /identity/v3/projects/4bfee9248c574961a5339c32c14fbdfc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:32.585152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e727ed2-16b8-4f88-b373-37951feecbc9 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:32.585619 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e727ed2-16b8-4f88-b373-37951feecbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:32.585718 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e727ed2-16b8-4f88-b373-37951feecbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:32.603000 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-3e727ed2-16b8-4f88-b373-37951feecbc9 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:32.604179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3e727ed2-16b8-4f88-b373-37951feecbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:32.661894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1329/2678] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:32.670116 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a46a8-152e-4b35-b8aa-5e73e2b1b00d None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:32.670441 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a46a8-152e-4b35-b8aa-5e73e2b1b00d None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:32.670727 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a46a8-152e-4b35-b8aa-5e73e2b1b00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:32.688582 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-606a46a8-152e-4b35-b8aa-5e73e2b1b00d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:32.689812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-606a46a8-152e-4b35-b8aa-5e73e2b1b00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:32.697713 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1350/2679] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:32.702355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e727ed2-16b8-4f88-b373-37951feecbc9 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:32.716584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e727ed2-16b8-4f88-b373-37951feecbc9 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:32.721503 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf9f1f-63ca-46bb-b314-8ec678fee006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:32.722180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf9f1f-63ca-46bb-b314-8ec678fee006 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:32.722496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf9f1f-63ca-46bb-b314-8ec678fee006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:32.722774 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf9f1f-63ca-46bb-b314-8ec678fee006 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:32.723510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf9f1f-63ca-46bb-b314-8ec678fee006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:34:32.723823 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf9f1f-63ca-46bb-b314-8ec678fee006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:32.725541 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf9f1f-63ca-46bb-b314-8ec678fee006 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:32.738173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1330/2680] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:34:32.742554 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a46a8-152e-4b35-b8aa-5e73e2b1b00d None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:32.752181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a46a8-152e-4b35-b8aa-5e73e2b1b00d None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:32.757147 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b5d72-47eb-4dca-a9d7-9eda58b1651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:32.757939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b5d72-47eb-4dca-a9d7-9eda58b1651d admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:32.758291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b5d72-47eb-4dca-a9d7-9eda58b1651d admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:32.758655 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b5d72-47eb-4dca-a9d7-9eda58b1651d admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:32.760011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b5d72-47eb-4dca-a9d7-9eda58b1651d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:32.762489 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b5d72-47eb-4dca-a9d7-9eda58b1651d admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:32.799633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1351/2681] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:34:32 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:32.804496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf9f1f-63ca-46bb-b314-8ec678fee006 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:32.813854 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf9f1f-63ca-46bb-b314-8ec678fee006 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:32.879143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7d70-56d0-4873-bee7-40af9ed71ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:32.879827 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7d70-56d0-4873-bee7-40af9ed71ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:32.880125 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7d70-56d0-4873-bee7-40af9ed71ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:32.880401 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7d70-56d0-4873-bee7-40af9ed71ea7 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:32.881149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd7d70-56d0-4873-bee7-40af9ed71ea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:32.883098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd7d70-56d0-4873-bee7-40af9ed71ea7 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:32.907933 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1331/2682] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:34:32 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:34:32.908772 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b5d72-47eb-4dca-a9d7-9eda58b1651d admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:32.926813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b5d72-47eb-4dca-a9d7-9eda58b1651d admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:32.932022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9c4e6-9bdd-4c52-8042-bee3371eb8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:32.932695 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9c4e6-9bdd-4c52-8042-bee3371eb8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:32.933055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9c4e6-9bdd-4c52-8042-bee3371eb8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:32.933362 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9c4e6-9bdd-4c52-8042-bee3371eb8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:32.934123 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9c4e6-9bdd-4c52-8042-bee3371eb8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:32.935762 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9c4e6-9bdd-4c52-8042-bee3371eb8a1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:32.946383 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1352/2683] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:34:32.951069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7d70-56d0-4873-bee7-40af9ed71ea7 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:32.961181 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7d70-56d0-4873-bee7-40af9ed71ea7 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:32.966648 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84394b3-3340-439a-adce-05ed90c9c3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:32.967321 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84394b3-3340-439a-adce-05ed90c9c3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:32.967613 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84394b3-3340-439a-adce-05ed90c9c3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:32.967894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84394b3-3340-439a-adce-05ed90c9c3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:32.968761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84394b3-3340-439a-adce-05ed90c9c3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:32.970716 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84394b3-3340-439a-adce-05ed90c9c3a8 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:32.985387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1332/2684] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:34:32.989452 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9c4e6-9bdd-4c52-8042-bee3371eb8a1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:32.999200 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9c4e6-9bdd-4c52-8042-bee3371eb8a1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:33.004023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad65ab6-e59e-4ad1-96b3-0bde847dcee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:33.004927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65ab6-e59e-4ad1-96b3-0bde847dcee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:33.005210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65ab6-e59e-4ad1-96b3-0bde847dcee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:33.005481 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad65ab6-e59e-4ad1-96b3-0bde847dcee1 admin admin] PATH_INFO: `/v3/projects/dd30322cfe354116bd2f588162ee6f6e/users/e4283657b363493cad2e9ba6f192788c/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:33.020507 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad65ab6-e59e-4ad1-96b3-0bde847dcee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd30322cfe354116bd2f588162ee6f6e, user_id=e4283657b363493cad2e9ba6f192788c, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:33.023216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad65ab6-e59e-4ad1-96b3-0bde847dcee1 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:33.035699 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1353/2685] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:34:32 2022] PUT /identity/v3/projects/dd30322cfe354116bd2f588162ee6f6e/users/e4283657b363493cad2e9ba6f192788c/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:34:33.050806 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3a666-3682-47c1-9bfc-70f45a2462d3 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:33.051105 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3a666-3682-47c1-9bfc-70f45a2462d3 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:33.051387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3a666-3682-47c1-9bfc-70f45a2462d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:33.081616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-9af3a666-3682-47c1-9bfc-70f45a2462d3 None None] MFA Rules not processed for user `e4283657b363493cad2e9ba6f192788c`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:34:33.083220 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9af3a666-3682-47c1-9bfc-70f45a2462d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:33.146519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1333/2686] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:34:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:34:33.158549 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad65ab6-e59e-4ad1-96b3-0bde847dcee1 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:34:33.160186 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-dad65ab6-e59e-4ad1-96b3-0bde847dcee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:34:33.213655 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad65ab6-e59e-4ad1-96b3-0bde847dcee1 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:34:33.217251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883a00b-08cc-429f-9d23-593415c821ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f59e7ae8da841dc809355fa8e4be488', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:34:33.217885 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883a00b-08cc-429f-9d23-593415c821ca service glance] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:34:33.218164 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883a00b-08cc-429f-9d23-593415c821ca service glance] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:34:33.218436 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883a00b-08cc-429f-9d23-593415c821ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:34:33.226313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883a00b-08cc-429f-9d23-593415c821ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:34:33.227727 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883a00b-08cc-429f-9d23-593415c821ca service glance] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:34:33.236132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1354/2687] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:34:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:35:09.409427 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3a666-3682-47c1-9bfc-70f45a2462d3 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:09.468303 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3a666-3682-47c1-9bfc-70f45a2462d3 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:09.472764 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbed3c-0459-46d2-8a7c-dd4b0261bcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:09.473662 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbed3c-0459-46d2-8a7c-dd4b0261bcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:09.473941 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbed3c-0459-46d2-8a7c-dd4b0261bcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:09.474212 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbed3c-0459-46d2-8a7c-dd4b0261bcb4 admin admin] PATH_INFO: `/v3/users/e4283657b363493cad2e9ba6f192788c` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:09.475380 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbed3c-0459-46d2-8a7c-dd4b0261bcb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4283657b363493cad2e9ba6f192788c)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:09.477295 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbed3c-0459-46d2-8a7c-dd4b0261bcb4 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:09.520853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4fdbed3c-0459-46d2-8a7c-dd4b0261bcb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4283657b363493cad2e9ba6f192788c'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:09.521537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4fdbed3c-0459-46d2-8a7c-dd4b0261bcb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4283657b363493cad2e9ba6f192788c'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:09.532679 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4fdbed3c-0459-46d2-8a7c-dd4b0261bcb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4283657b363493cad2e9ba6f192788c'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:09.539069 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4fdbed3c-0459-46d2-8a7c-dd4b0261bcb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4283657b363493cad2e9ba6f192788c'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:09.546436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-4fdbed3c-0459-46d2-8a7c-dd4b0261bcb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4283657b363493cad2e9ba6f192788c'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:09.552252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1334/2688] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:35:09 2022] DELETE /identity/v3/users/e4283657b363493cad2e9ba6f192788c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:35:09.556857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511106b-7c11-4edd-a1c6-4fbb720f77f4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:09.557383 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511106b-7c11-4edd-a1c6-4fbb720f77f4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:09.557490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511106b-7c11-4edd-a1c6-4fbb720f77f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:09.574769 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-5511106b-7c11-4edd-a1c6-4fbb720f77f4 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:09.575967 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5511106b-7c11-4edd-a1c6-4fbb720f77f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:09.631596 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1355/2689] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:09.641234 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbed3c-0459-46d2-8a7c-dd4b0261bcb4 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:09.642829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-4fdbed3c-0459-46d2-8a7c-dd4b0261bcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:09.699657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbed3c-0459-46d2-8a7c-dd4b0261bcb4 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:09.705817 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e1f41-af5c-4b1b-bfbe-79c1beb941a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:09.706476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e1f41-af5c-4b1b-bfbe-79c1beb941a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:09.706789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e1f41-af5c-4b1b-bfbe-79c1beb941a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:09.707064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e1f41-af5c-4b1b-bfbe-79c1beb941a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:09.716844 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e1f41-af5c-4b1b-bfbe-79c1beb941a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:09.718169 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e1f41-af5c-4b1b-bfbe-79c1beb941a0 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:09.727507 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1335/2690] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:35:09.997075 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511106b-7c11-4edd-a1c6-4fbb720f77f4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:09.999277 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5511106b-7c11-4edd-a1c6-4fbb720f77f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:10.012366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511106b-7c11-4edd-a1c6-4fbb720f77f4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:10.018109 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a659ffa7-324e-4e1a-9f10-174135e42733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:10.020032 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659ffa7-324e-4e1a-9f10-174135e42733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:10.020331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659ffa7-324e-4e1a-9f10-174135e42733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:10.020700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659ffa7-324e-4e1a-9f10-174135e42733 admin admin] PATH_INFO: `/v3/projects/dd30322cfe354116bd2f588162ee6f6e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:10.021995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659ffa7-324e-4e1a-9f10-174135e42733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd30322cfe354116bd2f588162ee6f6e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:10.023898 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a659ffa7-324e-4e1a-9f10-174135e42733 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:10.068590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a659ffa7-324e-4e1a-9f10-174135e42733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd30322cfe354116bd2f588162ee6f6e', 'request_id': 'req-a659ffa7-324e-4e1a-9f10-174135e42733'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:10.073856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a659ffa7-324e-4e1a-9f10-174135e42733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd30322cfe354116bd2f588162ee6f6e', 'request_id': 'req-a659ffa7-324e-4e1a-9f10-174135e42733'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:10.080320 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a659ffa7-324e-4e1a-9f10-174135e42733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd30322cfe354116bd2f588162ee6f6e', 'request_id': 'req-a659ffa7-324e-4e1a-9f10-174135e42733'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:10.092517 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a659ffa7-324e-4e1a-9f10-174135e42733 admin admin] The token cache is being invalidate because project dd30322cfe354116bd2f588162ee6f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:35:10.092805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a659ffa7-324e-4e1a-9f10-174135e42733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:10.093463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-a659ffa7-324e-4e1a-9f10-174135e42733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:10.094988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1356/2691] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:35:09 2022] DELETE /identity/v3/projects/dd30322cfe354116bd2f588162ee6f6e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:35:10.099761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42636eb7-e136-4ea4-a406-4afe9d69a848 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:10.100053 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42636eb7-e136-4ea4-a406-4afe9d69a848 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:10.100334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42636eb7-e136-4ea4-a406-4afe9d69a848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:10.118407 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-42636eb7-e136-4ea4-a406-4afe9d69a848 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:10.120151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-42636eb7-e136-4ea4-a406-4afe9d69a848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:10.183040 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1336/2692] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:10.191242 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a145202-afd5-456a-adef-aaf7da64af0b None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:10.191533 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a145202-afd5-456a-adef-aaf7da64af0b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:10.191812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a145202-afd5-456a-adef-aaf7da64af0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:10.209336 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8a145202-afd5-456a-adef-aaf7da64af0b None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:10.210509 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8a145202-afd5-456a-adef-aaf7da64af0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:10.218600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1357/2693] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:10.222522 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42636eb7-e136-4ea4-a406-4afe9d69a848 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:10.232600 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42636eb7-e136-4ea4-a406-4afe9d69a848 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:10.237180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee4d1a-78a5-4c21-a426-7e4d41f06b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:10.237829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4d1a-78a5-4c21-a426-7e4d41f06b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:10.238111 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4d1a-78a5-4c21-a426-7e4d41f06b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:10.238383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4d1a-78a5-4c21-a426-7e4d41f06b1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:10.239100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee4d1a-78a5-4c21-a426-7e4d41f06b1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:35:10.239408 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee4d1a-78a5-4c21-a426-7e4d41f06b1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:10.240995 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee4d1a-78a5-4c21-a426-7e4d41f06b1b admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:10.252630 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1337/2694] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:35:10.256566 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a145202-afd5-456a-adef-aaf7da64af0b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:10.265368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a145202-afd5-456a-adef-aaf7da64af0b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:10.270212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50440ade-0c40-4893-9891-c3496a01e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:10.270840 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50440ade-0c40-4893-9891-c3496a01e3ce admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:10.271121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50440ade-0c40-4893-9891-c3496a01e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:10.271396 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50440ade-0c40-4893-9891-c3496a01e3ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:10.272078 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50440ade-0c40-4893-9891-c3496a01e3ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:10.273995 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50440ade-0c40-4893-9891-c3496a01e3ce admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:10.299691 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1358/2695] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:35:10 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:35:10.303604 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee4d1a-78a5-4c21-a426-7e4d41f06b1b admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:10.313930 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee4d1a-78a5-4c21-a426-7e4d41f06b1b admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:10.366568 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30726-acc9-4f32-8eef-53a589dfaa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:10.367228 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30726-acc9-4f32-8eef-53a589dfaa6d admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:10.367512 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30726-acc9-4f32-8eef-53a589dfaa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:10.367787 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30726-acc9-4f32-8eef-53a589dfaa6d admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:10.368494 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30726-acc9-4f32-8eef-53a589dfaa6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:10.370467 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30726-acc9-4f32-8eef-53a589dfaa6d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:10.390317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1338/2696] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:35:10 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:35:10.394583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50440ade-0c40-4893-9891-c3496a01e3ce admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:10.404477 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50440ade-0c40-4893-9891-c3496a01e3ce admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:10.409039 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12e656-23c1-4707-a06e-b5e3bce06af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:10.409691 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12e656-23c1-4707-a06e-b5e3bce06af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:10.409979 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12e656-23c1-4707-a06e-b5e3bce06af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:10.410257 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b12e656-23c1-4707-a06e-b5e3bce06af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:10.410980 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b12e656-23c1-4707-a06e-b5e3bce06af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:10.412572 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b12e656-23c1-4707-a06e-b5e3bce06af8 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:10.423218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1359/2697] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:35:10.426888 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30726-acc9-4f32-8eef-53a589dfaa6d admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:10.437139 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30726-acc9-4f32-8eef-53a589dfaa6d admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:10.441656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805e02a-7415-4be5-a12f-c7f817f5f22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:10.442298 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805e02a-7415-4be5-a12f-c7f817f5f22d admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:10.442581 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805e02a-7415-4be5-a12f-c7f817f5f22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:10.442857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805e02a-7415-4be5-a12f-c7f817f5f22d admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:10.443584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805e02a-7415-4be5-a12f-c7f817f5f22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:10.445191 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805e02a-7415-4be5-a12f-c7f817f5f22d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:10.454644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1339/2698] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:35:10.458373 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12e656-23c1-4707-a06e-b5e3bce06af8 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:10.467842 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b12e656-23c1-4707-a06e-b5e3bce06af8 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:10.472395 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe63c0-ca69-4a97-8579-e5affa178cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:10.473284 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe63c0-ca69-4a97-8579-e5affa178cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:10.473590 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe63c0-ca69-4a97-8579-e5affa178cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:10.473865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe63c0-ca69-4a97-8579-e5affa178cc3 admin admin] PATH_INFO: `/v3/projects/8b5ed8728fd643c2ad0f974a4769fa2e/users/99f0a4841293439f95068a9490edb683/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:10.488313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe63c0-ca69-4a97-8579-e5affa178cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5ed8728fd643c2ad0f974a4769fa2e, user_id=99f0a4841293439f95068a9490edb683, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:10.490976 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe63c0-ca69-4a97-8579-e5affa178cc3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:10.504345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1360/2699] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:35:10 2022] PUT /identity/v3/projects/8b5ed8728fd643c2ad0f974a4769fa2e/users/99f0a4841293439f95068a9490edb683/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:35:10.515516 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803634e-a92c-47e2-b658-71e03bff5d39 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:10.515809 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803634e-a92c-47e2-b658-71e03bff5d39 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:10.516089 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803634e-a92c-47e2-b658-71e03bff5d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:10.542052 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-7803634e-a92c-47e2-b658-71e03bff5d39 None None] MFA Rules not processed for user `99f0a4841293439f95068a9490edb683`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:10.543280 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7803634e-a92c-47e2-b658-71e03bff5d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:10.605226 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1340/2700] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:10.616904 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe63c0-ca69-4a97-8579-e5affa178cc3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:10.618670 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-adbe63c0-ca69-4a97-8579-e5affa178cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:10.674589 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe63c0-ca69-4a97-8579-e5affa178cc3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:10.678165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92be876-689d-4bea-8e89-2d9ea317a73a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:10.678801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92be876-689d-4bea-8e89-2d9ea317a73a service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:10.679083 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92be876-689d-4bea-8e89-2d9ea317a73a service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:10.679357 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92be876-689d-4bea-8e89-2d9ea317a73a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:10.687453 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92be876-689d-4bea-8e89-2d9ea317a73a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:10.688813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92be876-689d-4bea-8e89-2d9ea317a73a service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:10.697259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1361/2701] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:35:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:35:10.828853 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803634e-a92c-47e2-b658-71e03bff5d39 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:10.830796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7803634e-a92c-47e2-b658-71e03bff5d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:10.896782 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803634e-a92c-47e2-b658-71e03bff5d39 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:10.901918 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de30ff-96f2-43f0-82d1-1308d33a382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:10.902815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de30ff-96f2-43f0-82d1-1308d33a382e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:10.903096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de30ff-96f2-43f0-82d1-1308d33a382e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:10.903366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de30ff-96f2-43f0-82d1-1308d33a382e admin admin] PATH_INFO: `/v3/users/8b8a2e21eb5c4cc28f366cf8fd4d4f6e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:10.905104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de30ff-96f2-43f0-82d1-1308d33a382e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8a2e21eb5c4cc28f366cf8fd4d4f6e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:10.907045 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de30ff-96f2-43f0-82d1-1308d33a382e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:10.959301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-66de30ff-96f2-43f0-82d1-1308d33a382e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8a2e21eb5c4cc28f366cf8fd4d4f6e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:10.963396 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-66de30ff-96f2-43f0-82d1-1308d33a382e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8a2e21eb5c4cc28f366cf8fd4d4f6e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:10.977477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-66de30ff-96f2-43f0-82d1-1308d33a382e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8a2e21eb5c4cc28f366cf8fd4d4f6e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:10.985195 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-66de30ff-96f2-43f0-82d1-1308d33a382e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8a2e21eb5c4cc28f366cf8fd4d4f6e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:10.993343 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-66de30ff-96f2-43f0-82d1-1308d33a382e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8a2e21eb5c4cc28f366cf8fd4d4f6e'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:11.001064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1341/2702] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:35:10 2022] DELETE /identity/v3/users/8b8a2e21eb5c4cc28f366cf8fd4d4f6e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:35:11.006988 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8090e7-156e-4349-8fb0-079fabc67bc8 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:11.007944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8090e7-156e-4349-8fb0-079fabc67bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:11.007944 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8090e7-156e-4349-8fb0-079fabc67bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:11.030839 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1d8090e7-156e-4349-8fb0-079fabc67bc8 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:11.032127 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1d8090e7-156e-4349-8fb0-079fabc67bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:11.089565 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1362/2703] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:35:11.099951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de30ff-96f2-43f0-82d1-1308d33a382e admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:11.101363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-66de30ff-96f2-43f0-82d1-1308d33a382e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:11.167483 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de30ff-96f2-43f0-82d1-1308d33a382e admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:11.171641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70098c7d-a720-4fd7-9b25-97cd8dc5165f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:11.172563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098c7d-a720-4fd7-9b25-97cd8dc5165f service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:11.173131 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098c7d-a720-4fd7-9b25-97cd8dc5165f service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:11.173619 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098c7d-a720-4fd7-9b25-97cd8dc5165f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:11.182996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70098c7d-a720-4fd7-9b25-97cd8dc5165f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:11.184433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70098c7d-a720-4fd7-9b25-97cd8dc5165f service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:11.193892 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1342/2704] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:35:11.456527 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8090e7-156e-4349-8fb0-079fabc67bc8 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:11.457954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1d8090e7-156e-4349-8fb0-079fabc67bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:11.470546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8090e7-156e-4349-8fb0-079fabc67bc8 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:11.475157 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1f99b-7d0b-4d05-8762-9434a079cba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:11.476017 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1f99b-7d0b-4d05-8762-9434a079cba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:11.476301 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1f99b-7d0b-4d05-8762-9434a079cba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:11.476596 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1f99b-7d0b-4d05-8762-9434a079cba6 admin admin] PATH_INFO: `/v3/projects/0f82ebb83c5f40c59d2d54a073567887` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:11.477815 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1f99b-7d0b-4d05-8762-9434a079cba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f82ebb83c5f40c59d2d54a073567887)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:11.479989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1f99b-7d0b-4d05-8762-9434a079cba6 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:11.532524 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b7e1f99b-7d0b-4d05-8762-9434a079cba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f82ebb83c5f40c59d2d54a073567887', 'request_id': 'req-b7e1f99b-7d0b-4d05-8762-9434a079cba6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:11.537722 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b7e1f99b-7d0b-4d05-8762-9434a079cba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f82ebb83c5f40c59d2d54a073567887', 'request_id': 'req-b7e1f99b-7d0b-4d05-8762-9434a079cba6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:11.543553 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b7e1f99b-7d0b-4d05-8762-9434a079cba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f82ebb83c5f40c59d2d54a073567887', 'request_id': 'req-b7e1f99b-7d0b-4d05-8762-9434a079cba6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:11.555221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b7e1f99b-7d0b-4d05-8762-9434a079cba6 admin admin] The token cache is being invalidate because project 0f82ebb83c5f40c59d2d54a073567887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:35:11.555523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b7e1f99b-7d0b-4d05-8762-9434a079cba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:11.556114 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-b7e1f99b-7d0b-4d05-8762-9434a079cba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:11.557673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1363/2705] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:35:11 2022] DELETE /identity/v3/projects/0f82ebb83c5f40c59d2d54a073567887 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:35:11.563405 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745f88c-6d6f-4a0d-b85e-97fd2138e917 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:11.563910 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745f88c-6d6f-4a0d-b85e-97fd2138e917 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:11.564008 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745f88c-6d6f-4a0d-b85e-97fd2138e917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:11.581552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-9745f88c-6d6f-4a0d-b85e-97fd2138e917 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:11.582723 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9745f88c-6d6f-4a0d-b85e-97fd2138e917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:11.637707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1343/2706] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:11.646275 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a8b30-7b26-4c1c-b241-2959117e64b2 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:11.646748 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a8b30-7b26-4c1c-b241-2959117e64b2 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:11.646846 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a8b30-7b26-4c1c-b241-2959117e64b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:11.664427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8c7a8b30-7b26-4c1c-b241-2959117e64b2 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:11.665632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8c7a8b30-7b26-4c1c-b241-2959117e64b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:11.673919 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1364/2707] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:11.677948 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745f88c-6d6f-4a0d-b85e-97fd2138e917 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:11.687937 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745f88c-6d6f-4a0d-b85e-97fd2138e917 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:11.692510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb088c-725a-4c1b-9fd9-70b81fbc57e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:11.693187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb088c-725a-4c1b-9fd9-70b81fbc57e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:11.693473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb088c-725a-4c1b-9fd9-70b81fbc57e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:11.693749 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb088c-725a-4c1b-9fd9-70b81fbc57e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:11.694496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb088c-725a-4c1b-9fd9-70b81fbc57e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:35:11.694803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb088c-725a-4c1b-9fd9-70b81fbc57e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:11.696384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb088c-725a-4c1b-9fd9-70b81fbc57e4 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:11.707624 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1344/2708] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:35:11.711564 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a8b30-7b26-4c1c-b241-2959117e64b2 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:11.720688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a8b30-7b26-4c1c-b241-2959117e64b2 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:11.725434 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806026c7-4d70-4535-93cd-e32d8dbcc21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:11.726069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806026c7-4d70-4535-93cd-e32d8dbcc21c admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:11.726439 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806026c7-4d70-4535-93cd-e32d8dbcc21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:11.726688 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806026c7-4d70-4535-93cd-e32d8dbcc21c admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:11.727296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806026c7-4d70-4535-93cd-e32d8dbcc21c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:11.729225 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806026c7-4d70-4535-93cd-e32d8dbcc21c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:11.756102 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1365/2709] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:35:11 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:35:11.760741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb088c-725a-4c1b-9fd9-70b81fbc57e4 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:11.770826 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb088c-725a-4c1b-9fd9-70b81fbc57e4 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:11.825265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c896c-7fed-4382-b8c3-45f1c1b38082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:11.825934 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c896c-7fed-4382-b8c3-45f1c1b38082 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:11.826219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c896c-7fed-4382-b8c3-45f1c1b38082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:11.826496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c896c-7fed-4382-b8c3-45f1c1b38082 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:11.827193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c896c-7fed-4382-b8c3-45f1c1b38082 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:11.829126 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c896c-7fed-4382-b8c3-45f1c1b38082 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:11.846760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1345/2710] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:35:11 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:35:11.850836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806026c7-4d70-4535-93cd-e32d8dbcc21c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:11.861346 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806026c7-4d70-4535-93cd-e32d8dbcc21c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:11.865884 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfdeee-b031-46a3-9905-b3c4d4d57062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:11.866564 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfdeee-b031-46a3-9905-b3c4d4d57062 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:11.866850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfdeee-b031-46a3-9905-b3c4d4d57062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:11.867124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfdeee-b031-46a3-9905-b3c4d4d57062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:11.867846 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfdeee-b031-46a3-9905-b3c4d4d57062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:11.869464 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfdeee-b031-46a3-9905-b3c4d4d57062 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:11.880011 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1366/2711] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:35:11.883654 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c896c-7fed-4382-b8c3-45f1c1b38082 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:11.893448 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c896c-7fed-4382-b8c3-45f1c1b38082 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:11.897989 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504438d4-7281-4498-98a2-621de10daea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:11.898639 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504438d4-7281-4498-98a2-621de10daea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:11.898925 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504438d4-7281-4498-98a2-621de10daea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:11.899202 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504438d4-7281-4498-98a2-621de10daea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:11.899952 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504438d4-7281-4498-98a2-621de10daea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:11.901544 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504438d4-7281-4498-98a2-621de10daea7 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:11.911378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1346/2712] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:35:11.914883 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfdeee-b031-46a3-9905-b3c4d4d57062 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:11.924927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfdeee-b031-46a3-9905-b3c4d4d57062 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:11.929525 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad45dd2-d53e-48c4-8b30-e38f2f52218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:11.930413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad45dd2-d53e-48c4-8b30-e38f2f52218a admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:11.930699 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad45dd2-d53e-48c4-8b30-e38f2f52218a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:11.930978 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad45dd2-d53e-48c4-8b30-e38f2f52218a admin admin] PATH_INFO: `/v3/projects/61379b54bfc341878955a07870c5fda4/users/676ded85a5b545939d26ddc630d1fac3/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:11.945343 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad45dd2-d53e-48c4-8b30-e38f2f52218a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61379b54bfc341878955a07870c5fda4, user_id=676ded85a5b545939d26ddc630d1fac3, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:11.947963 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad45dd2-d53e-48c4-8b30-e38f2f52218a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:11.960153 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1367/2713] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:35:11 2022] PUT /identity/v3/projects/61379b54bfc341878955a07870c5fda4/users/676ded85a5b545939d26ddc630d1fac3/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:35:11.965184 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836c73d-d880-448a-93b0-6325b1cda835 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:11.965483 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836c73d-d880-448a-93b0-6325b1cda835 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:11.965769 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836c73d-d880-448a-93b0-6325b1cda835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:11.985597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e836c73d-d880-448a-93b0-6325b1cda835 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:11.986886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e836c73d-d880-448a-93b0-6325b1cda835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:12.049061 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1347/2714] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:12.056020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad45dd2-d53e-48c4-8b30-e38f2f52218a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:12.057750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2ad45dd2-d53e-48c4-8b30-e38f2f52218a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:12.120038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad45dd2-d53e-48c4-8b30-e38f2f52218a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:12.123834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0aa28-375c-4d05-89fa-4c67a1633c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:12.124480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0aa28-375c-4d05-89fa-4c67a1633c14 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:12.124767 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0aa28-375c-4d05-89fa-4c67a1633c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:12.125078 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0aa28-375c-4d05-89fa-4c67a1633c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:12.134946 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0aa28-375c-4d05-89fa-4c67a1633c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:12.136481 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0aa28-375c-4d05-89fa-4c67a1633c14 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:12.149823 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1368/2715] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:35:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:35:13.227576 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836c73d-d880-448a-93b0-6325b1cda835 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:13.229261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e836c73d-d880-448a-93b0-6325b1cda835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:13.244828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836c73d-d880-448a-93b0-6325b1cda835 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:13.250518 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ed775-7ec2-4e60-af45-c3250563196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:13.251470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ed775-7ec2-4e60-af45-c3250563196b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:13.251824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ed775-7ec2-4e60-af45-c3250563196b admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:13.252328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ed775-7ec2-4e60-af45-c3250563196b admin admin] PATH_INFO: `/v3/users/99f0a4841293439f95068a9490edb683` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:13.253750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ed775-7ec2-4e60-af45-c3250563196b admin admin] RBAC: Authorizing `identity:delete_user(user_id=99f0a4841293439f95068a9490edb683)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:13.255877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ed775-7ec2-4e60-af45-c3250563196b admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:13.309449 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e13ed775-7ec2-4e60-af45-c3250563196b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99f0a4841293439f95068a9490edb683'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:13.312563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e13ed775-7ec2-4e60-af45-c3250563196b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99f0a4841293439f95068a9490edb683'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:13.325700 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e13ed775-7ec2-4e60-af45-c3250563196b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99f0a4841293439f95068a9490edb683'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:13.333064 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e13ed775-7ec2-4e60-af45-c3250563196b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99f0a4841293439f95068a9490edb683'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:13.341756 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e13ed775-7ec2-4e60-af45-c3250563196b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99f0a4841293439f95068a9490edb683'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:13.348067 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1348/2716] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:35:13 2022] DELETE /identity/v3/users/99f0a4841293439f95068a9490edb683 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:35:13.352680 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7f0fa-9634-4122-b56f-8df8b28991d6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:13.353674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7f0fa-9634-4122-b56f-8df8b28991d6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:13.354441 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7f0fa-9634-4122-b56f-8df8b28991d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:13.376198 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c7f7f0fa-9634-4122-b56f-8df8b28991d6 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:13.380862 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c7f7f0fa-9634-4122-b56f-8df8b28991d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:13.458917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1369/2717] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:13.472315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ed775-7ec2-4e60-af45-c3250563196b admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:13.473876 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e13ed775-7ec2-4e60-af45-c3250563196b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:13.540807 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ed775-7ec2-4e60-af45-c3250563196b admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:13.550447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca3a1b-0984-445c-8949-d0e0b6db8ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:13.551485 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3a1b-0984-445c-8949-d0e0b6db8ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:13.551855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3a1b-0984-445c-8949-d0e0b6db8ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:13.552133 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca3a1b-0984-445c-8949-d0e0b6db8ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:13.578187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca3a1b-0984-445c-8949-d0e0b6db8ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:13.580109 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca3a1b-0984-445c-8949-d0e0b6db8ba2 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:13.594502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1349/2718] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:35:13.897543 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7f0fa-9634-4122-b56f-8df8b28991d6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:13.899017 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c7f7f0fa-9634-4122-b56f-8df8b28991d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:13.920392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7f0fa-9634-4122-b56f-8df8b28991d6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:13.927480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:13.929239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:13.929860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:13.930146 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] PATH_INFO: `/v3/projects/8b5ed8728fd643c2ad0f974a4769fa2e` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:13.931753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5ed8728fd643c2ad0f974a4769fa2e)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:13.934200 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:13.998381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5ed8728fd643c2ad0f974a4769fa2e', 'request_id': 'req-3a898e9d-0229-43c9-8352-63e2d629211c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:14.004523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5ed8728fd643c2ad0f974a4769fa2e', 'request_id': 'req-3a898e9d-0229-43c9-8352-63e2d629211c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:14.011353 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5ed8728fd643c2ad0f974a4769fa2e', 'request_id': 'req-3a898e9d-0229-43c9-8352-63e2d629211c'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:14.026778 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] The token cache is being invalidate because project 8b5ed8728fd643c2ad0f974a4769fa2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:35:14.027089 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:14.027893 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:14.029773 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1370/2719] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:35:13 2022] DELETE /identity/v3/projects/8b5ed8728fd643c2ad0f974a4769fa2e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:35:16.741193 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68f47-5c8d-40df-8a3f-959a0aa8dc1d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:16.742074 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68f47-5c8d-40df-8a3f-959a0aa8dc1d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:16.742537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac68f47-5c8d-40df-8a3f-959a0aa8dc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:16.780209 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-2ac68f47-5c8d-40df-8a3f-959a0aa8dc1d None None] MFA Rules not processed for user `676ded85a5b545939d26ddc630d1fac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:16.781885 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-2ac68f47-5c8d-40df-8a3f-959a0aa8dc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:16.869175 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:16.872769 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:16.875299 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1350/2720] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:16.955490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a898e9d-0229-43c9-8352-63e2d629211c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:16.960417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e16c1f-382d-43d5-ae3e-62668f149cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:16.961300 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e16c1f-382d-43d5-ae3e-62668f149cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:16.961812 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e16c1f-382d-43d5-ae3e-62668f149cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:16.962198 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e16c1f-382d-43d5-ae3e-62668f149cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:16.963189 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e16c1f-382d-43d5-ae3e-62668f149cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:16.965750 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e16c1f-382d-43d5-ae3e-62668f149cc9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:17.010693 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1371/2721] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:35:16 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:35:17.015710 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac68f47-5c8d-40df-8a3f-959a0aa8dc1d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:17.030412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac68f47-5c8d-40df-8a3f-959a0aa8dc1d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:17.149299 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553f768-2925-40aa-85bd-c2eb2aae27b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:17.150372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553f768-2925-40aa-85bd-c2eb2aae27b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:17.150834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553f768-2925-40aa-85bd-c2eb2aae27b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:17.151284 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553f768-2925-40aa-85bd-c2eb2aae27b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:17.152332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553f768-2925-40aa-85bd-c2eb2aae27b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:17.154860 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553f768-2925-40aa-85bd-c2eb2aae27b0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:17.187819 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1351/2722] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:35:17 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:35:17.191617 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e16c1f-382d-43d5-ae3e-62668f149cc9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:17.203833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e16c1f-382d-43d5-ae3e-62668f149cc9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:17.210999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec6ef2-09f3-417f-a246-6c7b7a26dc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:17.212004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec6ef2-09f3-417f-a246-6c7b7a26dc23 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:17.212539 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec6ef2-09f3-417f-a246-6c7b7a26dc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:17.213067 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec6ef2-09f3-417f-a246-6c7b7a26dc23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:17.214076 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec6ef2-09f3-417f-a246-6c7b7a26dc23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:17.216025 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec6ef2-09f3-417f-a246-6c7b7a26dc23 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:17.232482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1372/2723] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:35:17.236577 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553f768-2925-40aa-85bd-c2eb2aae27b0 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:17.249494 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553f768-2925-40aa-85bd-c2eb2aae27b0 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:17.254878 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5734f-7121-48e7-854c-d57280639d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:17.255879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5734f-7121-48e7-854c-d57280639d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:17.256237 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5734f-7121-48e7-854c-d57280639d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:17.256587 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5734f-7121-48e7-854c-d57280639d3a admin admin] PATH_INFO: `/v3/projects/035222be838443a9b7aaec562bd9cbbb/users/3da1d2f758ea4623bf0e8953dfc6b4af/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:17.282502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5734f-7121-48e7-854c-d57280639d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=035222be838443a9b7aaec562bd9cbbb, user_id=3da1d2f758ea4623bf0e8953dfc6b4af, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:17.285374 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5734f-7121-48e7-854c-d57280639d3a admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:17.303997 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1352/2724] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:35:17 2022] PUT /identity/v3/projects/035222be838443a9b7aaec562bd9cbbb/users/3da1d2f758ea4623bf0e8953dfc6b4af/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:35:17.307681 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec6ef2-09f3-417f-a246-6c7b7a26dc23 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:17.325069 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec6ef2-09f3-417f-a246-6c7b7a26dc23 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:17.406672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2658f9-3e97-4e4c-99e5-2992126652ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:17.407358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2658f9-3e97-4e4c-99e5-2992126652ae admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:17.408004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2658f9-3e97-4e4c-99e5-2992126652ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:17.408004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2658f9-3e97-4e4c-99e5-2992126652ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:17.408618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2658f9-3e97-4e4c-99e5-2992126652ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:17.410256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2658f9-3e97-4e4c-99e5-2992126652ae admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:17.423933 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1373/2725] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:35:17.427866 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5734f-7121-48e7-854c-d57280639d3a admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:17.450152 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5734f-7121-48e7-854c-d57280639d3a admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:17.457871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319d3cb-2110-4a77-a02d-b914bfcc931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:17.458786 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319d3cb-2110-4a77-a02d-b914bfcc931b admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:17.459071 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319d3cb-2110-4a77-a02d-b914bfcc931b admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:17.459351 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3319d3cb-2110-4a77-a02d-b914bfcc931b admin admin] PATH_INFO: `/v3/projects/035222be838443a9b7aaec562bd9cbbb/users/3da1d2f758ea4623bf0e8953dfc6b4af/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:17.463880 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319d3cb-2110-4a77-a02d-b914bfcc931b admin admin] RBAC: Authorizing `identity:create_grant(project_id=035222be838443a9b7aaec562bd9cbbb, user_id=3da1d2f758ea4623bf0e8953dfc6b4af, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:17.466992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3319d3cb-2110-4a77-a02d-b914bfcc931b admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:17.481255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1353/2726] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:35:17 2022] PUT /identity/v3/projects/035222be838443a9b7aaec562bd9cbbb/users/3da1d2f758ea4623bf0e8953dfc6b4af/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:35:21.299242 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2658f9-3e97-4e4c-99e5-2992126652ae admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:21.302020 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-7a2658f9-3e97-4e4c-99e5-2992126652ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:21.370167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319d3cb-2110-4a77-a02d-b914bfcc931b admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:21.373654 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3319d3cb-2110-4a77-a02d-b914bfcc931b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:21.409094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2658f9-3e97-4e4c-99e5-2992126652ae admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:21.491274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de40162-26a4-4031-bce3-3bc4ec136591 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4dc7b58c8a04b359a4a9bbab9e7b219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:21.491959 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de40162-26a4-4031-bce3-3bc4ec136591 service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:21.492245 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de40162-26a4-4031-bce3-3bc4ec136591 service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:21.492521 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de40162-26a4-4031-bce3-3bc4ec136591 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:21.493130 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3319d3cb-2110-4a77-a02d-b914bfcc931b admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:21.497173 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2de40162-26a4-4031-bce3-3bc4ec136591 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:21.501644 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08191e72-e12f-442f-afbd-6c30462563cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:21.502332 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08191e72-e12f-442f-afbd-6c30462563cb service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:21.502620 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08191e72-e12f-442f-afbd-6c30462563cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:21.502900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08191e72-e12f-442f-afbd-6c30462563cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:21.504871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-08191e72-e12f-442f-afbd-6c30462563cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:21.512448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de40162-26a4-4031-bce3-3bc4ec136591 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:21.514444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de40162-26a4-4031-bce3-3bc4ec136591 service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:21.527951 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1374/2727] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:35:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:35:21.637043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08191e72-e12f-442f-afbd-6c30462563cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:21.640354 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08191e72-e12f-442f-afbd-6c30462563cb service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:21.652066 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1354/2728] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:35:22.523651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db93b3-40d6-4ecd-a311-0511f215c703 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:22.524136 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db93b3-40d6-4ecd-a311-0511f215c703 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:22.524329 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db93b3-40d6-4ecd-a311-0511f215c703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:22.559304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-85db93b3-40d6-4ecd-a311-0511f215c703 None None] MFA Rules not processed for user `3da1d2f758ea4623bf0e8953dfc6b4af`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:22.561913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-85db93b3-40d6-4ecd-a311-0511f215c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:22.645915 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1375/2729] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:22 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:22.659225 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08191e72-e12f-442f-afbd-6c30462563cb service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:22.660821 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-08191e72-e12f-442f-afbd-6c30462563cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:22.786752 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08191e72-e12f-442f-afbd-6c30462563cb service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:22.800113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abc6e1-ca0e-4ca9-9662-223d23020c32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:22.801096 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abc6e1-ca0e-4ca9-9662-223d23020c32 service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:22.801857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abc6e1-ca0e-4ca9-9662-223d23020c32 service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:22.802271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abc6e1-ca0e-4ca9-9662-223d23020c32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:22.906998 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abc6e1-ca0e-4ca9-9662-223d23020c32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:22.908952 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abc6e1-ca0e-4ca9-9662-223d23020c32 service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:22.950921 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1355/2730] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:35:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:35:24.487203 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116e392-c6ed-405c-9901-475ea184cbb0 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:24.487786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116e392-c6ed-405c-9901-475ea184cbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:24.487786 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116e392-c6ed-405c-9901-475ea184cbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:24.508150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-4116e392-c6ed-405c-9901-475ea184cbb0 None None] MFA Rules not processed for user `676ded85a5b545939d26ddc630d1fac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:24.509437 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4116e392-c6ed-405c-9901-475ea184cbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:24.518551 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1376/2731] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:25.541919 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abc6e1-ca0e-4ca9-9662-223d23020c32 service nova] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:25.543476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-70abc6e1-ca0e-4ca9-9662-223d23020c32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:25.558248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abc6e1-ca0e-4ca9-9662-223d23020c32 service nova] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:25.563261 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b296b-8ac2-4bb9-a76f-2a47cc0def94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:25.564138 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b296b-8ac2-4bb9-a76f-2a47cc0def94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:25.564493 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b296b-8ac2-4bb9-a76f-2a47cc0def94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:25.564707 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b296b-8ac2-4bb9-a76f-2a47cc0def94 admin admin] PATH_INFO: `/v3/users/36c95ddbd4384bb3a63d02698684e29a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:25.565947 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b296b-8ac2-4bb9-a76f-2a47cc0def94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c95ddbd4384bb3a63d02698684e29a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:25.567879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b296b-8ac2-4bb9-a76f-2a47cc0def94 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:25.623615 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bf9b296b-8ac2-4bb9-a76f-2a47cc0def94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c95ddbd4384bb3a63d02698684e29a'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:25.624390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bf9b296b-8ac2-4bb9-a76f-2a47cc0def94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c95ddbd4384bb3a63d02698684e29a'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:25.641871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bf9b296b-8ac2-4bb9-a76f-2a47cc0def94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c95ddbd4384bb3a63d02698684e29a'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:25.649834 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bf9b296b-8ac2-4bb9-a76f-2a47cc0def94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c95ddbd4384bb3a63d02698684e29a'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:25.658651 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-bf9b296b-8ac2-4bb9-a76f-2a47cc0def94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c95ddbd4384bb3a63d02698684e29a'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:25.665443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1356/2732] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:35:25 2022] DELETE /identity/v3/users/36c95ddbd4384bb3a63d02698684e29a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:35:25.893724 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116e392-c6ed-405c-9901-475ea184cbb0 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:25.920118 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116e392-c6ed-405c-9901-475ea184cbb0 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:25.994251 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9616c396-e941-4c80-ac38-2e5bd63c084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:25.995283 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616c396-e941-4c80-ac38-2e5bd63c084f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:25.995561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616c396-e941-4c80-ac38-2e5bd63c084f admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:25.995830 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9616c396-e941-4c80-ac38-2e5bd63c084f admin admin] PATH_INFO: `/v3/projects/89cf2816f8884e679e6c7e4c3d98f348` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:25.997864 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616c396-e941-4c80-ac38-2e5bd63c084f admin admin] RBAC: Authorizing `identity:delete_project(project_id=89cf2816f8884e679e6c7e4c3d98f348)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:25.999749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9616c396-e941-4c80-ac38-2e5bd63c084f admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:26.080550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9616c396-e941-4c80-ac38-2e5bd63c084f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89cf2816f8884e679e6c7e4c3d98f348', 'request_id': 'req-9616c396-e941-4c80-ac38-2e5bd63c084f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:26.088789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9616c396-e941-4c80-ac38-2e5bd63c084f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89cf2816f8884e679e6c7e4c3d98f348', 'request_id': 'req-9616c396-e941-4c80-ac38-2e5bd63c084f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:26.096490 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9616c396-e941-4c80-ac38-2e5bd63c084f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89cf2816f8884e679e6c7e4c3d98f348', 'request_id': 'req-9616c396-e941-4c80-ac38-2e5bd63c084f'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:26.119169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9616c396-e941-4c80-ac38-2e5bd63c084f admin admin] The token cache is being invalidate because project 89cf2816f8884e679e6c7e4c3d98f348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:35:26.119514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9616c396-e941-4c80-ac38-2e5bd63c084f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:26.120398 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-9616c396-e941-4c80-ac38-2e5bd63c084f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:35:26.124957 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1377/2733] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:35:25 2022] DELETE /identity/v3/projects/89cf2816f8884e679e6c7e4c3d98f348 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:35:26.130453 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ada61-77a1-40e5-9c70-65ebac1a9b22 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:26.131103 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ada61-77a1-40e5-9c70-65ebac1a9b22 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:26.131584 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ada61-77a1-40e5-9c70-65ebac1a9b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:26.168563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-de8ada61-77a1-40e5-9c70-65ebac1a9b22 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:26.170864 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-de8ada61-77a1-40e5-9c70-65ebac1a9b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:26.250761 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1357/2734] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:26.259304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e2663-6d1a-4fee-a63e-1fd43e917172 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:26.259860 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e2663-6d1a-4fee-a63e-1fd43e917172 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:26.260418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e2663-6d1a-4fee-a63e-1fd43e917172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:26.280455 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-0f7e2663-6d1a-4fee-a63e-1fd43e917172 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:26.282575 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0f7e2663-6d1a-4fee-a63e-1fd43e917172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:26.291165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1378/2735] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:26.295796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ada61-77a1-40e5-9c70-65ebac1a9b22 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:26.305677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ada61-77a1-40e5-9c70-65ebac1a9b22 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:26.310511 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca78deb-bf10-4124-b444-30986341d72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:26.311241 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca78deb-bf10-4124-b444-30986341d72d admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:26.311532 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca78deb-bf10-4124-b444-30986341d72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:26.311811 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca78deb-bf10-4124-b444-30986341d72d admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:26.312548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca78deb-bf10-4124-b444-30986341d72d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:35:26.312863 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca78deb-bf10-4124-b444-30986341d72d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:26.314515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca78deb-bf10-4124-b444-30986341d72d admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:26.326029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1358/2736] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:35:26.330671 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e2663-6d1a-4fee-a63e-1fd43e917172 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:26.340364 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e2663-6d1a-4fee-a63e-1fd43e917172 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:26.345920 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ae495-cca7-43d9-b28a-36d90fd54770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:26.346588 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ae495-cca7-43d9-b28a-36d90fd54770 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:26.346876 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ae495-cca7-43d9-b28a-36d90fd54770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:26.347155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ae495-cca7-43d9-b28a-36d90fd54770 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:26.347856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ae495-cca7-43d9-b28a-36d90fd54770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:26.349819 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ae495-cca7-43d9-b28a-36d90fd54770 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:26.379461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1379/2737] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:35:26 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:35:26.383547 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca78deb-bf10-4124-b444-30986341d72d admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:26.393654 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca78deb-bf10-4124-b444-30986341d72d admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:26.449907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1430bf-4cf1-4b69-803c-a1b0e5730368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:26.450582 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1430bf-4cf1-4b69-803c-a1b0e5730368 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:26.450869 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1430bf-4cf1-4b69-803c-a1b0e5730368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:26.451149 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1430bf-4cf1-4b69-803c-a1b0e5730368 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:26.451850 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1430bf-4cf1-4b69-803c-a1b0e5730368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:26.453806 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1430bf-4cf1-4b69-803c-a1b0e5730368 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:26.479662 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1359/2738] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:35:26 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:35:26.480836 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ae495-cca7-43d9-b28a-36d90fd54770 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:26.491504 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ae495-cca7-43d9-b28a-36d90fd54770 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:26.496456 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9184-21ae-41d2-a47f-f36abbcacd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:26.497180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9184-21ae-41d2-a47f-f36abbcacd61 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:26.497493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9184-21ae-41d2-a47f-f36abbcacd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:26.497781 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9184-21ae-41d2-a47f-f36abbcacd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:26.498522 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf9184-21ae-41d2-a47f-f36abbcacd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:26.500269 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf9184-21ae-41d2-a47f-f36abbcacd61 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:26.516181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1380/2739] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:35:26.517778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1430bf-4cf1-4b69-803c-a1b0e5730368 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:26.527539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1430bf-4cf1-4b69-803c-a1b0e5730368 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:26.532856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c370185-8dc3-44e0-b3cb-75b06ebd8da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:26.533552 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c370185-8dc3-44e0-b3cb-75b06ebd8da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:26.533837 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c370185-8dc3-44e0-b3cb-75b06ebd8da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:26.534116 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c370185-8dc3-44e0-b3cb-75b06ebd8da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:26.534945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c370185-8dc3-44e0-b3cb-75b06ebd8da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:26.536593 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c370185-8dc3-44e0-b3cb-75b06ebd8da4 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:26.549734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1360/2740] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:35:26.554229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9184-21ae-41d2-a47f-f36abbcacd61 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:26.570002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9184-21ae-41d2-a47f-f36abbcacd61 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:26.576105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc035c4-38bf-47cb-b1b3-b40cfd8455f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:26.577326 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc035c4-38bf-47cb-b1b3-b40cfd8455f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:26.577926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc035c4-38bf-47cb-b1b3-b40cfd8455f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:26.578424 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc035c4-38bf-47cb-b1b3-b40cfd8455f7 admin admin] PATH_INFO: `/v3/projects/24459511ae744b509a55faad8cd07970/users/d617f9658eb94f569568a5a729b14dff/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:26.594416 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc035c4-38bf-47cb-b1b3-b40cfd8455f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24459511ae744b509a55faad8cd07970, user_id=d617f9658eb94f569568a5a729b14dff, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:26.597122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc035c4-38bf-47cb-b1b3-b40cfd8455f7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:26.613439 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1381/2741] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:35:26 2022] PUT /identity/v3/projects/24459511ae744b509a55faad8cd07970/users/d617f9658eb94f569568a5a729b14dff/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:35:26.618512 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914b6ed-e8c7-4dbb-9fcc-a7a0e8edf3e1 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:26.618854 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914b6ed-e8c7-4dbb-9fcc-a7a0e8edf3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:26.619176 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914b6ed-e8c7-4dbb-9fcc-a7a0e8edf3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:26.636469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-7914b6ed-e8c7-4dbb-9fcc-a7a0e8edf3e1 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:26.637739 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7914b6ed-e8c7-4dbb-9fcc-a7a0e8edf3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:26.702839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1361/2742] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:26.709733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc035c4-38bf-47cb-b1b3-b40cfd8455f7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:26.712386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3fc035c4-38bf-47cb-b1b3-b40cfd8455f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:26.769857 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc035c4-38bf-47cb-b1b3-b40cfd8455f7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:26.774129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcaa66-dfde-4e4a-a4c8-31e131dba8be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:26.774790 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcaa66-dfde-4e4a-a4c8-31e131dba8be service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:26.775074 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcaa66-dfde-4e4a-a4c8-31e131dba8be service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:26.775351 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcaa66-dfde-4e4a-a4c8-31e131dba8be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:26.785429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcaa66-dfde-4e4a-a4c8-31e131dba8be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:26.786864 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcaa66-dfde-4e4a-a4c8-31e131dba8be service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:26.796831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1382/2743] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:35:31.601746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbb509-26d1-4ed1-af5e-3bad709d75f3 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:31.602315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbb509-26d1-4ed1-af5e-3bad709d75f3 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:31.602315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acbb509-26d1-4ed1-af5e-3bad709d75f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:31.631763 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-7acbb509-26d1-4ed1-af5e-3bad709d75f3 None None] MFA Rules not processed for user `d617f9658eb94f569568a5a729b14dff`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:31.633001 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7acbb509-26d1-4ed1-af5e-3bad709d75f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:31.699808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1362/2744] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:31.713937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcaa66-dfde-4e4a-a4c8-31e131dba8be service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:31.715878 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-d0dcaa66-dfde-4e4a-a4c8-31e131dba8be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:31.806659 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcaa66-dfde-4e4a-a4c8-31e131dba8be service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:31.814124 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660a673-d568-4f7c-beb7-d6a090ae2626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:31.814934 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660a673-d568-4f7c-beb7-d6a090ae2626 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:31.815363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660a673-d568-4f7c-beb7-d6a090ae2626 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:31.817952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660a673-d568-4f7c-beb7-d6a090ae2626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:31.827926 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660a673-d568-4f7c-beb7-d6a090ae2626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:31.829755 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660a673-d568-4f7c-beb7-d6a090ae2626 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:31.843882 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1383/2745] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:35:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:35:33.209637 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218a18e-a5b2-4869-8853-7aefbe4d6225 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:33.210641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218a18e-a5b2-4869-8853-7aefbe4d6225 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:33.211124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218a18e-a5b2-4869-8853-7aefbe4d6225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:33.232029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6218a18e-a5b2-4869-8853-7aefbe4d6225 None None] MFA Rules not processed for user `d617f9658eb94f569568a5a729b14dff`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:35:33.233553 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6218a18e-a5b2-4869-8853-7aefbe4d6225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:33.243656 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1363/2746] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:35:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:35:56.278811 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660a673-d568-4f7c-beb7-d6a090ae2626 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:35:56.288132 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660a673-d568-4f7c-beb7-d6a090ae2626 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:35:56.291650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77e1bc-1d5b-41a1-a7b9-15adcfe47282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:35:56.292290 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77e1bc-1d5b-41a1-a7b9-15adcfe47282 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:35:56.292577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77e1bc-1d5b-41a1-a7b9-15adcfe47282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:35:56.292856 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77e1bc-1d5b-41a1-a7b9-15adcfe47282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:35:56.295210 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-fb77e1bc-1d5b-41a1-a7b9-15adcfe47282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:35:56.354327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77e1bc-1d5b-41a1-a7b9-15adcfe47282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:35:56.355814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77e1bc-1d5b-41a1-a7b9-15adcfe47282 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:35:56.365895 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1384/2747] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:35:56 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:36:25.150650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218a18e-a5b2-4869-8853-7aefbe4d6225 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:36:25.152042 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6218a18e-a5b2-4869-8853-7aefbe4d6225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:36:25.205841 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218a18e-a5b2-4869-8853-7aefbe4d6225 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:36:25.209457 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d47613-b211-4419-b917-c42b84704789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:36:25.210095 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d47613-b211-4419-b917-c42b84704789 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:36:25.210379 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d47613-b211-4419-b917-c42b84704789 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:36:25.210658 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d47613-b211-4419-b917-c42b84704789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:36:25.212433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-f1d47613-b211-4419-b917-c42b84704789 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:36:25.269255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d47613-b211-4419-b917-c42b84704789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:36:25.270606 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d47613-b211-4419-b917-c42b84704789 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:36:25.279924 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1364/2748] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:36:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:36:30.914092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970b402-bd98-41f6-9599-4dfc2c53db31 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:36:30.914508 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970b402-bd98-41f6-9599-4dfc2c53db31 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:36:30.914676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970b402-bd98-41f6-9599-4dfc2c53db31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:36:30.932574 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-2970b402-bd98-41f6-9599-4dfc2c53db31 None None] MFA Rules not processed for user `d617f9658eb94f569568a5a729b14dff`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:36:30.933818 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2970b402-bd98-41f6-9599-4dfc2c53db31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:36:30.940781 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1385/2749] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:36:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:36:33.105023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834678bf-f75d-42de-9bd1-58f4820e6eab None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:36:33.105573 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834678bf-f75d-42de-9bd1-58f4820e6eab None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:36:33.105747 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834678bf-f75d-42de-9bd1-58f4820e6eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:36:33.122835 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-834678bf-f75d-42de-9bd1-58f4820e6eab None None] MFA Rules not processed for user `17f6eadae19c4b7b8bd66e21ae302363`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:36:33.124110 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-834678bf-f75d-42de-9bd1-58f4820e6eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:36:33.140799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1365/2750] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:36:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:36:49.726732 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970b402-bd98-41f6-9599-4dfc2c53db31 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:36:49.728129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2970b402-bd98-41f6-9599-4dfc2c53db31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:36:49.739977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970b402-bd98-41f6-9599-4dfc2c53db31 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:36:49.743518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ebc86-b5bf-4ea5-8958-3272b821fb29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:36:49.744150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ebc86-b5bf-4ea5-8958-3272b821fb29 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:36:49.744434 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ebc86-b5bf-4ea5-8958-3272b821fb29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:36:49.744713 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ebc86-b5bf-4ea5-8958-3272b821fb29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:36:49.746956 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a62ebc86-b5bf-4ea5-8958-3272b821fb29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:36:49.806492 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ebc86-b5bf-4ea5-8958-3272b821fb29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:36:49.807960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ebc86-b5bf-4ea5-8958-3272b821fb29 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:36:49.817789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1386/2751] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:36:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:37:18.670403 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834678bf-f75d-42de-9bd1-58f4820e6eab None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:37:18.671774 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-834678bf-f75d-42de-9bd1-58f4820e6eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:37:18.683473 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834678bf-f75d-42de-9bd1-58f4820e6eab None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:37:18.687828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280564ea-21df-4d6b-9481-c8669b98d33e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:37:18.688471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280564ea-21df-4d6b-9481-c8669b98d33e service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:37:18.688755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280564ea-21df-4d6b-9481-c8669b98d33e service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:37:18.689071 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280564ea-21df-4d6b-9481-c8669b98d33e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:37:18.690778 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-280564ea-21df-4d6b-9481-c8669b98d33e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:37:18.704776 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280564ea-21df-4d6b-9481-c8669b98d33e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:37:18.706243 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280564ea-21df-4d6b-9481-c8669b98d33e service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:37:18.717572 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1366/2752] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:37:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:37:20.101906 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ebc86-b5bf-4ea5-8958-3272b821fb29 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:37:20.110523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ebc86-b5bf-4ea5-8958-3272b821fb29 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:37:20.114146 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c750d-6d56-4afa-b8dc-15eccd20e42a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:37:20.114789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c750d-6d56-4afa-b8dc-15eccd20e42a service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:37:20.115074 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c750d-6d56-4afa-b8dc-15eccd20e42a service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:37:20.115352 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c750d-6d56-4afa-b8dc-15eccd20e42a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:37:20.117162 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4b4c750d-6d56-4afa-b8dc-15eccd20e42a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:37:20.130616 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c750d-6d56-4afa-b8dc-15eccd20e42a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:37:20.132040 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c750d-6d56-4afa-b8dc-15eccd20e42a service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:37:20.143526 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1387/2753] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:37:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:37:29.779923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18dfe8-d8b1-40b1-a1dc-86dec2063b37 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:37:29.780475 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18dfe8-d8b1-40b1-a1dc-86dec2063b37 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:37:29.780475 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18dfe8-d8b1-40b1-a1dc-86dec2063b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:37:29.799234 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-5d18dfe8-d8b1-40b1-a1dc-86dec2063b37 None None] MFA Rules not processed for user `d617f9658eb94f569568a5a729b14dff`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:37:29.800494 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-5d18dfe8-d8b1-40b1-a1dc-86dec2063b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:37:29.807292 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1367/2754] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:37:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:37:30.389071 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b300a-a6d5-4d00-9f82-0911428df65b None None] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:37:30.389532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b300a-a6d5-4d00-9f82-0911428df65b None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:37:30.389648 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b300a-a6d5-4d00-9f82-0911428df65b None None] PATH_INFO: `/` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:37:30.391686 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1388/2755] 10.222.0.61 () {54 vars in 960 bytes} [Tue May 10 20:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:37:30.398174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516d63-72eb-4744-bd42-7e4cca553498 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:37:30.398467 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516d63-72eb-4744-bd42-7e4cca553498 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:37:30.398750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516d63-72eb-4744-bd42-7e4cca553498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:37:30.437390 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-68516d63-72eb-4744-bd42-7e4cca553498 None None] MFA Rules not processed for user `a4dc7b58c8a04b359a4a9bbab9e7b219`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:37:30.438591 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-68516d63-72eb-4744-bd42-7e4cca553498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:37:30.497985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1368/2756] 10.222.0.61 () {58 vars in 1057 bytes} [Tue May 10 20:37:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:37:30.506208 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b300a-a6d5-4d00-9f82-0911428df65b None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:37:30.521366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b300a-a6d5-4d00-9f82-0911428df65b None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:37:30.527135 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84e9f6-81a1-478d-90a1-1fd1a12bd986 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4dc7b58c8a04b359a4a9bbab9e7b219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:37:30.527887 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84e9f6-81a1-478d-90a1-1fd1a12bd986 service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:37:30.528396 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84e9f6-81a1-478d-90a1-1fd1a12bd986 service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:37:30.528733 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84e9f6-81a1-478d-90a1-1fd1a12bd986 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:37:30.530888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-2f84e9f6-81a1-478d-90a1-1fd1a12bd986 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:37:30.542953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84e9f6-81a1-478d-90a1-1fd1a12bd986 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:37:30.544541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84e9f6-81a1-478d-90a1-1fd1a12bd986 service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:37:30.553990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1389/2757] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:37:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:37:32.410855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68516d63-72eb-4744-bd42-7e4cca553498 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:37:32.426574 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68516d63-72eb-4744-bd42-7e4cca553498 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:37:32.431476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25e21a-5ebb-4c74-8a70-81ef336404f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:37:32.432146 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25e21a-5ebb-4c74-8a70-81ef336404f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:37:32.432452 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25e21a-5ebb-4c74-8a70-81ef336404f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:37:32.432727 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25e21a-5ebb-4c74-8a70-81ef336404f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:37:32.434595 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6f25e21a-5ebb-4c74-8a70-81ef336404f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:37:32.445597 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25e21a-5ebb-4c74-8a70-81ef336404f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:37:32.447097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25e21a-5ebb-4c74-8a70-81ef336404f1 service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:37:32.455799 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1369/2758] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:37:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:38:09.818777 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84e9f6-81a1-478d-90a1-1fd1a12bd986 service placement] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:38:09.829747 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84e9f6-81a1-478d-90a1-1fd1a12bd986 service placement] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:38:09.833485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70667bcb-5ee7-4b1d-8541-fc1193d8ecd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:38:09.834165 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667bcb-5ee7-4b1d-8541-fc1193d8ecd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:38:09.834424 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667bcb-5ee7-4b1d-8541-fc1193d8ecd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:38:09.835067 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70667bcb-5ee7-4b1d-8541-fc1193d8ecd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:38:09.836939 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-70667bcb-5ee7-4b1d-8541-fc1193d8ecd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:38:09.847497 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70667bcb-5ee7-4b1d-8541-fc1193d8ecd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:38:09.848961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70667bcb-5ee7-4b1d-8541-fc1193d8ecd0 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:38:09.858129 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1390/2759] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:38:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:38:09.937082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25e21a-5ebb-4c74-8a70-81ef336404f1 service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:38:09.946504 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25e21a-5ebb-4c74-8a70-81ef336404f1 service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:38:09.950265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa93ca-e8dc-492d-8501-3288aa2bf2cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:38:09.950914 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa93ca-e8dc-492d-8501-3288aa2bf2cc service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:38:09.951200 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa93ca-e8dc-492d-8501-3288aa2bf2cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:38:09.951476 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa93ca-e8dc-492d-8501-3288aa2bf2cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:38:09.953376 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-caaa93ca-e8dc-492d-8501-3288aa2bf2cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:38:09.967035 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa93ca-e8dc-492d-8501-3288aa2bf2cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:38:09.968724 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa93ca-e8dc-492d-8501-3288aa2bf2cc service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:38:09.980187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1370/2760] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:38:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:38:19.877369 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70667bcb-5ee7-4b1d-8541-fc1193d8ecd0 service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:38:19.878802 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-70667bcb-5ee7-4b1d-8541-fc1193d8ecd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:38:19.895363 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70667bcb-5ee7-4b1d-8541-fc1193d8ecd0 service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:38:19.900850 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93547683-558f-4003-a979-f591d4579f83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:38:19.901749 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93547683-558f-4003-a979-f591d4579f83 service nova] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:38:19.902031 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93547683-558f-4003-a979-f591d4579f83 service nova] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:38:19.902307 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93547683-558f-4003-a979-f591d4579f83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:38:19.905079 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-93547683-558f-4003-a979-f591d4579f83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:38:19.917937 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93547683-558f-4003-a979-f591d4579f83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:38:19.919523 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93547683-558f-4003-a979-f591d4579f83 service nova] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:38:19.931441 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1391/2761] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:38:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:38:22.054404 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa93ca-e8dc-492d-8501-3288aa2bf2cc service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:38:22.065534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa93ca-e8dc-492d-8501-3288aa2bf2cc service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:38:22.071858 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99eaab1-9e6b-4d1f-895d-fa0f61a87ecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c3c6fe7e21c4c1ebc01cf91c3c05c4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:38:22.072718 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99eaab1-9e6b-4d1f-895d-fa0f61a87ecc service nova] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:38:22.073179 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99eaab1-9e6b-4d1f-895d-fa0f61a87ecc service nova] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:38:22.073720 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99eaab1-9e6b-4d1f-895d-fa0f61a87ecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:38:22.076219 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-a99eaab1-9e6b-4d1f-895d-fa0f61a87ecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:38:22.090282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99eaab1-9e6b-4d1f-895d-fa0f61a87ecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:38:22.092133 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99eaab1-9e6b-4d1f-895d-fa0f61a87ecc service nova] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:38:22.104338 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1371/2762] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:38:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:38:33.343252 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93547683-558f-4003-a979-f591d4579f83 service nova] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:38:33.352869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93547683-558f-4003-a979-f591d4579f83 service nova] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:38:33.356486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde626b3-4537-4f81-925b-b2029fa612ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:38:33.357172 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde626b3-4537-4f81-925b-b2029fa612ad service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:38:33.357461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde626b3-4537-4f81-925b-b2029fa612ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:38:33.357740 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde626b3-4537-4f81-925b-b2029fa612ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:38:33.359674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-dde626b3-4537-4f81-925b-b2029fa612ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:38:33.372155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde626b3-4537-4f81-925b-b2029fa612ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:38:33.373632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde626b3-4537-4f81-925b-b2029fa612ad service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:38:33.383289 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1392/2763] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:38:33.838999 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aef79-5de5-446a-a835-b1ca60725d2b None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:38:33.839502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aef79-5de5-446a-a835-b1ca60725d2b None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:38:33.839712 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85aef79-5de5-446a-a835-b1ca60725d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:38:33.858088 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e85aef79-5de5-446a-a835-b1ca60725d2b None None] MFA Rules not processed for user `d617f9658eb94f569568a5a729b14dff`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:38:33.859389 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e85aef79-5de5-446a-a835-b1ca60725d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:38:33.867202 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1372/2764] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:38:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:38:34.194515 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde626b3-4537-4f81-925b-b2029fa612ad service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:38:34.203783 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde626b3-4537-4f81-925b-b2029fa612ad service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:38:34.208501 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0cfc4-f2bf-4c36-857a-8ea354a9855f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:38:34.209194 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0cfc4-f2bf-4c36-857a-8ea354a9855f service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:38:34.209719 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0cfc4-f2bf-4c36-857a-8ea354a9855f service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:38:34.210058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0cfc4-f2bf-4c36-857a-8ea354a9855f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:38:34.212063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-e9b0cfc4-f2bf-4c36-857a-8ea354a9855f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:38:34.223123 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0cfc4-f2bf-4c36-857a-8ea354a9855f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:38:34.225055 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0cfc4-f2bf-4c36-857a-8ea354a9855f service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:38:34.234092 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1393/2765] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:38:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:38:40.437154 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aef79-5de5-446a-a835-b1ca60725d2b None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:38:40.439542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e85aef79-5de5-446a-a835-b1ca60725d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:38:40.453998 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85aef79-5de5-446a-a835-b1ca60725d2b None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:38:40.459267 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c563d-11f1-44ec-af9c-768c9cb5b349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:38:40.460100 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c563d-11f1-44ec-af9c-768c9cb5b349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:38:40.460384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c563d-11f1-44ec-af9c-768c9cb5b349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:38:40.461055 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c563d-11f1-44ec-af9c-768c9cb5b349 admin admin] PATH_INFO: `/v3/users/17f6eadae19c4b7b8bd66e21ae302363` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:38:40.462250 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c563d-11f1-44ec-af9c-768c9cb5b349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f6eadae19c4b7b8bd66e21ae302363)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:38:40.464336 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c563d-11f1-44ec-af9c-768c9cb5b349 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:38:40.520287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6d1c563d-11f1-44ec-af9c-768c9cb5b349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f6eadae19c4b7b8bd66e21ae302363'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:40.521227 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6d1c563d-11f1-44ec-af9c-768c9cb5b349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f6eadae19c4b7b8bd66e21ae302363'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:40.539029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6d1c563d-11f1-44ec-af9c-768c9cb5b349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f6eadae19c4b7b8bd66e21ae302363'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:40.548530 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6d1c563d-11f1-44ec-af9c-768c9cb5b349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f6eadae19c4b7b8bd66e21ae302363'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:40.557732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-6d1c563d-11f1-44ec-af9c-768c9cb5b349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f6eadae19c4b7b8bd66e21ae302363'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:40.563851 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1373/2766] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:38:40 2022] DELETE /identity/v3/users/17f6eadae19c4b7b8bd66e21ae302363 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:38:40.743651 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0cfc4-f2bf-4c36-857a-8ea354a9855f service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:38:40.757378 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0cfc4-f2bf-4c36-857a-8ea354a9855f service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:38:40.812463 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:38:40.813233 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:38:40.813518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:38:40.813795 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] PATH_INFO: `/v3/projects/890bf13c89b748b3a8f9ba4106c582b3` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:38:40.815635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=890bf13c89b748b3a8f9ba4106c582b3)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:38:40.817583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:38:40.860584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890bf13c89b748b3a8f9ba4106c582b3', 'request_id': 'req-4a0cb0f3-0013-425a-b924-055d18ff7ea3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:40.865826 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890bf13c89b748b3a8f9ba4106c582b3', 'request_id': 'req-4a0cb0f3-0013-425a-b924-055d18ff7ea3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:40.871621 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890bf13c89b748b3a8f9ba4106c582b3', 'request_id': 'req-4a0cb0f3-0013-425a-b924-055d18ff7ea3'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:40.883618 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] The token cache is being invalidate because project 890bf13c89b748b3a8f9ba4106c582b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:38:40.883910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:40.884554 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:40.886130 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1394/2767] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:38:40 2022] DELETE /identity/v3/projects/890bf13c89b748b3a8f9ba4106c582b3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:38:40.890143 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c563d-11f1-44ec-af9c-768c9cb5b349 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:38:40.892293 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6d1c563d-11f1-44ec-af9c-768c9cb5b349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:38:40.909822 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c563d-11f1-44ec-af9c-768c9cb5b349 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:38:40.965090 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f8af0-2452-4512-b633-3da989ad8639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:38:40.965956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f8af0-2452-4512-b633-3da989ad8639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:38:40.966242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f8af0-2452-4512-b633-3da989ad8639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:38:40.966518 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f8af0-2452-4512-b633-3da989ad8639 admin admin] PATH_INFO: `/v3/users/526cc3b8fad246aa910cead6acf7d002` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:38:40.967751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f8af0-2452-4512-b633-3da989ad8639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=526cc3b8fad246aa910cead6acf7d002)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:38:40.969709 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f8af0-2452-4512-b633-3da989ad8639 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:38:41.014982 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-da4f8af0-2452-4512-b633-3da989ad8639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526cc3b8fad246aa910cead6acf7d002'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:41.015628 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-da4f8af0-2452-4512-b633-3da989ad8639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526cc3b8fad246aa910cead6acf7d002'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:41.027757 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-da4f8af0-2452-4512-b633-3da989ad8639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526cc3b8fad246aa910cead6acf7d002'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:41.034213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-da4f8af0-2452-4512-b633-3da989ad8639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526cc3b8fad246aa910cead6acf7d002'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:41.041113 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-da4f8af0-2452-4512-b633-3da989ad8639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526cc3b8fad246aa910cead6acf7d002'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:41.046863 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1374/2768] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:38:40 2022] DELETE /identity/v3/users/526cc3b8fad246aa910cead6acf7d002 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:38:41.212358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:38:41.213976 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:38:41.231608 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cb0f3-0013-425a-b924-055d18ff7ea3 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:38:41.285707 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:38:41.286489 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:38:41.286796 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:38:41.287067 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] PATH_INFO: `/v3/projects/ffca25f230564ac0b861ea42271a088a` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:38:41.288243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffca25f230564ac0b861ea42271a088a)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:38:41.290173 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:38:41.334152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffca25f230564ac0b861ea42271a088a', 'request_id': 'req-f1425317-1fe4-43e2-90fb-d0a3da04c12a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:41.339226 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffca25f230564ac0b861ea42271a088a', 'request_id': 'req-f1425317-1fe4-43e2-90fb-d0a3da04c12a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:41.344960 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffca25f230564ac0b861ea42271a088a', 'request_id': 'req-f1425317-1fe4-43e2-90fb-d0a3da04c12a'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:41.356330 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] The token cache is being invalidate because project ffca25f230564ac0b861ea42271a088a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:38:41.356611 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:41.357250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:38:41.358746 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1395/2769] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:38:41 2022] DELETE /identity/v3/projects/ffca25f230564ac0b861ea42271a088a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:36.823136 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f8af0-2452-4512-b633-3da989ad8639 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:36.825335 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-da4f8af0-2452-4512-b633-3da989ad8639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:36.882682 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f8af0-2452-4512-b633-3da989ad8639 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:36.949542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e75c0e-27e5-43ee-b9b7-5d0da2b48f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:36.950425 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e75c0e-27e5-43ee-b9b7-5d0da2b48f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:36.950709 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e75c0e-27e5-43ee-b9b7-5d0da2b48f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:36.951022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e75c0e-27e5-43ee-b9b7-5d0da2b48f08 admin admin] PATH_INFO: `/v3/users/d617f9658eb94f569568a5a729b14dff` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:36.952197 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e75c0e-27e5-43ee-b9b7-5d0da2b48f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d617f9658eb94f569568a5a729b14dff)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:36.954920 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e75c0e-27e5-43ee-b9b7-5d0da2b48f08 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:37.006915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-20e75c0e-27e5-43ee-b9b7-5d0da2b48f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd617f9658eb94f569568a5a729b14dff'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:37.007570 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-20e75c0e-27e5-43ee-b9b7-5d0da2b48f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd617f9658eb94f569568a5a729b14dff'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:37.019435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-20e75c0e-27e5-43ee-b9b7-5d0da2b48f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd617f9658eb94f569568a5a729b14dff'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:37.026651 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-20e75c0e-27e5-43ee-b9b7-5d0da2b48f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd617f9658eb94f569568a5a729b14dff'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:37.033839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-20e75c0e-27e5-43ee-b9b7-5d0da2b48f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd617f9658eb94f569568a5a729b14dff'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:37.040708 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1375/2770] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:39:36 2022] DELETE /identity/v3/users/d617f9658eb94f569568a5a729b14dff => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:37.272321 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:37.273825 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:37.311791 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1425317-1fe4-43e2-90fb-d0a3da04c12a admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:37.367221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afb3e7-9e71-43e3-8826-4bbdef348110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:37.368089 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afb3e7-9e71-43e3-8826-4bbdef348110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:37.368374 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afb3e7-9e71-43e3-8826-4bbdef348110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:37.368646 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afb3e7-9e71-43e3-8826-4bbdef348110 admin admin] PATH_INFO: `/v3/projects/24459511ae744b509a55faad8cd07970` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:37.369871 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afb3e7-9e71-43e3-8826-4bbdef348110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24459511ae744b509a55faad8cd07970)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:37.371789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afb3e7-9e71-43e3-8826-4bbdef348110 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:37.420240 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c5afb3e7-9e71-43e3-8826-4bbdef348110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24459511ae744b509a55faad8cd07970', 'request_id': 'req-c5afb3e7-9e71-43e3-8826-4bbdef348110'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:37.425665 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c5afb3e7-9e71-43e3-8826-4bbdef348110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24459511ae744b509a55faad8cd07970', 'request_id': 'req-c5afb3e7-9e71-43e3-8826-4bbdef348110'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:37.431377 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c5afb3e7-9e71-43e3-8826-4bbdef348110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24459511ae744b509a55faad8cd07970', 'request_id': 'req-c5afb3e7-9e71-43e3-8826-4bbdef348110'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:37.444777 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c5afb3e7-9e71-43e3-8826-4bbdef348110 admin admin] The token cache is being invalidate because project 24459511ae744b509a55faad8cd07970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:39:37.445172 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c5afb3e7-9e71-43e3-8826-4bbdef348110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:37.445805 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c5afb3e7-9e71-43e3-8826-4bbdef348110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:37.447720 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1396/2771] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:39:37 2022] DELETE /identity/v3/projects/24459511ae744b509a55faad8cd07970 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:37.452746 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562007b-f325-40f4-9ee5-536e1d64a575 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:37.453158 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562007b-f325-40f4-9ee5-536e1d64a575 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:37.453551 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562007b-f325-40f4-9ee5-536e1d64a575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:37.472270 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b562007b-f325-40f4-9ee5-536e1d64a575 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:37.474120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b562007b-f325-40f4-9ee5-536e1d64a575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:37.533116 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1376/2772] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:37.541292 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81fefb-2393-4119-98ff-62762dc8897f None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:37.541583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81fefb-2393-4119-98ff-62762dc8897f None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:37.542034 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81fefb-2393-4119-98ff-62762dc8897f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:37.560624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ef81fefb-2393-4119-98ff-62762dc8897f None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:37.561835 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ef81fefb-2393-4119-98ff-62762dc8897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:37.569886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1397/2773] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:37.574505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562007b-f325-40f4-9ee5-536e1d64a575 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:37.586051 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562007b-f325-40f4-9ee5-536e1d64a575 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:37.591065 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3a96-3b16-4d4c-b88c-496bb6480216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:37.591773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3a96-3b16-4d4c-b88c-496bb6480216 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:37.592050 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3a96-3b16-4d4c-b88c-496bb6480216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:37.592318 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3a96-3b16-4d4c-b88c-496bb6480216 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:37.593084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3a96-3b16-4d4c-b88c-496bb6480216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:39:37.593395 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3a96-3b16-4d4c-b88c-496bb6480216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:37.595112 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3a96-3b16-4d4c-b88c-496bb6480216 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:37.610729 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1377/2774] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:39:37.612384 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81fefb-2393-4119-98ff-62762dc8897f None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:37.621399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81fefb-2393-4119-98ff-62762dc8897f None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:37.626180 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16eb7c2-49e1-41ce-ae9f-7e05d10d703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:37.626865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb7c2-49e1-41ce-ae9f-7e05d10d703e admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:37.627218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb7c2-49e1-41ce-ae9f-7e05d10d703e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:37.627529 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb7c2-49e1-41ce-ae9f-7e05d10d703e admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:37.628252 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16eb7c2-49e1-41ce-ae9f-7e05d10d703e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:37.630211 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16eb7c2-49e1-41ce-ae9f-7e05d10d703e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:37.657614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1398/2775] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:39:37 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:39:37.662515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3a96-3b16-4d4c-b88c-496bb6480216 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:37.673005 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3a96-3b16-4d4c-b88c-496bb6480216 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:37.729843 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477f04c-1b8f-4fb2-8a04-a9aae87d242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:37.730641 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f04c-1b8f-4fb2-8a04-a9aae87d242f admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:37.730932 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f04c-1b8f-4fb2-8a04-a9aae87d242f admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:37.731213 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477f04c-1b8f-4fb2-8a04-a9aae87d242f admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:37.731901 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477f04c-1b8f-4fb2-8a04-a9aae87d242f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:37.733877 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477f04c-1b8f-4fb2-8a04-a9aae87d242f admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:37.757935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1378/2776] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:39:37 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:39:37.759359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16eb7c2-49e1-41ce-ae9f-7e05d10d703e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:37.769642 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16eb7c2-49e1-41ce-ae9f-7e05d10d703e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:37.774801 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe2edb-b28b-4424-80c6-67738a604254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:37.775407 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe2edb-b28b-4424-80c6-67738a604254 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:37.775692 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe2edb-b28b-4424-80c6-67738a604254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:37.775970 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe2edb-b28b-4424-80c6-67738a604254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:37.776701 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe2edb-b28b-4424-80c6-67738a604254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:37.778345 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe2edb-b28b-4424-80c6-67738a604254 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:37.789209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1399/2777] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:39:37.793628 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477f04c-1b8f-4fb2-8a04-a9aae87d242f admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:37.804106 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477f04c-1b8f-4fb2-8a04-a9aae87d242f admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:37.808829 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183caeb-cb16-434a-9203-b85b81f4b1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:37.809521 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183caeb-cb16-434a-9203-b85b81f4b1ab admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:37.809804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183caeb-cb16-434a-9203-b85b81f4b1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:37.810079 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183caeb-cb16-434a-9203-b85b81f4b1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:37.810855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183caeb-cb16-434a-9203-b85b81f4b1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:37.812433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183caeb-cb16-434a-9203-b85b81f4b1ab admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:37.822992 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1379/2778] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:39:37.827243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe2edb-b28b-4424-80c6-67738a604254 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:37.840948 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe2edb-b28b-4424-80c6-67738a604254 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:37.847107 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864d4ad-6d0e-486c-97ed-a29d6676ba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:37.848105 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864d4ad-6d0e-486c-97ed-a29d6676ba6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:37.849188 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864d4ad-6d0e-486c-97ed-a29d6676ba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:37.849708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864d4ad-6d0e-486c-97ed-a29d6676ba6e admin admin] PATH_INFO: `/v3/projects/df29f84a3d734b27b25bd590cb8dc207/users/3ae0a2870b1b4163a83d22dd0849dbc8/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:37.865307 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864d4ad-6d0e-486c-97ed-a29d6676ba6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df29f84a3d734b27b25bd590cb8dc207, user_id=3ae0a2870b1b4163a83d22dd0849dbc8, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:37.868157 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864d4ad-6d0e-486c-97ed-a29d6676ba6e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:37.892867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1400/2779] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:39:37 2022] PUT /identity/v3/projects/df29f84a3d734b27b25bd590cb8dc207/users/3ae0a2870b1b4163a83d22dd0849dbc8/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:39:37.894936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68012e-4bc0-4d3e-8987-44631287ac1d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:37.896025 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68012e-4bc0-4d3e-8987-44631287ac1d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:37.896254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68012e-4bc0-4d3e-8987-44631287ac1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:37.926486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-6f68012e-4bc0-4d3e-8987-44631287ac1d None None] MFA Rules not processed for user `3ae0a2870b1b4163a83d22dd0849dbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:37.927895 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6f68012e-4bc0-4d3e-8987-44631287ac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:38.000104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1380/2780] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:38.011478 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864d4ad-6d0e-486c-97ed-a29d6676ba6e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:38.013360 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-b864d4ad-6d0e-486c-97ed-a29d6676ba6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:38.088763 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864d4ad-6d0e-486c-97ed-a29d6676ba6e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:38.092460 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1fe29-a4cb-4d65-aa91-888905faacfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:38.093122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1fe29-a4cb-4d65-aa91-888905faacfc service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:38.093434 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1fe29-a4cb-4d65-aa91-888905faacfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:38.094416 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1fe29-a4cb-4d65-aa91-888905faacfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:38.103418 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1fe29-a4cb-4d65-aa91-888905faacfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:38.104951 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1fe29-a4cb-4d65-aa91-888905faacfc service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:38.113560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1401/2781] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:39:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:39:46.000949 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68012e-4bc0-4d3e-8987-44631287ac1d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:46.002634 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6f68012e-4bc0-4d3e-8987-44631287ac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:46.100945 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68012e-4bc0-4d3e-8987-44631287ac1d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:46.105564 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14f0e6-3089-4de5-b942-393d9cee032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:46.106440 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f0e6-3089-4de5-b942-393d9cee032b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:46.106745 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f0e6-3089-4de5-b942-393d9cee032b admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:46.107022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14f0e6-3089-4de5-b942-393d9cee032b admin admin] PATH_INFO: `/v3/users/676ded85a5b545939d26ddc630d1fac3` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:46.108230 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14f0e6-3089-4de5-b942-393d9cee032b admin admin] RBAC: Authorizing `identity:delete_user(user_id=676ded85a5b545939d26ddc630d1fac3)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:46.110171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14f0e6-3089-4de5-b942-393d9cee032b admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:46.157679 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-3a14f0e6-3089-4de5-b942-393d9cee032b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '676ded85a5b545939d26ddc630d1fac3'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.158315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-3a14f0e6-3089-4de5-b942-393d9cee032b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '676ded85a5b545939d26ddc630d1fac3'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.170020 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-3a14f0e6-3089-4de5-b942-393d9cee032b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '676ded85a5b545939d26ddc630d1fac3'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.176684 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-3a14f0e6-3089-4de5-b942-393d9cee032b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '676ded85a5b545939d26ddc630d1fac3'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.183147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-3a14f0e6-3089-4de5-b942-393d9cee032b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '676ded85a5b545939d26ddc630d1fac3'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.189104 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1381/2782] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:39:45 2022] DELETE /identity/v3/users/676ded85a5b545939d26ddc630d1fac3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:46.357281 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1fe29-a4cb-4d65-aa91-888905faacfc service cinder] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:46.367883 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1fe29-a4cb-4d65-aa91-888905faacfc service cinder] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:46.422743 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:46.423541 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:46.423824 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:46.424100 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] PATH_INFO: `/v3/projects/61379b54bfc341878955a07870c5fda4` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:46.425302 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61379b54bfc341878955a07870c5fda4)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:46.427212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:46.471674 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61379b54bfc341878955a07870c5fda4', 'request_id': 'req-bd2c421e-5679-41f4-b079-4614a3540f33'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.478126 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61379b54bfc341878955a07870c5fda4', 'request_id': 'req-bd2c421e-5679-41f4-b079-4614a3540f33'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.484131 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61379b54bfc341878955a07870c5fda4', 'request_id': 'req-bd2c421e-5679-41f4-b079-4614a3540f33'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.496002 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] The token cache is being invalidate because project 61379b54bfc341878955a07870c5fda4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:39:46.496288 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.496913 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.498452 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1402/2783] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:39:46 2022] DELETE /identity/v3/projects/61379b54bfc341878955a07870c5fda4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:46.502804 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14f0e6-3089-4de5-b942-393d9cee032b admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:46.503863 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-3a14f0e6-3089-4de5-b942-393d9cee032b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:46.516861 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14f0e6-3089-4de5-b942-393d9cee032b admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:46.522676 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:46.524078 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:46.573726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99002a5a-121d-4a96-9b95-c4ceb0c7e933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:46.574668 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99002a5a-121d-4a96-9b95-c4ceb0c7e933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:46.574870 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99002a5a-121d-4a96-9b95-c4ceb0c7e933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:46.575174 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99002a5a-121d-4a96-9b95-c4ceb0c7e933 admin admin] PATH_INFO: `/v3/users/3da1d2f758ea4623bf0e8953dfc6b4af` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:46.576355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99002a5a-121d-4a96-9b95-c4ceb0c7e933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3da1d2f758ea4623bf0e8953dfc6b4af)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:46.578333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99002a5a-121d-4a96-9b95-c4ceb0c7e933 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:46.588098 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c421e-5679-41f4-b079-4614a3540f33 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:46.592799 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae082f7-fa51-4f57-ae2f-0f9f50cba4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:46.593687 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae082f7-fa51-4f57-ae2f-0f9f50cba4e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:46.593967 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae082f7-fa51-4f57-ae2f-0f9f50cba4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:46.594239 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae082f7-fa51-4f57-ae2f-0f9f50cba4e9 admin admin] PATH_INFO: `/v3/users/3ae0a2870b1b4163a83d22dd0849dbc8` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:46.595529 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae082f7-fa51-4f57-ae2f-0f9f50cba4e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae0a2870b1b4163a83d22dd0849dbc8)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:46.597464 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae082f7-fa51-4f57-ae2f-0f9f50cba4e9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:46.624900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-99002a5a-121d-4a96-9b95-c4ceb0c7e933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3da1d2f758ea4623bf0e8953dfc6b4af'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.625543 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-99002a5a-121d-4a96-9b95-c4ceb0c7e933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3da1d2f758ea4623bf0e8953dfc6b4af'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.637487 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-99002a5a-121d-4a96-9b95-c4ceb0c7e933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3da1d2f758ea4623bf0e8953dfc6b4af'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.644361 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-99002a5a-121d-4a96-9b95-c4ceb0c7e933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3da1d2f758ea4623bf0e8953dfc6b4af'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.645168 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1ae082f7-fa51-4f57-ae2f-0f9f50cba4e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae0a2870b1b4163a83d22dd0849dbc8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.652726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-99002a5a-121d-4a96-9b95-c4ceb0c7e933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3da1d2f758ea4623bf0e8953dfc6b4af'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.656925 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1ae082f7-fa51-4f57-ae2f-0f9f50cba4e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae0a2870b1b4163a83d22dd0849dbc8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.658571 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1382/2784] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:39:46 2022] DELETE /identity/v3/users/3da1d2f758ea4623bf0e8953dfc6b4af => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:46.664417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1ae082f7-fa51-4f57-ae2f-0f9f50cba4e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae0a2870b1b4163a83d22dd0849dbc8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.665157 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1ae082f7-fa51-4f57-ae2f-0f9f50cba4e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae0a2870b1b4163a83d22dd0849dbc8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.672796 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-1ae082f7-fa51-4f57-ae2f-0f9f50cba4e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae0a2870b1b4163a83d22dd0849dbc8'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.679485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1403/2785] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:39:46 2022] DELETE /identity/v3/users/3ae0a2870b1b4163a83d22dd0849dbc8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:39:46.684180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88553bd5-05c9-409f-a4a9-0d1a973e8954 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:46.684469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88553bd5-05c9-409f-a4a9-0d1a973e8954 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:46.684743 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88553bd5-05c9-409f-a4a9-0d1a973e8954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:46.711596 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-88553bd5-05c9-409f-a4a9-0d1a973e8954 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:46.712784 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-88553bd5-05c9-409f-a4a9-0d1a973e8954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:46.769120 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1383/2786] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:46.779709 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae082f7-fa51-4f57-ae2f-0f9f50cba4e9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:46.781171 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1ae082f7-fa51-4f57-ae2f-0f9f50cba4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:46.828803 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88553bd5-05c9-409f-a4a9-0d1a973e8954 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:46.830491 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-88553bd5-05c9-409f-a4a9-0d1a973e8954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:46.851012 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88553bd5-05c9-409f-a4a9-0d1a973e8954 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:46.856534 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f303ed-74ac-4a2d-adea-547065e28e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:46.857436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f303ed-74ac-4a2d-adea-547065e28e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:46.857725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f303ed-74ac-4a2d-adea-547065e28e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:46.858005 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f303ed-74ac-4a2d-adea-547065e28e56 admin admin] PATH_INFO: `/v3/projects/035222be838443a9b7aaec562bd9cbbb` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:46.859197 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f303ed-74ac-4a2d-adea-547065e28e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=035222be838443a9b7aaec562bd9cbbb)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:46.861150 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f303ed-74ac-4a2d-adea-547065e28e56 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:46.861680 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae082f7-fa51-4f57-ae2f-0f9f50cba4e9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:46.865470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2edb27-704d-4259-96ca-bd7241e8666f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:46.866114 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2edb27-704d-4259-96ca-bd7241e8666f service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:46.866399 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2edb27-704d-4259-96ca-bd7241e8666f service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:46.866677 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2edb27-704d-4259-96ca-bd7241e8666f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:46.876025 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2edb27-704d-4259-96ca-bd7241e8666f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:46.877434 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2edb27-704d-4259-96ca-bd7241e8666f service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:46.887050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1404/2787] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:39:46.908187 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-51f303ed-74ac-4a2d-adea-547065e28e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035222be838443a9b7aaec562bd9cbbb', 'request_id': 'req-51f303ed-74ac-4a2d-adea-547065e28e56'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.916202 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-51f303ed-74ac-4a2d-adea-547065e28e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035222be838443a9b7aaec562bd9cbbb', 'request_id': 'req-51f303ed-74ac-4a2d-adea-547065e28e56'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.922167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-51f303ed-74ac-4a2d-adea-547065e28e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035222be838443a9b7aaec562bd9cbbb', 'request_id': 'req-51f303ed-74ac-4a2d-adea-547065e28e56'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.933794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-51f303ed-74ac-4a2d-adea-547065e28e56 admin admin] The token cache is being invalidate because project 035222be838443a9b7aaec562bd9cbbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:39:46.934076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-51f303ed-74ac-4a2d-adea-547065e28e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.934915 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-51f303ed-74ac-4a2d-adea-547065e28e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:46.936687 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1384/2788] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:39:46 2022] DELETE /identity/v3/projects/035222be838443a9b7aaec562bd9cbbb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:39:47.181152 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2edb27-704d-4259-96ca-bd7241e8666f service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:47.182656 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-5d2edb27-704d-4259-96ca-bd7241e8666f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:47.195108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2edb27-704d-4259-96ca-bd7241e8666f service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:47.249779 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:47.250635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:47.250915 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:47.251212 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e admin admin] PATH_INFO: `/v3/projects/df29f84a3d734b27b25bd590cb8dc207` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:47.252374 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e admin admin] RBAC: Authorizing `identity:delete_project(project_id=df29f84a3d734b27b25bd590cb8dc207)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:47.254333 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:47.297391 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df29f84a3d734b27b25bd590cb8dc207', 'request_id': 'req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:47.303084 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df29f84a3d734b27b25bd590cb8dc207', 'request_id': 'req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:47.308799 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df29f84a3d734b27b25bd590cb8dc207', 'request_id': 'req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:47.320018 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e admin admin] The token cache is being invalidate because project df29f84a3d734b27b25bd590cb8dc207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:39:47.320301 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:47.320905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-fed7b5a6-cb30-4fdf-9754-6fcf3ddb564e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:47.322438 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1405/2789] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:39:47 2022] DELETE /identity/v3/projects/df29f84a3d734b27b25bd590cb8dc207 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:47.327215 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312dacd-ac14-4eb0-9065-773278db422d None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:47.327683 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312dacd-ac14-4eb0-9065-773278db422d None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:47.327785 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312dacd-ac14-4eb0-9065-773278db422d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:47.373412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-1312dacd-ac14-4eb0-9065-773278db422d None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:47.374588 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-1312dacd-ac14-4eb0-9065-773278db422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:47.430072 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1385/2790] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:47.437671 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670635fd-aabe-4b8a-a2ae-2973c8971a58 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:47.438143 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670635fd-aabe-4b8a-a2ae-2973c8971a58 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:47.438238 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670635fd-aabe-4b8a-a2ae-2973c8971a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:47.456540 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-670635fd-aabe-4b8a-a2ae-2973c8971a58 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:47.457781 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-670635fd-aabe-4b8a-a2ae-2973c8971a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:47.468108 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1406/2791] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:47.472154 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312dacd-ac14-4eb0-9065-773278db422d None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:47.481950 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1312dacd-ac14-4eb0-9065-773278db422d None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:47.486454 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc4b3c-d0f8-4432-97f0-73e35729f779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:47.487099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc4b3c-d0f8-4432-97f0-73e35729f779 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:47.487380 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc4b3c-d0f8-4432-97f0-73e35729f779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:47.487652 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc4b3c-d0f8-4432-97f0-73e35729f779 admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:47.488368 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc4b3c-d0f8-4432-97f0-73e35729f779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:39:47.488675 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc4b3c-d0f8-4432-97f0-73e35729f779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:47.490339 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc4b3c-d0f8-4432-97f0-73e35729f779 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:47.501263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1386/2792] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:39:47.505371 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670635fd-aabe-4b8a-a2ae-2973c8971a58 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:47.515122 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670635fd-aabe-4b8a-a2ae-2973c8971a58 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:47.519879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156ba3a-70e8-436c-96bb-1e0ed7a9cb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:47.520599 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156ba3a-70e8-436c-96bb-1e0ed7a9cb52 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:47.520816 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156ba3a-70e8-436c-96bb-1e0ed7a9cb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:47.521641 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156ba3a-70e8-436c-96bb-1e0ed7a9cb52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:47.522592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156ba3a-70e8-436c-96bb-1e0ed7a9cb52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:47.524495 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156ba3a-70e8-436c-96bb-1e0ed7a9cb52 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:47.549024 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1407/2793] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:39:47 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:39:47.553305 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc4b3c-d0f8-4432-97f0-73e35729f779 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:47.562882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc4b3c-d0f8-4432-97f0-73e35729f779 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:47.617520 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acd8ea-729d-4af8-a5b8-6e422b75eeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:47.618177 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acd8ea-729d-4af8-a5b8-6e422b75eeac admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:47.618461 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acd8ea-729d-4af8-a5b8-6e422b75eeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:47.618732 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acd8ea-729d-4af8-a5b8-6e422b75eeac admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:47.619405 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acd8ea-729d-4af8-a5b8-6e422b75eeac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:47.621307 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acd8ea-729d-4af8-a5b8-6e422b75eeac admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:47.639114 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1387/2794] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:39:47 2022] POST /identity/v3/users => generated 283 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:39:47.643117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156ba3a-70e8-436c-96bb-1e0ed7a9cb52 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:47.654359 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156ba3a-70e8-436c-96bb-1e0ed7a9cb52 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:47.658985 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c425db-cc16-4644-8d92-4779a72b0bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:47.659635 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c425db-cc16-4644-8d92-4779a72b0bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:47.659911 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c425db-cc16-4644-8d92-4779a72b0bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:47.660181 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c425db-cc16-4644-8d92-4779a72b0bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:47.660899 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c425db-cc16-4644-8d92-4779a72b0bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:47.663119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c425db-cc16-4644-8d92-4779a72b0bc9 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:47.673272 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1408/2795] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:39:47.677025 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acd8ea-729d-4af8-a5b8-6e422b75eeac admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:47.686839 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acd8ea-729d-4af8-a5b8-6e422b75eeac admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:47.691352 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd596468-4fa0-42e1-b6bf-ca38b8ccd858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:47.692000 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd596468-4fa0-42e1-b6bf-ca38b8ccd858 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:47.692280 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd596468-4fa0-42e1-b6bf-ca38b8ccd858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:47.692551 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd596468-4fa0-42e1-b6bf-ca38b8ccd858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:47.693323 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd596468-4fa0-42e1-b6bf-ca38b8ccd858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:47.694882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd596468-4fa0-42e1-b6bf-ca38b8ccd858 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:47.704334 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1388/2796] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:39:47.708171 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c425db-cc16-4644-8d92-4779a72b0bc9 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:47.720820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c425db-cc16-4644-8d92-4779a72b0bc9 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:47.729451 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a03c6-d50b-4c0c-87b4-d45d0721f57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:47.731004 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a03c6-d50b-4c0c-87b4-d45d0721f57e admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:47.731503 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a03c6-d50b-4c0c-87b4-d45d0721f57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:47.732022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a03c6-d50b-4c0c-87b4-d45d0721f57e admin admin] PATH_INFO: `/v3/projects/388603c7facb430eb467e65416990064/users/8e1669f5da1a4b20979a22868185315b/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:47.748107 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a03c6-d50b-4c0c-87b4-d45d0721f57e admin admin] RBAC: Authorizing `identity:create_grant(project_id=388603c7facb430eb467e65416990064, user_id=8e1669f5da1a4b20979a22868185315b, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:47.750903 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a03c6-d50b-4c0c-87b4-d45d0721f57e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:47.762951 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1409/2797] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:39:47 2022] PUT /identity/v3/projects/388603c7facb430eb467e65416990064/users/8e1669f5da1a4b20979a22868185315b/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:47.774189 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16378099-63d0-47a5-a52d-c90e8eae94ce None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:47.774477 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16378099-63d0-47a5-a52d-c90e8eae94ce None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:47.774755 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16378099-63d0-47a5-a52d-c90e8eae94ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:47.801248 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-16378099-63d0-47a5-a52d-c90e8eae94ce None None] MFA Rules not processed for user `8e1669f5da1a4b20979a22868185315b`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:47.802429 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-16378099-63d0-47a5-a52d-c90e8eae94ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:47.862890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1389/2798] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:47.867238 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a03c6-d50b-4c0c-87b4-d45d0721f57e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:47.928987 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a03c6-d50b-4c0c-87b4-d45d0721f57e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:47.933547 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e8aa3-c1ae-4a63-985f-984b906fff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:47.934191 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e8aa3-c1ae-4a63-985f-984b906fff32 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:47.934560 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e8aa3-c1ae-4a63-985f-984b906fff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:47.934834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e8aa3-c1ae-4a63-985f-984b906fff32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:47.935518 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e8aa3-c1ae-4a63-985f-984b906fff32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:47.937478 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e8aa3-c1ae-4a63-985f-984b906fff32 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:47.961624 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1410/2799] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:39:47 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:39:47.965636 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16378099-63d0-47a5-a52d-c90e8eae94ce None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:47.976515 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16378099-63d0-47a5-a52d-c90e8eae94ce None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:48.032900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af777-84cb-4b96-9ad7-8d91213d6b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:48.033601 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af777-84cb-4b96-9ad7-8d91213d6b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:48.033883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af777-84cb-4b96-9ad7-8d91213d6b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:48.034155 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af777-84cb-4b96-9ad7-8d91213d6b43 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:48.034849 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60af777-84cb-4b96-9ad7-8d91213d6b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:48.037280 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60af777-84cb-4b96-9ad7-8d91213d6b43 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:48.056510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1390/2800] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:39:47 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:39:48.060513 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e8aa3-c1ae-4a63-985f-984b906fff32 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:48.070498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e8aa3-c1ae-4a63-985f-984b906fff32 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:48.075073 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606565f-02cf-4948-8c2e-8991c20221eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:48.075718 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606565f-02cf-4948-8c2e-8991c20221eb admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:48.075998 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606565f-02cf-4948-8c2e-8991c20221eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:48.076275 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606565f-02cf-4948-8c2e-8991c20221eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:48.077028 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606565f-02cf-4948-8c2e-8991c20221eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:48.078603 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606565f-02cf-4948-8c2e-8991c20221eb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:48.088905 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1411/2801] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:39:48.092936 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af777-84cb-4b96-9ad7-8d91213d6b43 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:48.103007 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af777-84cb-4b96-9ad7-8d91213d6b43 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:48.107659 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73c587-905d-4ecc-b0d2-edbe04b35368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:48.108526 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73c587-905d-4ecc-b0d2-edbe04b35368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:48.108807 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73c587-905d-4ecc-b0d2-edbe04b35368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:48.109116 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73c587-905d-4ecc-b0d2-edbe04b35368 admin admin] PATH_INFO: `/v3/projects/76292358beca4bd1ade300054bacf8a7/users/f410d7f54ec34858ba92191f6a18df6b/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:48.123818 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73c587-905d-4ecc-b0d2-edbe04b35368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76292358beca4bd1ade300054bacf8a7, user_id=f410d7f54ec34858ba92191f6a18df6b, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:48.126469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73c587-905d-4ecc-b0d2-edbe04b35368 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:48.138789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1391/2802] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:39:48 2022] PUT /identity/v3/projects/76292358beca4bd1ade300054bacf8a7/users/f410d7f54ec34858ba92191f6a18df6b/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:39:48.142577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606565f-02cf-4948-8c2e-8991c20221eb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:48.152242 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606565f-02cf-4948-8c2e-8991c20221eb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:48.206327 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8eceb-dbfd-4192-9bd2-497c9e7c6d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:48.206912 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8eceb-dbfd-4192-9bd2-497c9e7c6d6b admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:48.207194 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8eceb-dbfd-4192-9bd2-497c9e7c6d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:48.207470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8eceb-dbfd-4192-9bd2-497c9e7c6d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:48.208185 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8eceb-dbfd-4192-9bd2-497c9e7c6d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:48.210474 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8eceb-dbfd-4192-9bd2-497c9e7c6d6b admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:48.220263 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1412/2803] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:39:48.225043 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73c587-905d-4ecc-b0d2-edbe04b35368 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:48.235242 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73c587-905d-4ecc-b0d2-edbe04b35368 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:48.239867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43054708-376b-4260-8527-544a75c12a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:48.240731 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43054708-376b-4260-8527-544a75c12a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:48.241044 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43054708-376b-4260-8527-544a75c12a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:48.241328 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43054708-376b-4260-8527-544a75c12a35 admin admin] PATH_INFO: `/v3/projects/76292358beca4bd1ade300054bacf8a7/users/f410d7f54ec34858ba92191f6a18df6b/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:48.243301 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43054708-376b-4260-8527-544a75c12a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76292358beca4bd1ade300054bacf8a7, user_id=f410d7f54ec34858ba92191f6a18df6b, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:48.245951 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43054708-376b-4260-8527-544a75c12a35 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:48.255927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1392/2804] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:39:48 2022] PUT /identity/v3/projects/76292358beca4bd1ade300054bacf8a7/users/f410d7f54ec34858ba92191f6a18df6b/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:48.267313 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c000-c012-454c-af2a-24709e8d09c6 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:48.267602 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c000-c012-454c-af2a-24709e8d09c6 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:48.268016 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637c000-c012-454c-af2a-24709e8d09c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:48.295113 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8637c000-c012-454c-af2a-24709e8d09c6 None None] MFA Rules not processed for user `f410d7f54ec34858ba92191f6a18df6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:48.296305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8637c000-c012-454c-af2a-24709e8d09c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:48.359892 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1413/2805] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:48.371192 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43054708-376b-4260-8527-544a75c12a35 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:48.372883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-43054708-376b-4260-8527-544a75c12a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:48.427943 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43054708-376b-4260-8527-544a75c12a35 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:48.431561 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7474999-4330-461f-a112-d97a31e40932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:48.432189 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474999-4330-461f-a112-d97a31e40932 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:48.432474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474999-4330-461f-a112-d97a31e40932 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:48.432753 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7474999-4330-461f-a112-d97a31e40932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:48.441784 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7474999-4330-461f-a112-d97a31e40932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:48.443252 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7474999-4330-461f-a112-d97a31e40932 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:48.452347 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1393/2806] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:39:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:39:48.525858 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c000-c012-454c-af2a-24709e8d09c6 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:48.535190 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8637c000-c012-454c-af2a-24709e8d09c6 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:48.539328 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0867e02-795c-4800-b5d2-1f3d3c9ef92e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:48.539954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0867e02-795c-4800-b5d2-1f3d3c9ef92e service cinder] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:48.540240 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0867e02-795c-4800-b5d2-1f3d3c9ef92e service cinder] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:48.540510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0867e02-795c-4800-b5d2-1f3d3c9ef92e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:48.596555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0867e02-795c-4800-b5d2-1f3d3c9ef92e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:48.598048 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0867e02-795c-4800-b5d2-1f3d3c9ef92e service cinder] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:48.606529 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1414/2807] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:39:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:39:51.270310 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7474999-4330-461f-a112-d97a31e40932 service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:51.329923 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7474999-4330-461f-a112-d97a31e40932 service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:51.334442 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94544807-d150-4491-8f59-6bbdd74e2967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:51.335302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94544807-d150-4491-8f59-6bbdd74e2967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:51.335589 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94544807-d150-4491-8f59-6bbdd74e2967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:51.335866 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94544807-d150-4491-8f59-6bbdd74e2967 admin admin] PATH_INFO: `/v3/users/8e1669f5da1a4b20979a22868185315b` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:51.337082 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94544807-d150-4491-8f59-6bbdd74e2967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e1669f5da1a4b20979a22868185315b)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:51.338997 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94544807-d150-4491-8f59-6bbdd74e2967 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:51.381857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-94544807-d150-4491-8f59-6bbdd74e2967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e1669f5da1a4b20979a22868185315b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:51.382502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-94544807-d150-4491-8f59-6bbdd74e2967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e1669f5da1a4b20979a22868185315b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:51.393725 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-94544807-d150-4491-8f59-6bbdd74e2967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e1669f5da1a4b20979a22868185315b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:51.400533 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-94544807-d150-4491-8f59-6bbdd74e2967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e1669f5da1a4b20979a22868185315b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:51.407153 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-94544807-d150-4491-8f59-6bbdd74e2967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e1669f5da1a4b20979a22868185315b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:51.412956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1394/2808] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:39:51 2022] DELETE /identity/v3/users/8e1669f5da1a4b20979a22868185315b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:51.417753 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf206af-ffd7-4216-ae9d-193f3dfbbc09 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:51.418256 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf206af-ffd7-4216-ae9d-193f3dfbbc09 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:51.418379 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf206af-ffd7-4216-ae9d-193f3dfbbc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:51.435695 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-ecf206af-ffd7-4216-ae9d-193f3dfbbc09 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:51.436866 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ecf206af-ffd7-4216-ae9d-193f3dfbbc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:51.491707 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1415/2809] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:51.503084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94544807-d150-4491-8f59-6bbdd74e2967 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:51.504397 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-94544807-d150-4491-8f59-6bbdd74e2967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:51.559451 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94544807-d150-4491-8f59-6bbdd74e2967 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:51.563263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e4915-5b6f-486a-b65a-602f75557d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:51.563907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e4915-5b6f-486a-b65a-602f75557d1c service neutron] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:51.564196 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e4915-5b6f-486a-b65a-602f75557d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:51.564474 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e4915-5b6f-486a-b65a-602f75557d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:51.574322 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e4915-5b6f-486a-b65a-602f75557d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:51.575773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e4915-5b6f-486a-b65a-602f75557d1c service neutron] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:51.585282 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1395/2810] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:39:51.842341 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf206af-ffd7-4216-ae9d-193f3dfbbc09 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:51.843949 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ecf206af-ffd7-4216-ae9d-193f3dfbbc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:51.856489 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf206af-ffd7-4216-ae9d-193f3dfbbc09 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:51.861393 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:51.862787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:51.863662 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:51.864260 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] PATH_INFO: `/v3/projects/388603c7facb430eb467e65416990064` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:51.866450 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=388603c7facb430eb467e65416990064)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:51.868608 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:51.914027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388603c7facb430eb467e65416990064', 'request_id': 'req-890c4f54-44ad-4f66-8fb3-a841db5844a0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:51.919364 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388603c7facb430eb467e65416990064', 'request_id': 'req-890c4f54-44ad-4f66-8fb3-a841db5844a0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:51.925315 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388603c7facb430eb467e65416990064', 'request_id': 'req-890c4f54-44ad-4f66-8fb3-a841db5844a0'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:51.937434 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] The token cache is being invalidate because project 388603c7facb430eb467e65416990064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:39:51.937722 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:51.938336 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:51.939853 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1416/2811] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:39:51 2022] DELETE /identity/v3/projects/388603c7facb430eb467e65416990064 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:51.943987 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e4915-5b6f-486a-b65a-602f75557d1c service neutron] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:51.953663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e4915-5b6f-486a-b65a-602f75557d1c service neutron] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:52.008456 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bdb97-f6df-4364-a430-cf80abdbddf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:52.009333 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bdb97-f6df-4364-a430-cf80abdbddf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:52.009619 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bdb97-f6df-4364-a430-cf80abdbddf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:52.009900 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bdb97-f6df-4364-a430-cf80abdbddf5 admin admin] PATH_INFO: `/v3/users/f410d7f54ec34858ba92191f6a18df6b` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:52.011076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bdb97-f6df-4364-a430-cf80abdbddf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f410d7f54ec34858ba92191f6a18df6b)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:52.013013 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bdb97-f6df-4364-a430-cf80abdbddf5 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:52.057840 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a79bdb97-f6df-4364-a430-cf80abdbddf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f410d7f54ec34858ba92191f6a18df6b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:52.058430 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a79bdb97-f6df-4364-a430-cf80abdbddf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f410d7f54ec34858ba92191f6a18df6b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:52.069985 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a79bdb97-f6df-4364-a430-cf80abdbddf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f410d7f54ec34858ba92191f6a18df6b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:52.076628 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a79bdb97-f6df-4364-a430-cf80abdbddf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f410d7f54ec34858ba92191f6a18df6b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:52.084412 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-a79bdb97-f6df-4364-a430-cf80abdbddf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f410d7f54ec34858ba92191f6a18df6b'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:52.090296 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1396/2812] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:39:51 2022] DELETE /identity/v3/users/f410d7f54ec34858ba92191f6a18df6b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:39:52.346090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:52.347610 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:52.360516 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c4f54-44ad-4f66-8fb3-a841db5844a0 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:52.415429 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37903cf-59ba-4598-a0be-b616add83295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:52.416274 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37903cf-59ba-4598-a0be-b616add83295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:52.416553 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37903cf-59ba-4598-a0be-b616add83295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:52.416822 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37903cf-59ba-4598-a0be-b616add83295 admin admin] PATH_INFO: `/v3/projects/76292358beca4bd1ade300054bacf8a7` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:52.418015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37903cf-59ba-4598-a0be-b616add83295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76292358beca4bd1ade300054bacf8a7)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:52.420095 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37903cf-59ba-4598-a0be-b616add83295 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:52.470436 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c37903cf-59ba-4598-a0be-b616add83295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76292358beca4bd1ade300054bacf8a7', 'request_id': 'req-c37903cf-59ba-4598-a0be-b616add83295'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:52.475711 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c37903cf-59ba-4598-a0be-b616add83295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76292358beca4bd1ade300054bacf8a7', 'request_id': 'req-c37903cf-59ba-4598-a0be-b616add83295'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:52.481633 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c37903cf-59ba-4598-a0be-b616add83295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76292358beca4bd1ade300054bacf8a7', 'request_id': 'req-c37903cf-59ba-4598-a0be-b616add83295'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:52.493991 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c37903cf-59ba-4598-a0be-b616add83295 admin admin] The token cache is being invalidate because project 76292358beca4bd1ade300054bacf8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80021) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:39:52.494279 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c37903cf-59ba-4598-a0be-b616add83295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:52.494919 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-c37903cf-59ba-4598-a0be-b616add83295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:52.496462 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1417/2813] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:39:52 2022] DELETE /identity/v3/projects/76292358beca4bd1ade300054bacf8a7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:52.501517 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5e81e-f0f2-4c6a-94f7-33c47f949d04 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:52.501996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5e81e-f0f2-4c6a-94f7-33c47f949d04 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:52.502099 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5e81e-f0f2-4c6a-94f7-33c47f949d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:52.519365 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-c5d5e81e-f0f2-4c6a-94f7-33c47f949d04 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:52.520544 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-c5d5e81e-f0f2-4c6a-94f7-33c47f949d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:52.577977 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1397/2814] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:52.586475 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e64330-8f1b-4f98-8c92-cf39144e7736 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:52.586874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e64330-8f1b-4f98-8c92-cf39144e7736 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:52.587163 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e64330-8f1b-4f98-8c92-cf39144e7736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:52.605103 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-95e64330-8f1b-4f98-8c92-cf39144e7736 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:52.606244 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-95e64330-8f1b-4f98-8c92-cf39144e7736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:52.614058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1418/2815] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:52.618146 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5e81e-f0f2-4c6a-94f7-33c47f949d04 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:52.627616 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5e81e-f0f2-4c6a-94f7-33c47f949d04 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:52.632681 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2c3f8-a488-4629-a257-c187fea4c30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:52.633363 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2c3f8-a488-4629-a257-c187fea4c30a admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:52.633650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2c3f8-a488-4629-a257-c187fea4c30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:52.633947 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2c3f8-a488-4629-a257-c187fea4c30a admin admin] PATH_INFO: `/v3/domains` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:52.634657 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2c3f8-a488-4629-a257-c187fea4c30a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80020) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:39:52.634988 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2c3f8-a488-4629-a257-c187fea4c30a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:52.636542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2c3f8-a488-4629-a257-c187fea4c30a admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:52.648537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1398/2816] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:39:52.652571 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e64330-8f1b-4f98-8c92-cf39144e7736 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:52.661708 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e64330-8f1b-4f98-8c92-cf39144e7736 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:52.666318 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588c1cc-c33b-4268-90d5-47f24da4b322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:52.666961 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588c1cc-c33b-4268-90d5-47f24da4b322 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:52.667250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588c1cc-c33b-4268-90d5-47f24da4b322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:52.667530 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588c1cc-c33b-4268-90d5-47f24da4b322 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:52.668229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588c1cc-c33b-4268-90d5-47f24da4b322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:52.670150 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588c1cc-c33b-4268-90d5-47f24da4b322 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:52.695262 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1419/2817] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:39:52 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:39:52.699245 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2c3f8-a488-4629-a257-c187fea4c30a admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:52.708940 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2c3f8-a488-4629-a257-c187fea4c30a admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:52.763207 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635113e-8eb1-4a9d-a030-163046a424d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:52.763879 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635113e-8eb1-4a9d-a030-163046a424d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:52.764167 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635113e-8eb1-4a9d-a030-163046a424d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:52.764447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635113e-8eb1-4a9d-a030-163046a424d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:52.765178 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635113e-8eb1-4a9d-a030-163046a424d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:52.767084 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635113e-8eb1-4a9d-a030-163046a424d0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:52.786373 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1399/2818] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:39:52 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:39:52.790458 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588c1cc-c33b-4268-90d5-47f24da4b322 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:52.800491 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588c1cc-c33b-4268-90d5-47f24da4b322 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:52.805639 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b661fa7-fc23-46c7-be9a-6ce21b904637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:52.806293 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b661fa7-fc23-46c7-be9a-6ce21b904637 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:52.806584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b661fa7-fc23-46c7-be9a-6ce21b904637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:52.806865 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b661fa7-fc23-46c7-be9a-6ce21b904637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:52.807592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b661fa7-fc23-46c7-be9a-6ce21b904637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:52.809218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b661fa7-fc23-46c7-be9a-6ce21b904637 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:52.819698 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1420/2819] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:39:52.823394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635113e-8eb1-4a9d-a030-163046a424d0 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:52.832765 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635113e-8eb1-4a9d-a030-163046a424d0 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:52.837254 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c176f-2bfd-4487-875c-9003a4b17d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:52.837890 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c176f-2bfd-4487-875c-9003a4b17d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:52.838171 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c176f-2bfd-4487-875c-9003a4b17d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:52.838443 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c176f-2bfd-4487-875c-9003a4b17d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:52.839151 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c176f-2bfd-4487-875c-9003a4b17d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:52.840717 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c176f-2bfd-4487-875c-9003a4b17d7f admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:52.850134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1400/2820] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:39:52.853810 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b661fa7-fc23-46c7-be9a-6ce21b904637 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:52.863325 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b661fa7-fc23-46c7-be9a-6ce21b904637 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:52.868335 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a21548-4a8a-42bd-aed7-c99877048778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:52.869298 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21548-4a8a-42bd-aed7-c99877048778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:52.869584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21548-4a8a-42bd-aed7-c99877048778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:52.869861 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21548-4a8a-42bd-aed7-c99877048778 admin admin] PATH_INFO: `/v3/projects/dfdc20ef68e04d7791976767d263a069/users/b67c4e78d9154e59af6a58284a9b85a6/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:52.884229 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a21548-4a8a-42bd-aed7-c99877048778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfdc20ef68e04d7791976767d263a069, user_id=b67c4e78d9154e59af6a58284a9b85a6, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:52.886910 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a21548-4a8a-42bd-aed7-c99877048778 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:52.898999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1421/2821] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:39:52 2022] PUT /identity/v3/projects/dfdc20ef68e04d7791976767d263a069/users/b67c4e78d9154e59af6a58284a9b85a6/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:39:52.910372 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ded28-f12a-4965-9702-3944eedaa693 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:52.910663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ded28-f12a-4965-9702-3944eedaa693 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:52.910942 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ded28-f12a-4965-9702-3944eedaa693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:52.936436 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-b88ded28-f12a-4965-9702-3944eedaa693 None None] MFA Rules not processed for user `b67c4e78d9154e59af6a58284a9b85a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:52.937702 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b88ded28-f12a-4965-9702-3944eedaa693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:52.998236 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1401/2822] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:53.002728 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a21548-4a8a-42bd-aed7-c99877048778 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:53.061266 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a21548-4a8a-42bd-aed7-c99877048778 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:53.066958 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97372cb-70d4-4b3f-a29e-19db48cae1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:53.067620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97372cb-70d4-4b3f-a29e-19db48cae1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:53.068506 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97372cb-70d4-4b3f-a29e-19db48cae1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:53.068789 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97372cb-70d4-4b3f-a29e-19db48cae1f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:53.069535 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97372cb-70d4-4b3f-a29e-19db48cae1f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:53.071452 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97372cb-70d4-4b3f-a29e-19db48cae1f7 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:53.095570 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1422/2823] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:39:53 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:39:53.099933 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ded28-f12a-4965-9702-3944eedaa693 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:53.110147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ded28-f12a-4965-9702-3944eedaa693 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:53.163341 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59653dee-065c-41c7-bd5e-6b71b2606c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:53.164030 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653dee-065c-41c7-bd5e-6b71b2606c55 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:53.164319 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653dee-065c-41c7-bd5e-6b71b2606c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:53.164618 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59653dee-065c-41c7-bd5e-6b71b2606c55 admin admin] PATH_INFO: `/v3/users` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:53.165357 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59653dee-065c-41c7-bd5e-6b71b2606c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:53.167283 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59653dee-065c-41c7-bd5e-6b71b2606c55 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:53.186347 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1402/2824] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:39:53 2022] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:39:53.190427 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97372cb-70d4-4b3f-a29e-19db48cae1f7 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:53.200368 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97372cb-70d4-4b3f-a29e-19db48cae1f7 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:53.204921 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5258d-7d9a-4219-8f3a-ee593ad574fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:53.205605 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5258d-7d9a-4219-8f3a-ee593ad574fb admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:53.205888 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5258d-7d9a-4219-8f3a-ee593ad574fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:53.206187 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5258d-7d9a-4219-8f3a-ee593ad574fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:53.206907 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5258d-7d9a-4219-8f3a-ee593ad574fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:53.208498 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5258d-7d9a-4219-8f3a-ee593ad574fb admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:53.218559 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1423/2825] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:39:53.222311 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59653dee-065c-41c7-bd5e-6b71b2606c55 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:53.232331 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59653dee-065c-41c7-bd5e-6b71b2606c55 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:53.236886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dc0b4-466f-4e1d-be79-ed397abc3d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:53.237790 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dc0b4-466f-4e1d-be79-ed397abc3d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:53.238070 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dc0b4-466f-4e1d-be79-ed397abc3d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:53.238342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458dc0b4-466f-4e1d-be79-ed397abc3d30 admin admin] PATH_INFO: `/v3/projects/8a6aa8fa63f3442f9c82241dee217fdb/users/4e46685e67ca465aa8d6acc8d7c07356/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:53.252871 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dc0b4-466f-4e1d-be79-ed397abc3d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6aa8fa63f3442f9c82241dee217fdb, user_id=4e46685e67ca465aa8d6acc8d7c07356, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:53.255550 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458dc0b4-466f-4e1d-be79-ed397abc3d30 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:53.268828 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1403/2826] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:39:53 2022] PUT /identity/v3/projects/8a6aa8fa63f3442f9c82241dee217fdb/users/4e46685e67ca465aa8d6acc8d7c07356/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:39:53.272947 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5258d-7d9a-4219-8f3a-ee593ad574fb admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:53.282510 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5258d-7d9a-4219-8f3a-ee593ad574fb admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:53.337179 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fbb37-2193-4995-b3b7-5ed6f6fa4c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:53.337838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fbb37-2193-4995-b3b7-5ed6f6fa4c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:53.338117 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fbb37-2193-4995-b3b7-5ed6f6fa4c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:53.338392 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fbb37-2193-4995-b3b7-5ed6f6fa4c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:53.339114 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fbb37-2193-4995-b3b7-5ed6f6fa4c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:53.340731 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2fbb37-2193-4995-b3b7-5ed6f6fa4c7e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:53.350483 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1424/2827] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:39:53.354563 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dc0b4-466f-4e1d-be79-ed397abc3d30 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:53.364730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458dc0b4-466f-4e1d-be79-ed397abc3d30 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:53.369957 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b0fdc-5a55-4ceb-973b-79406f5e50fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:53.370830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b0fdc-5a55-4ceb-973b-79406f5e50fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:53.371112 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b0fdc-5a55-4ceb-973b-79406f5e50fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:53.371386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b0fdc-5a55-4ceb-973b-79406f5e50fd admin admin] PATH_INFO: `/v3/projects/8a6aa8fa63f3442f9c82241dee217fdb/users/4e46685e67ca465aa8d6acc8d7c07356/roles/958d8d89cd184e3ca4581a2e65fdc08e` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:53.373384 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b0fdc-5a55-4ceb-973b-79406f5e50fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6aa8fa63f3442f9c82241dee217fdb, user_id=4e46685e67ca465aa8d6acc8d7c07356, role_id=958d8d89cd184e3ca4581a2e65fdc08e)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:53.375993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b0fdc-5a55-4ceb-973b-79406f5e50fd admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:53.385830 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1404/2828] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:39:53 2022] PUT /identity/v3/projects/8a6aa8fa63f3442f9c82241dee217fdb/users/4e46685e67ca465aa8d6acc8d7c07356/roles/958d8d89cd184e3ca4581a2e65fdc08e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:53.395673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94edf-365a-410a-96d3-9d540b542689 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:53.395982 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94edf-365a-410a-96d3-9d540b542689 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:53.396265 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94edf-365a-410a-96d3-9d540b542689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:53.421978 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-72d94edf-365a-410a-96d3-9d540b542689 None None] MFA Rules not processed for user `4e46685e67ca465aa8d6acc8d7c07356`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:53.423082 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-72d94edf-365a-410a-96d3-9d540b542689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:53.491241 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1425/2829] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:39:53.504948 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b0fdc-5a55-4ceb-973b-79406f5e50fd admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:53.506650 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b16b0fdc-5a55-4ceb-973b-79406f5e50fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:53.561199 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b0fdc-5a55-4ceb-973b-79406f5e50fd admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:53.564856 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0643f-2232-4e1c-a005-5cffdfe18f33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:53.565516 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0643f-2232-4e1c-a005-5cffdfe18f33 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:53.565797 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0643f-2232-4e1c-a005-5cffdfe18f33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:53.566074 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0643f-2232-4e1c-a005-5cffdfe18f33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:53.574798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0643f-2232-4e1c-a005-5cffdfe18f33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:53.576210 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0643f-2232-4e1c-a005-5cffdfe18f33 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:53.585824 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1405/2830] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:39:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:39:53.877296 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d94edf-365a-410a-96d3-9d540b542689 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:53.886808 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d94edf-365a-410a-96d3-9d540b542689 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:53.891459 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa204f1-9ffb-4144-8100-ac7743e86938 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e46685e67ca465aa8d6acc8d7c07356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6aa8fa63f3442f9c82241dee217fdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:53.892121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa204f1-9ffb-4144-8100-ac7743e86938 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:53.892417 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa204f1-9ffb-4144-8100-ac7743e86938 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:53.892716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa204f1-9ffb-4144-8100-ac7743e86938 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:53.893532 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa204f1-9ffb-4144-8100-ac7743e86938 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:39:53.893867 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa204f1-9ffb-4144-8100-ac7743e86938 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:53.895620 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa204f1-9ffb-4144-8100-ac7743e86938 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:53.907970 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1426/2831] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:39:53.912023 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0643f-2232-4e1c-a005-5cffdfe18f33 service cinder] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:53.920883 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0643f-2232-4e1c-a005-5cffdfe18f33 service cinder] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:53.925480 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9c910-ecae-4d4d-bbc5-732a8104c382 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e46685e67ca465aa8d6acc8d7c07356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6aa8fa63f3442f9c82241dee217fdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:53.926124 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c910-ecae-4d4d-bbc5-732a8104c382 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:53.926414 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c910-ecae-4d4d-bbc5-732a8104c382 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:53.926697 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c910-ecae-4d4d-bbc5-732a8104c382 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:53.927387 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9c910-ecae-4d4d-bbc5-732a8104c382 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:53.929302 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9c910-ecae-4d4d-bbc5-732a8104c382 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:53.954506 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1406/2832] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:39:53 2022] POST /identity/v3/projects => generated 354 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:39:53.958415 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa204f1-9ffb-4144-8100-ac7743e86938 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:53.968549 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa204f1-9ffb-4144-8100-ac7743e86938 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:54.022116 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a2345-9218-4739-96ae-4893e8d455a2 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e46685e67ca465aa8d6acc8d7c07356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6aa8fa63f3442f9c82241dee217fdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:54.023027 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a2345-9218-4739-96ae-4893e8d455a2 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:54.023314 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a2345-9218-4739-96ae-4893e8d455a2 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:54.023593 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a2345-9218-4739-96ae-4893e8d455a2 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:54.024312 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a2345-9218-4739-96ae-4893e8d455a2 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:39:54.024623 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a2345-9218-4739-96ae-4893e8d455a2 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:54.026291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a2345-9218-4739-96ae-4893e8d455a2 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:54.037078 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1427/2833] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:39:54.071404 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9c910-ecae-4d4d-bbc5-732a8104c382 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:54.081469 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9c910-ecae-4d4d-bbc5-732a8104c382 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:54.086665 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707858b7-74f5-4741-9bfe-bdbfb957cfac tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e46685e67ca465aa8d6acc8d7c07356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a6aa8fa63f3442f9c82241dee217fdb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:54.087513 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707858b7-74f5-4741-9bfe-bdbfb957cfac tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:54.087806 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707858b7-74f5-4741-9bfe-bdbfb957cfac tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:54.088086 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707858b7-74f5-4741-9bfe-bdbfb957cfac tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] PATH_INFO: `/v3/projects/41df68eaa5694557b5f23671331393fa` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:54.089298 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707858b7-74f5-4741-9bfe-bdbfb957cfac tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] RBAC: Authorizing `identity:delete_project(project_id=41df68eaa5694557b5f23671331393fa)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:54.091190 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707858b7-74f5-4741-9bfe-bdbfb957cfac tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:54.136062 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-707858b7-74f5-4741-9bfe-bdbfb957cfac tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41df68eaa5694557b5f23671331393fa', 'request_id': 'req-707858b7-74f5-4741-9bfe-bdbfb957cfac'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:54.142993 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-707858b7-74f5-4741-9bfe-bdbfb957cfac tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41df68eaa5694557b5f23671331393fa', 'request_id': 'req-707858b7-74f5-4741-9bfe-bdbfb957cfac'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:54.149168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-707858b7-74f5-4741-9bfe-bdbfb957cfac tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41df68eaa5694557b5f23671331393fa', 'request_id': 'req-707858b7-74f5-4741-9bfe-bdbfb957cfac'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:54.159542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-707858b7-74f5-4741-9bfe-bdbfb957cfac tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] The token cache is being invalidate because project 41df68eaa5694557b5f23671331393fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:39:54.159831 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-707858b7-74f5-4741-9bfe-bdbfb957cfac tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:54.160479 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-707858b7-74f5-4741-9bfe-bdbfb957cfac tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:54.162098 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1407/2834] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:39:54 2022] DELETE /identity/v3/projects/41df68eaa5694557b5f23671331393fa => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:54.341231 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a2345-9218-4739-96ae-4893e8d455a2 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:54.342943 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-db3a2345-9218-4739-96ae-4893e8d455a2 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:54.405673 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a2345-9218-4739-96ae-4893e8d455a2 tempest-VolumeQuotaClassesTest-1873056024 tempest-VolumeQuotaClassesTest-1873056024-project-admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:54.461101 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1c2c7-54f9-48b2-bca5-af5a8fa92e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:54.462253 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1c2c7-54f9-48b2-bca5-af5a8fa92e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:54.462253 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1c2c7-54f9-48b2-bca5-af5a8fa92e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:54.463136 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1c2c7-54f9-48b2-bca5-af5a8fa92e5c admin admin] PATH_INFO: `/v3/users/b67c4e78d9154e59af6a58284a9b85a6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:54.464592 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1c2c7-54f9-48b2-bca5-af5a8fa92e5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b67c4e78d9154e59af6a58284a9b85a6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:54.466550 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce1c2c7-54f9-48b2-bca5-af5a8fa92e5c admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:54.512476 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0ce1c2c7-54f9-48b2-bca5-af5a8fa92e5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b67c4e78d9154e59af6a58284a9b85a6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:54.524022 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0ce1c2c7-54f9-48b2-bca5-af5a8fa92e5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b67c4e78d9154e59af6a58284a9b85a6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:54.530336 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0ce1c2c7-54f9-48b2-bca5-af5a8fa92e5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b67c4e78d9154e59af6a58284a9b85a6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:54.530992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0ce1c2c7-54f9-48b2-bca5-af5a8fa92e5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b67c4e78d9154e59af6a58284a9b85a6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:54.537546 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0ce1c2c7-54f9-48b2-bca5-af5a8fa92e5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b67c4e78d9154e59af6a58284a9b85a6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:54.543388 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1428/2835] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:39:54 2022] DELETE /identity/v3/users/b67c4e78d9154e59af6a58284a9b85a6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:54.547919 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f55c38-f42b-4670-8ac4-06622eca5247 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:54.548435 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f55c38-f42b-4670-8ac4-06622eca5247 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:54.548542 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f55c38-f42b-4670-8ac4-06622eca5247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:54.565959 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-06f55c38-f42b-4670-8ac4-06622eca5247 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:54.567144 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-06f55c38-f42b-4670-8ac4-06622eca5247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:54.624371 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1408/2836] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:54.633984 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1c2c7-54f9-48b2-bca5-af5a8fa92e5c admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:54.635378 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0ce1c2c7-54f9-48b2-bca5-af5a8fa92e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:54.690103 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1c2c7-54f9-48b2-bca5-af5a8fa92e5c admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:54.693827 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06a4bb-df44-4c76-80bf-deb1343c252d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:54.694468 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06a4bb-df44-4c76-80bf-deb1343c252d service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:54.694754 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06a4bb-df44-4c76-80bf-deb1343c252d service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:54.695033 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06a4bb-df44-4c76-80bf-deb1343c252d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:54.703800 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06a4bb-df44-4c76-80bf-deb1343c252d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:54.705250 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f06a4bb-df44-4c76-80bf-deb1343c252d service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:54.714365 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1429/2837] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:39:54.977894 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f55c38-f42b-4670-8ac4-06622eca5247 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:54.979500 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-06f55c38-f42b-4670-8ac4-06622eca5247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:54.992160 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f55c38-f42b-4670-8ac4-06622eca5247 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:54.997391 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:54.998255 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:54.998539 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:54.998816 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] PATH_INFO: `/v3/projects/dfdc20ef68e04d7791976767d263a069` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:55.000147 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfdc20ef68e04d7791976767d263a069)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:55.002197 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:55.049131 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfdc20ef68e04d7791976767d263a069', 'request_id': 'req-e03af989-4c6d-4613-8558-f422db3560cb'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.055789 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfdc20ef68e04d7791976767d263a069', 'request_id': 'req-e03af989-4c6d-4613-8558-f422db3560cb'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.061134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfdc20ef68e04d7791976767d263a069', 'request_id': 'req-e03af989-4c6d-4613-8558-f422db3560cb'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.071706 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] The token cache is being invalidate because project dfdc20ef68e04d7791976767d263a069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:39:55.071989 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.072620 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.074170 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1409/2838] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:39:54 2022] DELETE /identity/v3/projects/dfdc20ef68e04d7791976767d263a069 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:55.078209 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06a4bb-df44-4c76-80bf-deb1343c252d service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:55.088050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f06a4bb-df44-4c76-80bf-deb1343c252d service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:55.141817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430a702-fd8a-4de6-8c18-3164ecd01bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:55.142682 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430a702-fd8a-4de6-8c18-3164ecd01bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:55.142965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430a702-fd8a-4de6-8c18-3164ecd01bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:55.143270 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430a702-fd8a-4de6-8c18-3164ecd01bb0 admin admin] PATH_INFO: `/v3/users/4e46685e67ca465aa8d6acc8d7c07356` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:55.144480 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430a702-fd8a-4de6-8c18-3164ecd01bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e46685e67ca465aa8d6acc8d7c07356)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:55.146993 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430a702-fd8a-4de6-8c18-3164ecd01bb0 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:55.190962 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5430a702-fd8a-4de6-8c18-3164ecd01bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e46685e67ca465aa8d6acc8d7c07356'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.202080 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5430a702-fd8a-4de6-8c18-3164ecd01bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e46685e67ca465aa8d6acc8d7c07356'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.209023 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5430a702-fd8a-4de6-8c18-3164ecd01bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e46685e67ca465aa8d6acc8d7c07356'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.209683 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5430a702-fd8a-4de6-8c18-3164ecd01bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e46685e67ca465aa8d6acc8d7c07356'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.216470 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-5430a702-fd8a-4de6-8c18-3164ecd01bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e46685e67ca465aa8d6acc8d7c07356'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.222219 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1430/2839] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:39:55 2022] DELETE /identity/v3/users/4e46685e67ca465aa8d6acc8d7c07356 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:55.474378 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:55.475845 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:55.488751 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03af989-4c6d-4613-8558-f422db3560cb admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:55.551342 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c190bc-6401-42d4-9953-49a89fce39e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:55.552249 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c190bc-6401-42d4-9953-49a89fce39e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:55.552537 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c190bc-6401-42d4-9953-49a89fce39e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:55.552815 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c190bc-6401-42d4-9953-49a89fce39e6 admin admin] PATH_INFO: `/v3/projects/8a6aa8fa63f3442f9c82241dee217fdb` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:55.554022 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c190bc-6401-42d4-9953-49a89fce39e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6aa8fa63f3442f9c82241dee217fdb)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:55.555929 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c190bc-6401-42d4-9953-49a89fce39e6 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:55.600671 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-89c190bc-6401-42d4-9953-49a89fce39e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6aa8fa63f3442f9c82241dee217fdb', 'request_id': 'req-89c190bc-6401-42d4-9953-49a89fce39e6'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.607339 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-89c190bc-6401-42d4-9953-49a89fce39e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6aa8fa63f3442f9c82241dee217fdb', 'request_id': 'req-89c190bc-6401-42d4-9953-49a89fce39e6'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.612684 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-89c190bc-6401-42d4-9953-49a89fce39e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6aa8fa63f3442f9c82241dee217fdb', 'request_id': 'req-89c190bc-6401-42d4-9953-49a89fce39e6'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.623265 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-89c190bc-6401-42d4-9953-49a89fce39e6 admin admin] The token cache is being invalidate because project 8a6aa8fa63f3442f9c82241dee217fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:39:55.623548 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-89c190bc-6401-42d4-9953-49a89fce39e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.624177 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-89c190bc-6401-42d4-9953-49a89fce39e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:55.625717 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1410/2840] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:39:55 2022] DELETE /identity/v3/projects/8a6aa8fa63f3442f9c82241dee217fdb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:55.631191 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a8e8c-3e77-4eca-abae-19a6b2e2b487 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:55.631690 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a8e8c-3e77-4eca-abae-19a6b2e2b487 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:55.631803 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a8e8c-3e77-4eca-abae-19a6b2e2b487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:55.650221 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-c71a8e8c-3e77-4eca-abae-19a6b2e2b487 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:55.651414 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-c71a8e8c-3e77-4eca-abae-19a6b2e2b487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:55.707530 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1431/2841] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:55.715415 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc19c-dbec-4f10-a4d2-bb8bed677d6a None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:55.715730 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc19c-dbec-4f10-a4d2-bb8bed677d6a None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:55.716011 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fc19c-dbec-4f10-a4d2-bb8bed677d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:55.733655 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-8b2fc19c-dbec-4f10-a4d2-bb8bed677d6a None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:55.734838 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-8b2fc19c-dbec-4f10-a4d2-bb8bed677d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:55.743234 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1411/2842] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:55.747260 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a8e8c-3e77-4eca-abae-19a6b2e2b487 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:55.757194 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a8e8c-3e77-4eca-abae-19a6b2e2b487 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:55.761716 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116fa66-9c3b-43c2-9350-d96bdb79759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:55.762358 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116fa66-9c3b-43c2-9350-d96bdb79759e admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:55.762640 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116fa66-9c3b-43c2-9350-d96bdb79759e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:55.762917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c116fa66-9c3b-43c2-9350-d96bdb79759e admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:55.763672 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116fa66-9c3b-43c2-9350-d96bdb79759e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:39:55.763981 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116fa66-9c3b-43c2-9350-d96bdb79759e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:55.765600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c116fa66-9c3b-43c2-9350-d96bdb79759e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:55.776794 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1432/2843] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:39:55.780907 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fc19c-dbec-4f10-a4d2-bb8bed677d6a None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:55.791198 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fc19c-dbec-4f10-a4d2-bb8bed677d6a None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:55.799229 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cc47c-adc5-4d3e-ad0e-6dde009b5e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:55.799884 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cc47c-adc5-4d3e-ad0e-6dde009b5e0a admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:55.800168 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cc47c-adc5-4d3e-ad0e-6dde009b5e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:55.800447 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cc47c-adc5-4d3e-ad0e-6dde009b5e0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:55.801210 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cc47c-adc5-4d3e-ad0e-6dde009b5e0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:55.803897 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cc47c-adc5-4d3e-ad0e-6dde009b5e0a admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:55.831510 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1412/2844] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:39:55 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:39:55.834406 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116fa66-9c3b-43c2-9350-d96bdb79759e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:55.844000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c116fa66-9c3b-43c2-9350-d96bdb79759e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:55.897918 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06b41-9644-4d64-a53c-f4687e3db267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:55.898600 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06b41-9644-4d64-a53c-f4687e3db267 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:55.898881 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06b41-9644-4d64-a53c-f4687e3db267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:55.899155 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06b41-9644-4d64-a53c-f4687e3db267 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:55.899886 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d06b41-9644-4d64-a53c-f4687e3db267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:55.901894 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d06b41-9644-4d64-a53c-f4687e3db267 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:55.921035 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1433/2845] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:39:55 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:39:55.925166 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cc47c-adc5-4d3e-ad0e-6dde009b5e0a admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:55.935258 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cc47c-adc5-4d3e-ad0e-6dde009b5e0a admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:55.939881 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c85af-1a23-48ce-896b-de5713bc5399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:55.940567 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c85af-1a23-48ce-896b-de5713bc5399 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:55.940855 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c85af-1a23-48ce-896b-de5713bc5399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:55.941173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c85af-1a23-48ce-896b-de5713bc5399 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:55.941904 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c85af-1a23-48ce-896b-de5713bc5399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:55.943492 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c85af-1a23-48ce-896b-de5713bc5399 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:55.953642 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1413/2846] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:39:55.957391 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06b41-9644-4d64-a53c-f4687e3db267 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:55.967347 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06b41-9644-4d64-a53c-f4687e3db267 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:55.972160 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931386ab-a81d-4524-a532-3eafce4848b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:55.972820 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931386ab-a81d-4524-a532-3eafce4848b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:55.973141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931386ab-a81d-4524-a532-3eafce4848b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:55.973421 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931386ab-a81d-4524-a532-3eafce4848b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:55.974790 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931386ab-a81d-4524-a532-3eafce4848b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:55.976386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931386ab-a81d-4524-a532-3eafce4848b5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:55.987154 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1434/2847] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:39:55.991287 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c85af-1a23-48ce-896b-de5713bc5399 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:56.001598 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c85af-1a23-48ce-896b-de5713bc5399 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:56.006218 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9c9cc-fbf8-47f0-9b13-0d12b79a9f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:56.007085 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c9cc-fbf8-47f0-9b13-0d12b79a9f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:56.007370 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c9cc-fbf8-47f0-9b13-0d12b79a9f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:56.007645 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c9cc-fbf8-47f0-9b13-0d12b79a9f99 admin admin] PATH_INFO: `/v3/projects/6c3dcbf6512c400c9817aee575c8e4d6/users/a2e05a9921554d2394c985cdf1d46aa6/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:56.022272 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9c9cc-fbf8-47f0-9b13-0d12b79a9f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3dcbf6512c400c9817aee575c8e4d6, user_id=a2e05a9921554d2394c985cdf1d46aa6, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:56.025186 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9c9cc-fbf8-47f0-9b13-0d12b79a9f99 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:56.038486 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1414/2848] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:39:55 2022] PUT /identity/v3/projects/6c3dcbf6512c400c9817aee575c8e4d6/users/a2e05a9921554d2394c985cdf1d46aa6/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:56.049485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00ca5e-a76b-4979-9060-c15044734ee4 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:56.049776 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00ca5e-a76b-4979-9060-c15044734ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:56.050054 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00ca5e-a76b-4979-9060-c15044734ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:56.075992 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-1e00ca5e-a76b-4979-9060-c15044734ee4 None None] MFA Rules not processed for user `a2e05a9921554d2394c985cdf1d46aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:56.077247 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-1e00ca5e-a76b-4979-9060-c15044734ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:56.139047 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1435/2849] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:56.150741 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9c9cc-fbf8-47f0-9b13-0d12b79a9f99 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:56.152433 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-fed9c9cc-fbf8-47f0-9b13-0d12b79a9f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:56.207502 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9c9cc-fbf8-47f0-9b13-0d12b79a9f99 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:56.211798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e9847-3d73-4a18-9665-0c066517bcc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:56.212439 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e9847-3d73-4a18-9665-0c066517bcc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:56.212726 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e9847-3d73-4a18-9665-0c066517bcc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:56.213033 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e9847-3d73-4a18-9665-0c066517bcc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:56.221189 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e9847-3d73-4a18-9665-0c066517bcc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:56.222610 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e9847-3d73-4a18-9665-0c066517bcc5 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:56.231421 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1415/2850] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:39:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:39:56.250170 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00ca5e-a76b-4979-9060-c15044734ee4 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:56.310298 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00ca5e-a76b-4979-9060-c15044734ee4 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:56.314953 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b0516-ea52-4f3b-84cb-066f27022b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:56.315846 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0516-ea52-4f3b-84cb-066f27022b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:56.316125 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0516-ea52-4f3b-84cb-066f27022b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:56.316400 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b0516-ea52-4f3b-84cb-066f27022b7e admin admin] PATH_INFO: `/v3/users/a2e05a9921554d2394c985cdf1d46aa6` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:56.317636 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b0516-ea52-4f3b-84cb-066f27022b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e05a9921554d2394c985cdf1d46aa6)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:56.320090 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b0516-ea52-4f3b-84cb-066f27022b7e admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:56.362965 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0b6b0516-ea52-4f3b-84cb-066f27022b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e05a9921554d2394c985cdf1d46aa6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:56.374015 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0b6b0516-ea52-4f3b-84cb-066f27022b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e05a9921554d2394c985cdf1d46aa6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:56.381128 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0b6b0516-ea52-4f3b-84cb-066f27022b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e05a9921554d2394c985cdf1d46aa6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:56.381814 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0b6b0516-ea52-4f3b-84cb-066f27022b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e05a9921554d2394c985cdf1d46aa6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:56.389901 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-0b6b0516-ea52-4f3b-84cb-066f27022b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e05a9921554d2394c985cdf1d46aa6'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:56.395695 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1436/2851] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:39:56 2022] DELETE /identity/v3/users/a2e05a9921554d2394c985cdf1d46aa6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:56.400906 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4db183-7569-4498-a21a-f763a9a6f6c5 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:56.401231 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4db183-7569-4498-a21a-f763a9a6f6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:56.401512 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4db183-7569-4498-a21a-f763a9a6f6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:56.417954 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-0b4db183-7569-4498-a21a-f763a9a6f6c5 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:56.419134 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0b4db183-7569-4498-a21a-f763a9a6f6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:56.475263 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1416/2852] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:39:56.484719 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b0516-ea52-4f3b-84cb-066f27022b7e admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:56.486103 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-0b6b0516-ea52-4f3b-84cb-066f27022b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:56.540381 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b0516-ea52-4f3b-84cb-066f27022b7e admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:56.544019 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4efe6-5058-430f-8f53-40cd7d018a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:56.544657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4efe6-5058-430f-8f53-40cd7d018a05 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:56.544952 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4efe6-5058-430f-8f53-40cd7d018a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:56.545240 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4efe6-5058-430f-8f53-40cd7d018a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:56.554419 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4efe6-5058-430f-8f53-40cd7d018a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:56.555838 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4efe6-5058-430f-8f53-40cd7d018a05 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:56.564834 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1437/2853] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:39:56.816760 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4db183-7569-4498-a21a-f763a9a6f6c5 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:56.818798 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-0b4db183-7569-4498-a21a-f763a9a6f6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:56.831882 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4db183-7569-4498-a21a-f763a9a6f6c5 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:56.836875 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f62c4-798f-4ec9-9857-f7d2fa061500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:56.837955 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f62c4-798f-4ec9-9857-f7d2fa061500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:56.838271 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f62c4-798f-4ec9-9857-f7d2fa061500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:56.838575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f62c4-798f-4ec9-9857-f7d2fa061500 admin admin] PATH_INFO: `/v3/projects/6c3dcbf6512c400c9817aee575c8e4d6` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:56.839734 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f62c4-798f-4ec9-9857-f7d2fa061500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c3dcbf6512c400c9817aee575c8e4d6)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:56.841575 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f62c4-798f-4ec9-9857-f7d2fa061500 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:56.886694 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9a8f62c4-798f-4ec9-9857-f7d2fa061500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c3dcbf6512c400c9817aee575c8e4d6', 'request_id': 'req-9a8f62c4-798f-4ec9-9857-f7d2fa061500'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:56.893478 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9a8f62c4-798f-4ec9-9857-f7d2fa061500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c3dcbf6512c400c9817aee575c8e4d6', 'request_id': 'req-9a8f62c4-798f-4ec9-9857-f7d2fa061500'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:56.899059 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9a8f62c4-798f-4ec9-9857-f7d2fa061500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c3dcbf6512c400c9817aee575c8e4d6', 'request_id': 'req-9a8f62c4-798f-4ec9-9857-f7d2fa061500'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:56.909557 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9a8f62c4-798f-4ec9-9857-f7d2fa061500 admin admin] The token cache is being invalidate because project 6c3dcbf6512c400c9817aee575c8e4d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:39:56.909817 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9a8f62c4-798f-4ec9-9857-f7d2fa061500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:56.910414 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-9a8f62c4-798f-4ec9-9857-f7d2fa061500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:56.912462 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1417/2854] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:39:56 2022] DELETE /identity/v3/projects/6c3dcbf6512c400c9817aee575c8e4d6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:56.918259 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef0d43-7473-44bf-aebd-be40832cbf77 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:56.918757 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef0d43-7473-44bf-aebd-be40832cbf77 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:56.918866 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef0d43-7473-44bf-aebd-be40832cbf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:56.936831 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-78ef0d43-7473-44bf-aebd-be40832cbf77 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:56.938038 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-78ef0d43-7473-44bf-aebd-be40832cbf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:56.993421 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1438/2855] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:57.001194 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9766149-3cdf-4214-881c-e01d7ad9d384 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:57.001496 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9766149-3cdf-4214-881c-e01d7ad9d384 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:57.001780 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9766149-3cdf-4214-881c-e01d7ad9d384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:57.019551 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-e9766149-3cdf-4214-881c-e01d7ad9d384 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:57.020750 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-e9766149-3cdf-4214-881c-e01d7ad9d384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:57.030391 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1418/2856] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:57.034700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef0d43-7473-44bf-aebd-be40832cbf77 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:57.044493 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef0d43-7473-44bf-aebd-be40832cbf77 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:57.048990 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95bb4c-2ffd-4d85-a571-2364770a84b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:57.049649 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bb4c-2ffd-4d85-a571-2364770a84b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:57.049928 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bb4c-2ffd-4d85-a571-2364770a84b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:57.050201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bb4c-2ffd-4d85-a571-2364770a84b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:57.050914 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95bb4c-2ffd-4d85-a571-2364770a84b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:39:57.051218 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95bb4c-2ffd-4d85-a571-2364770a84b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:57.053386 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95bb4c-2ffd-4d85-a571-2364770a84b5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:57.064325 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1439/2857] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:39:57.068596 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9766149-3cdf-4214-881c-e01d7ad9d384 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:57.077664 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9766149-3cdf-4214-881c-e01d7ad9d384 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:57.082349 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f59250-8af4-44f4-a833-f3543070b0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:57.082996 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f59250-8af4-44f4-a833-f3543070b0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:57.083288 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f59250-8af4-44f4-a833-f3543070b0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:57.083594 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f59250-8af4-44f4-a833-f3543070b0b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:57.084308 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f59250-8af4-44f4-a833-f3543070b0b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:57.086223 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f59250-8af4-44f4-a833-f3543070b0b5 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:57.113958 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1419/2858] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:39:57 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:39:57.115721 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95bb4c-2ffd-4d85-a571-2364770a84b5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:57.125583 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95bb4c-2ffd-4d85-a571-2364770a84b5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:57.179657 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c223507-65e7-441d-9565-5dc8099525f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:57.180235 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c223507-65e7-441d-9565-5dc8099525f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:57.180514 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c223507-65e7-441d-9565-5dc8099525f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:57.180787 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c223507-65e7-441d-9565-5dc8099525f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:57.181501 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c223507-65e7-441d-9565-5dc8099525f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:57.183401 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c223507-65e7-441d-9565-5dc8099525f5 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:57.202258 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1440/2859] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:39:57 2022] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:39:57.206481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f59250-8af4-44f4-a833-f3543070b0b5 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:57.217083 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f59250-8af4-44f4-a833-f3543070b0b5 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:57.221738 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467bbbd-172b-434f-9a84-d7e91b20f09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:57.222389 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467bbbd-172b-434f-9a84-d7e91b20f09b admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:57.222677 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467bbbd-172b-434f-9a84-d7e91b20f09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:57.222956 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467bbbd-172b-434f-9a84-d7e91b20f09b admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:57.223679 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467bbbd-172b-434f-9a84-d7e91b20f09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:57.225922 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467bbbd-172b-434f-9a84-d7e91b20f09b admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:57.235886 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1420/2860] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:39:57.239545 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c223507-65e7-441d-9565-5dc8099525f5 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:57.249119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c223507-65e7-441d-9565-5dc8099525f5 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:57.253666 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bba06c-2d10-403c-8615-3296dc03f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:57.254304 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bba06c-2d10-403c-8615-3296dc03f3ce admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:57.254584 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bba06c-2d10-403c-8615-3296dc03f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:57.254855 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bba06c-2d10-403c-8615-3296dc03f3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:57.255569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bba06c-2d10-403c-8615-3296dc03f3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:57.257169 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bba06c-2d10-403c-8615-3296dc03f3ce admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:57.266482 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1441/2861] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:39:57.270355 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467bbbd-172b-434f-9a84-d7e91b20f09b admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:57.280585 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467bbbd-172b-434f-9a84-d7e91b20f09b admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:57.285233 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c8d76-c82e-468d-88f9-8f9621a7b28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:57.286097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c8d76-c82e-468d-88f9-8f9621a7b28f admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:57.286398 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c8d76-c82e-468d-88f9-8f9621a7b28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:57.287205 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c8d76-c82e-468d-88f9-8f9621a7b28f admin admin] PATH_INFO: `/v3/projects/fda160fed0214238a6849d1064c6bf25/users/dad7982483f14c01869dbc6a05794257/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:57.301315 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c8d76-c82e-468d-88f9-8f9621a7b28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda160fed0214238a6849d1064c6bf25, user_id=dad7982483f14c01869dbc6a05794257, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:57.303953 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c8d76-c82e-468d-88f9-8f9621a7b28f admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:57.316180 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1421/2862] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:39:57 2022] PUT /identity/v3/projects/fda160fed0214238a6849d1064c6bf25/users/dad7982483f14c01869dbc6a05794257/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:57.326366 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28348b9-2275-4984-8e37-79001ddb8506 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:57.326654 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28348b9-2275-4984-8e37-79001ddb8506 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:57.326931 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28348b9-2275-4984-8e37-79001ddb8506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:57.353064 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-a28348b9-2275-4984-8e37-79001ddb8506 None None] MFA Rules not processed for user `dad7982483f14c01869dbc6a05794257`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:57.354243 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-a28348b9-2275-4984-8e37-79001ddb8506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:57.414561 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1442/2863] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:57.425538 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c8d76-c82e-468d-88f9-8f9621a7b28f admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:57.427253 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-6a6c8d76-c82e-468d-88f9-8f9621a7b28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:57.482286 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c8d76-c82e-468d-88f9-8f9621a7b28f admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:57.485857 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7d693-d25f-4d3b-93ad-5a7b39782ce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:57.486491 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d693-d25f-4d3b-93ad-5a7b39782ce9 service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:57.486773 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d693-d25f-4d3b-93ad-5a7b39782ce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:57.487046 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d693-d25f-4d3b-93ad-5a7b39782ce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:57.495047 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7d693-d25f-4d3b-93ad-5a7b39782ce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:57.496450 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7d693-d25f-4d3b-93ad-5a7b39782ce9 service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:57.504888 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1422/2864] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:39:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:39:57.529505 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28348b9-2275-4984-8e37-79001ddb8506 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:57.597461 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28348b9-2275-4984-8e37-79001ddb8506 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:57.599331 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b383493-ded0-441b-ba9f-2439b6c9d433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:57.600201 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b383493-ded0-441b-ba9f-2439b6c9d433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:57.600485 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b383493-ded0-441b-ba9f-2439b6c9d433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:57.600813 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b383493-ded0-441b-ba9f-2439b6c9d433 admin admin] PATH_INFO: `/v3/users/dad7982483f14c01869dbc6a05794257` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:57.602063 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b383493-ded0-441b-ba9f-2439b6c9d433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad7982483f14c01869dbc6a05794257)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:57.603977 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b383493-ded0-441b-ba9f-2439b6c9d433 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:57.647954 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6b383493-ded0-441b-ba9f-2439b6c9d433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad7982483f14c01869dbc6a05794257'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:57.659280 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6b383493-ded0-441b-ba9f-2439b6c9d433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad7982483f14c01869dbc6a05794257'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:57.665869 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6b383493-ded0-441b-ba9f-2439b6c9d433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad7982483f14c01869dbc6a05794257'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:57.666555 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6b383493-ded0-441b-ba9f-2439b6c9d433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad7982483f14c01869dbc6a05794257'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:57.674255 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-6b383493-ded0-441b-ba9f-2439b6c9d433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad7982483f14c01869dbc6a05794257'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:57.679989 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1443/2865] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:39:57 2022] DELETE /identity/v3/users/dad7982483f14c01869dbc6a05794257 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:57.684521 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c286b-b51a-48a1-b311-c3836003c251 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:57.684812 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c286b-b51a-48a1-b311-c3836003c251 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:57.685135 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c286b-b51a-48a1-b311-c3836003c251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:57.702341 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-d90c286b-b51a-48a1-b311-c3836003c251 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:57.703519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d90c286b-b51a-48a1-b311-c3836003c251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:57.759731 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1423/2866] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:39:57.769141 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b383493-ded0-441b-ba9f-2439b6c9d433 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:57.770517 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-6b383493-ded0-441b-ba9f-2439b6c9d433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:57.827396 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b383493-ded0-441b-ba9f-2439b6c9d433 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:57.832833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee46506-8be9-48ea-b7a4-750386fabe06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:57.832833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee46506-8be9-48ea-b7a4-750386fabe06 service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:57.832833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee46506-8be9-48ea-b7a4-750386fabe06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:57.832833 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee46506-8be9-48ea-b7a4-750386fabe06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:57.841614 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee46506-8be9-48ea-b7a4-750386fabe06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:57.843058 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee46506-8be9-48ea-b7a4-750386fabe06 service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:57.852650 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1444/2867] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:39:58.106967 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c286b-b51a-48a1-b311-c3836003c251 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:58.108818 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-d90c286b-b51a-48a1-b311-c3836003c251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:58.121779 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c286b-b51a-48a1-b311-c3836003c251 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:58.126394 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:58.127247 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:58.127529 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:58.127808 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc admin admin] PATH_INFO: `/v3/projects/fda160fed0214238a6849d1064c6bf25` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:58.129068 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda160fed0214238a6849d1064c6bf25)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:58.131607 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:58.175617 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda160fed0214238a6849d1064c6bf25', 'request_id': 'req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:58.183244 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda160fed0214238a6849d1064c6bf25', 'request_id': 'req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:58.188846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda160fed0214238a6849d1064c6bf25', 'request_id': 'req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:58.201076 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc admin admin] The token cache is being invalidate because project fda160fed0214238a6849d1064c6bf25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:39:58.201663 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:58.202317 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-2b664a3d-17a3-4946-a91d-6d5d03bdf9cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:39:58.204927 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1424/2868] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:39:58 2022] DELETE /identity/v3/projects/fda160fed0214238a6849d1064c6bf25 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:58.210094 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f839086-2296-4643-a81f-52036e5c94c5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:58.210577 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f839086-2296-4643-a81f-52036e5c94c5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:58.210683 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f839086-2296-4643-a81f-52036e5c94c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:58.228214 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-8f839086-2296-4643-a81f-52036e5c94c5 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:58.229444 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-8f839086-2296-4643-a81f-52036e5c94c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:58.290469 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1445/2869] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 20:39:58.299218 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ab584-2da8-4476-b502-fb1276525df0 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:58.299513 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ab584-2da8-4476-b502-fb1276525df0 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:58.299796 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ab584-2da8-4476-b502-fb1276525df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:58.318505 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-9a9ab584-2da8-4476-b502-fb1276525df0 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:58.319695 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-9a9ab584-2da8-4476-b502-fb1276525df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:58.327471 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1425/2870] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:58.331632 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f839086-2296-4643-a81f-52036e5c94c5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:58.340917 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f839086-2296-4643-a81f-52036e5c94c5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:58.345486 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c44dfc-b15b-4499-9f8f-34a318787e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:58.346136 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c44dfc-b15b-4499-9f8f-34a318787e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:58.346421 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c44dfc-b15b-4499-9f8f-34a318787e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:58.346700 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c44dfc-b15b-4499-9f8f-34a318787e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:58.347423 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c44dfc-b15b-4499-9f8f-34a318787e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80021) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:39:58.347738 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c44dfc-b15b-4499-9f8f-34a318787e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:58.349874 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c44dfc-b15b-4499-9f8f-34a318787e40 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:58.360997 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1446/2871] 10.222.0.61 () {58 vars in 1152 bytes} [Tue May 10 20:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:39:58.414983 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ab584-2da8-4476-b502-fb1276525df0 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:58.424148 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ab584-2da8-4476-b502-fb1276525df0 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:58.429495 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90938ca-0443-4e43-b1a6-80e1d30d72b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:58.430148 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90938ca-0443-4e43-b1a6-80e1d30d72b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:58.430431 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90938ca-0443-4e43-b1a6-80e1d30d72b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:58.430722 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90938ca-0443-4e43-b1a6-80e1d30d72b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:58.431388 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90938ca-0443-4e43-b1a6-80e1d30d72b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:58.433312 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90938ca-0443-4e43-b1a6-80e1d30d72b0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:58.457383 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1426/2872] 10.222.0.61 () {60 vars in 1152 bytes} [Tue May 10 20:39:58 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:39:58.461400 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c44dfc-b15b-4499-9f8f-34a318787e40 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:58.471203 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c44dfc-b15b-4499-9f8f-34a318787e40 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:58.524654 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc381fd5-9bbe-48c6-b98b-8dc30bf66a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:58.525344 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc381fd5-9bbe-48c6-b98b-8dc30bf66a67 admin admin] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:58.525839 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc381fd5-9bbe-48c6-b98b-8dc30bf66a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:58.526121 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc381fd5-9bbe-48c6-b98b-8dc30bf66a67 admin admin] PATH_INFO: `/v3/users` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:58.526817 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc381fd5-9bbe-48c6-b98b-8dc30bf66a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:58.528754 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc381fd5-9bbe-48c6-b98b-8dc30bf66a67 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:58.548081 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1447/2873] 10.222.0.61 () {60 vars in 1143 bytes} [Tue May 10 20:39:58 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:39:58.552173 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90938ca-0443-4e43-b1a6-80e1d30d72b0 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:58.562749 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90938ca-0443-4e43-b1a6-80e1d30d72b0 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:58.567626 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257a9db-f2f5-4bc0-969a-3391096f7ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:58.568794 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a9db-f2f5-4bc0-969a-3391096f7ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:58.569123 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a9db-f2f5-4bc0-969a-3391096f7ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:58.569386 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a9db-f2f5-4bc0-969a-3391096f7ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:58.570140 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257a9db-f2f5-4bc0-969a-3391096f7ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:58.571758 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c257a9db-f2f5-4bc0-969a-3391096f7ad0 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:58.581836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1427/2874] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:39:58.586298 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc381fd5-9bbe-48c6-b98b-8dc30bf66a67 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:58.596119 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc381fd5-9bbe-48c6-b98b-8dc30bf66a67 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:58.600751 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c52694-b798-4456-b96d-d677633520f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:58.601448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c52694-b798-4456-b96d-d677633520f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:58.601734 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c52694-b798-4456-b96d-d677633520f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:58.602014 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c52694-b798-4456-b96d-d677633520f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:58.602744 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c52694-b798-4456-b96d-d677633520f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:58.604354 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c52694-b798-4456-b96d-d677633520f2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:58.613923 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1448/2875] 10.222.0.61 () {58 vars in 1121 bytes} [Tue May 10 20:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:39:58.617961 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257a9db-f2f5-4bc0-969a-3391096f7ad0 admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:58.627729 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257a9db-f2f5-4bc0-969a-3391096f7ad0 admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:58.632846 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6165c-a0fd-427d-ae92-1f896adc7f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:58.633754 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6165c-a0fd-427d-ae92-1f896adc7f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:58.634029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6165c-a0fd-427d-ae92-1f896adc7f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:58.634299 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6165c-a0fd-427d-ae92-1f896adc7f3e admin admin] PATH_INFO: `/v3/projects/4fd2396b9f4d4120a5a0a932859e643a/users/6a20e40ec1ac448c9b5a5cccbfadcc21/roles/dc43ddd6d3b649a187dbfe63b0e20247` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:58.648836 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6165c-a0fd-427d-ae92-1f896adc7f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd2396b9f4d4120a5a0a932859e643a, user_id=6a20e40ec1ac448c9b5a5cccbfadcc21, role_id=dc43ddd6d3b649a187dbfe63b0e20247)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:58.651470 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6165c-a0fd-427d-ae92-1f896adc7f3e admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:58.663635 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1428/2876] 10.222.0.61 () {60 vars in 1482 bytes} [Tue May 10 20:39:58 2022] PUT /identity/v3/projects/4fd2396b9f4d4120a5a0a932859e643a/users/6a20e40ec1ac448c9b5a5cccbfadcc21/roles/dc43ddd6d3b649a187dbfe63b0e20247 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:39:58.673275 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d83e1c-69ef-4361-8f8f-0f8ebd6ad6d5 None None] REQUEST_METHOD: `POST` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:58.673567 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d83e1c-69ef-4361-8f8f-0f8ebd6ad6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:58.673879 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d83e1c-69ef-4361-8f8f-0f8ebd6ad6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:58.700189 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.auth.core [None req-36d83e1c-69ef-4361-8f8f-0f8ebd6ad6d5 None None] MFA Rules not processed for user `6a20e40ec1ac448c9b5a5cccbfadcc21`. Rule list: `[]` (Enabled: `True`). {{(pid=80021) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:39:58.701419 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-36d83e1c-69ef-4361-8f8f-0f8ebd6ad6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:58.763081 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1449/2877] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:39:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:39:58.773867 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6165c-a0fd-427d-ae92-1f896adc7f3e admin admin] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:39:58.775578 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-b5f6165c-a0fd-427d-ae92-1f896adc7f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:39:58.830625 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6165c-a0fd-427d-ae92-1f896adc7f3e admin admin] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:39:58.834184 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d71883-5bb0-4788-acf7-84f78705c1bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f319323b3f3547849d452c1361764005', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:39:58.834817 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71883-5bb0-4788-acf7-84f78705c1bb service cinder] REQUEST_METHOD: `GET` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:39:58.835097 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71883-5bb0-4788-acf7-84f78705c1bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:39:58.835377 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d71883-5bb0-4788-acf7-84f78705c1bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:39:58.843366 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d71883-5bb0-4788-acf7-84f78705c1bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:39:58.844765 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d71883-5bb0-4788-acf7-84f78705c1bb service cinder] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:39:58.853350 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1429/2878] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:39:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 20:40:08.401140 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d83e1c-69ef-4361-8f8f-0f8ebd6ad6d5 None None] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:40:08.460044 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d83e1c-69ef-4361-8f8f-0f8ebd6ad6d5 None None] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:40:08.464413 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39eda2-c1cb-4a45-98e8-cb8bd1c723e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:40:08.465291 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39eda2-c1cb-4a45-98e8-cb8bd1c723e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:40:08.465569 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39eda2-c1cb-4a45-98e8-cb8bd1c723e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:40:08.465837 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39eda2-c1cb-4a45-98e8-cb8bd1c723e2 admin admin] PATH_INFO: `/v3/users/6a20e40ec1ac448c9b5a5cccbfadcc21` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:40:08.466999 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39eda2-c1cb-4a45-98e8-cb8bd1c723e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a20e40ec1ac448c9b5a5cccbfadcc21)` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:40:08.468896 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39eda2-c1cb-4a45-98e8-cb8bd1c723e2 admin admin] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:40:08.511973 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f39eda2-c1cb-4a45-98e8-cb8bd1c723e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a20e40ec1ac448c9b5a5cccbfadcc21'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:40:08.523409 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f39eda2-c1cb-4a45-98e8-cb8bd1c723e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a20e40ec1ac448c9b5a5cccbfadcc21'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:40:08.529927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f39eda2-c1cb-4a45-98e8-cb8bd1c723e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a20e40ec1ac448c9b5a5cccbfadcc21'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:40:08.530604 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f39eda2-c1cb-4a45-98e8-cb8bd1c723e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a20e40ec1ac448c9b5a5cccbfadcc21'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:40:08.538305 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.notifications [None req-3f39eda2-c1cb-4a45-98e8-cb8bd1c723e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a20e40ec1ac448c9b5a5cccbfadcc21'} {{(pid=80021) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:40:08.544050 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1450/2879] 10.222.0.61 () {58 vars in 1223 bytes} [Tue May 10 20:40:08 2022] DELETE /identity/v3/users/6a20e40ec1ac448c9b5a5cccbfadcc21 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:40:08.548536 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d386d27-0927-4cdf-ae24-176e7240a128 None None] REQUEST_METHOD: `POST` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:40:08.549039 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d386d27-0927-4cdf-ae24-176e7240a128 None None] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:40:08.549206 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d386d27-0927-4cdf-ae24-176e7240a128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:40:08.566021 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.auth.core [None req-7d386d27-0927-4cdf-ae24-176e7240a128 None None] MFA Rules not processed for user `caf7948704bc4cd8813f309af89db439`. Rule list: `[]` (Enabled: `True`). {{(pid=80020) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:40:08.567195 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7d386d27-0927-4cdf-ae24-176e7240a128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:40:08.627029 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1430/2880] 10.222.0.61 () {58 vars in 957 bytes} [Tue May 10 20:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 20:40:08.637204 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39eda2-c1cb-4a45-98e8-cb8bd1c723e2 admin admin] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:40:08.638591 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-3f39eda2-c1cb-4a45-98e8-cb8bd1c723e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:40:08.691927 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39eda2-c1cb-4a45-98e8-cb8bd1c723e2 admin admin] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:40:08.696159 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89bfe6-c70d-4384-b801-aa69c86f4ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e31558db83834034b7183223bbd0f84a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:40:08.696796 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89bfe6-c70d-4384-b801-aa69c86f4ace service neutron] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:40:08.697107 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89bfe6-c70d-4384-b801-aa69c86f4ace service neutron] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:40:08.697382 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89bfe6-c70d-4384-b801-aa69c86f4ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:40:08.706032 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89bfe6-c70d-4384-b801-aa69c86f4ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:40:08.707448 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89bfe6-c70d-4384-b801-aa69c86f4ace service neutron] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:40:08.716528 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1451/2881] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 20:40:08.967481 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d386d27-0927-4cdf-ae24-176e7240a128 None None] Authenticating user token {{(pid=80020) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:40:08.968893 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.fernet_utils [None req-7d386d27-0927-4cdf-ae24-176e7240a128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80020) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:40:08.981711 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d386d27-0927-4cdf-ae24-176e7240a128 None None] Validating token access rules against request {{(pid=80020) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:40:08.987444 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695cd23-d8b9-4685-b99c-70e0b34f19d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caf7948704bc4cd8813f309af89db439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92bd0a8a7f7646abb6287b06cfd28dac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80020) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:40:08.988519 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695cd23-d8b9-4685-b99c-70e0b34f19d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:40:08.988891 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695cd23-d8b9-4685-b99c-70e0b34f19d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:40:08.989264 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695cd23-d8b9-4685-b99c-70e0b34f19d7 admin admin] PATH_INFO: `/v3/projects/4fd2396b9f4d4120a5a0a932859e643a` {{(pid=80020) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:40:08.991198 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695cd23-d8b9-4685-b99c-70e0b34f19d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd2396b9f4d4120a5a0a932859e643a)` {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:40:08.993204 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695cd23-d8b9-4685-b99c-70e0b34f19d7 admin admin] RBAC: Authorization granted {{(pid=80020) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:40:09.038422 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0695cd23-d8b9-4685-b99c-70e0b34f19d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd2396b9f4d4120a5a0a932859e643a', 'request_id': 'req-0695cd23-d8b9-4685-b99c-70e0b34f19d7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:40:09.045221 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0695cd23-d8b9-4685-b99c-70e0b34f19d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd2396b9f4d4120a5a0a932859e643a', 'request_id': 'req-0695cd23-d8b9-4685-b99c-70e0b34f19d7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:40:09.050594 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0695cd23-d8b9-4685-b99c-70e0b34f19d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd2396b9f4d4120a5a0a932859e643a', 'request_id': 'req-0695cd23-d8b9-4685-b99c-70e0b34f19d7'} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:40:09.062004 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0695cd23-d8b9-4685-b99c-70e0b34f19d7 admin admin] The token cache is being invalidate because project 4fd2396b9f4d4120a5a0a932859e643a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80020) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 20:40:09.062293 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0695cd23-d8b9-4685-b99c-70e0b34f19d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:40:09.062935 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: DEBUG keystone.notifications [None req-0695cd23-d8b9-4685-b99c-70e0b34f19d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80020) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 20:40:09.064467 dv-cinder-828806-2-iscsi devstack@keystone.service[80020]: [pid: 80020|app: 0|req: 1431/2882] 10.222.0.61 () {58 vars in 1232 bytes} [Tue May 10 20:40:08 2022] DELETE /identity/v3/projects/4fd2396b9f4d4120a5a0a932859e643a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:40:27.282788 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89bfe6-c70d-4384-b801-aa69c86f4ace service neutron] Authenticating user token {{(pid=80021) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:40:27.284216 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-db89bfe6-c70d-4384-b801-aa69c86f4ace service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:40:27.372134 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89bfe6-c70d-4384-b801-aa69c86f4ace service neutron] Validating token access rules against request {{(pid=80021) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:40:27.430717 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cc3b0-2338-4d4d-a150-e00115ffd52e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4dc7b58c8a04b359a4a9bbab9e7b219', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7b37547e1bf4906b65ac39aad3a608c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80021) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:40:27.431441 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cc3b0-2338-4d4d-a150-e00115ffd52e service placement] REQUEST_METHOD: `GET` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:40:27.431723 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cc3b0-2338-4d4d-a150-e00115ffd52e service placement] SCRIPT_NAME: `/identity` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:40:27.432000 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cc3b0-2338-4d4d-a150-e00115ffd52e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80021) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:40:27.433783 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.fernet_utils [None req-ff0cc3b0-2338-4d4d-a150-e00115ffd52e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80021) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:40:27.445564 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cc3b0-2338-4d4d-a150-e00115ffd52e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:40:27.447248 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cc3b0-2338-4d4d-a150-e00115ffd52e service placement] RBAC: Authorization granted {{(pid=80021) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:40:27.457376 dv-cinder-828806-2-iscsi devstack@keystone.service[80021]: [pid: 80021|app: 0|req: 1452/2883] 10.222.0.61 () {60 vars in 1365 bytes} [Tue May 10 20:40:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)